利用XtraBackup給MYSQL熱備(基於數據文件)

利用XtraBackup給MYSQL熱備(基於數據文件)
利用 XtraBackup 快速配置主從服務器
這XtraBackup 個主要包含2個命令 xtrabackup 和 innobackupex 第一個是他的主程序另外個他本身封裝的腳本通常用腳原本完成備份
這是工做筆記比較凌亂湊合着看吧mysql

獲取XtraBackup

獲取XtraBackup(其中1.6裏面有個WIN版本的測試後很頭疼各類BUG未解決 WIN下的MYSQL仍是使用遠程備份吧)linux

http://www.percona.com/downloads/XtraBackup/sql

 
       1 
       # 例如個人環境是CENTOS 6X 64BIT的 
      
       2 
       mkdir -p $HOME/downloads;cd $HOME/downloads

1 # 多線程下載

`2`	`lftp -c` `"pget -n 30 http://www.percona.com/downloads/XtraBackup/LATEST/RPM/rhel6/x86_64/percona-xtrabackup-2.1.5-680.rhel6.x86_64.rpm"`

安裝

 
       1 
       # 而後安裝 
      
       2 
       # 安裝前可能須要 yum -y install libaio perl-Time-HiRes 
      
       3 
       # 而後再。。。 
      
       4 
       # 查看安裝包信息 
      
       5 
       rpm -qip percona-xtrabackup-2.1.5-680.rhel6.x86_64.rpm 
      
       6 
       # 安裝 
      
       7 
       rpm -ivh percona-xtrabackup-2.1.5-680.rhel6.x86_64.rpm 
      
       8 
       # 拆卸 
      
       9 
       rpm -e percona-xtrabackup

 
       1 
       # 不然可能出現如下提示 
      
       2 
       error: Failed dependencies: 
      
       3 
               libaio.so.1()(64bit) is needed by percona-xtrabackup-2.1.5-680.rhel6.x86_64 
      
       4 
               libaio.so.1(LIBAIO_0.1)(64bit) is needed by percona-xtrabackup-2.1.5-680.rhel6.x86_64 
      
       5 
               libaio.so.1(LIBAIO_0.4)(64bit) is needed by percona-xtrabackup-2.1.5-680.rhel6.x86_64 
      
       6 
               perl(Time::HiRes) is needed by percona-xtrabackup-2.1.5-680.rhel6.x86_64

 
       1 
       # 好 此次安裝順利過去了 
      
       2 
       xtrabackup --version 
      
       3 
       xtrabackup version 2.1.5 for Percona Server 5.1.70 unknown-linux-gnu (x86_64) (revision id: 680)

 
       1 
       # 
      
       2 
       開始備份(若是在MY.CNF裏面配置了[XtraBackup]節的用戶和密碼就可使用不帶密碼的方式備份) 
      
       3 
       BACKUP_DIR="/home/ftp/b/backup_data/wwwroot/2013/11/23/2" 
      
       4 
       mkdir -p $BACKUP_DIR 
      
       5 
       # xtrabackup --backup --datadir=Mysql源數據目錄 --target-dir=Mysql備份數據存放目錄 
      
       6 
       xtrabackup --backup --datadir=/var/lib/mysql/ --target-dir=$BACKUP_DIR 
      
       7 
       xtrabackup --backup --user=root --password=密碼 --datadir=/var/lib/mysql/ --target-dir=/home/ftp/b/backup_data/wwwroot/2013/11/23/-4

 
       1 
       innobackupex --user=root --password=密碼 --defaults-file=/etc/my.cnf /home/ftp/b/backup_data/wwwroot/2013/11/23/2.1 
      
       2 
       # 我暈 真是折騰啊 
      
       3 
       innobackupex: Connected to MySQL server 
      
       4 
       innobackupex: Error: Support for MySQL 5.1 with builtin InnoDB (not the plugin) was removed in Percona XtraBackup 2.1. The last version to support MySQL 5.1 with builtin InnoDB was Percona XtraBackup 2.0.

 
       1 
       # 拆卸 
      
       2 
       rpm -e percona-xtrabackup

 
       1 
       # 從新下載 
      
       2 
       mkdir -p $HOME/downloads;cd $HOME/downloads 
      
       3 
       lftp -c pget -n 30 http://www.percona.com/redir/downloads/XtraBackup/XtraBackup-2.0.0/RPM/rhel6/x86_64/percona-xtrabackup-2.0.0-417.rhel6.x86_64.rpm

 
       1 
       # 查看安裝包信息 
      
       2 
       rpm -qip percona-xtrabackup-2.0.0-417.rhel6.x86_64.rpm

 
       1 
       # 安裝 
      
       2 
       rpm -ivh percona-xtrabackup-2.0.0-417.rhel6.x86_64.rpm 
      
       3 
       warning: percona-xtrabackup-2.0.0-417.rhel6.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID cd2efd2a: NOKEY 
      
       4 
       Preparing...                ########################################### [100%] 
      
       5 
          1:percona-xtrabackup     ########################################### [100%] 
      
       6 
       xtrabackup --version 
      
       7 
       xtrabackup version 2.0.0 for Percona Server 5.1.59 unknown-linux-gnu (x86_64) (revision id: 417)

測試備份數據庫

 
       1 
       innobackupex --user=root --password=密碼 --defaults-file=/etc/my.cnf /home/ftp/b/backup_data/wwwroot/

好這下對鳥。。。服務器

 
       01 
       InnoDB Backup Utility v1.5.1-xtrabackup; Copyright 2003, 2009 Innobase Oy 
      
       02 
       and Percona Inc 2009-2012.  All Rights Reserved. 
      
       03 
         
       04 
       This software is published under 
      
       05 
       the GNU GENERAL PUBLIC LICENSE Version 2, June 1991. 
      
       06 
         
       07 
       131123 09:22:25  innobackupex: Starting mysql with options:  --defaults-file='/etc/my.cnf' --password=xxxxxxxx --user='root' --unbuffered -- 
      
       08 
       131123 09:22:25  innobackupex: Connected to database with mysql child process (pid=30774) 
      
       09 
       131123 09:22:31  innobackupex: Connection to database server closed 
      
       10 
       IMPORTANT: Please check that the backup run completes successfully. 
      
       11 
                  At the end of a successful backup run innobackupex 
      
       12 
                  prints "completed OK!". 
      
       13 
         
       14 
       innobackupex: Using mysql  Ver 14.14 Distrib 5.1.69, for redhat-linux-gnu (x86_64) using readline 5.1 
      
       15 
       innobackupex: Using mysql server version Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved. 
      
       16 
         
       17 
       innobackupex: Created backup directory /home/ftp/b/backup_data/wwwroot/2013-11-23_09-22-31 
      
       18 
       131123 09:22:31  innobackupex: Starting mysql with options:  --defaults-file='/etc/my.cnf' --password=xxxxxxxx --user='root' --unbuffered -- 
      
       19 
       131123 09:22:31  innobackupex: Connected to database with mysql child process (pid=30841) 
      
       20 
       131123 09:22:33  innobackupex: Connection to database server closed 
      
       21 
         
       22 
       131123 09:22:33  innobackupex: Starting ibbackup with command: xtrabackup_51  --defaults-file="/etc/my.cnf" --backup --suspend-at-end --target-dir=/home/ftp/b/backup_data/wwwroot/2013-11-23_09-22-31 
      
       23 
       innobackupex: Waiting for ibbackup (pid=30861) to suspend 
      
       24 
       innobackupex: Suspend file '/home/ftp/b/backup_data/wwwroot/2013-11-23_09-22-31/xtrabackup_suspended' 
      
       25 
         
       26 
       xtrabackup_51 version 2.0.0 for MySQL server 5.1.59 unknown-linux-gnu (x86_64) (revision id: 417) 
      
       27 
       xtrabackup: uses posix_fadvise(). 
      
       28 
       xtrabackup: cd to /var/lib/mysql 
      
       29 
       xtrabackup: Target instance is assumed as followings. 
      
       30 
       xtrabackup:   innodb_data_home_dir = ./ 
      
       31 
       xtrabackup:   innodb_data_file_path = ibdata1:10M:autoextend 
      
       32 
       xtrabackup:   innodb_log_group_home_dir = ./ 
      
       33 
       xtrabackup:   innodb_log_files_in_group = 2 
      
       34 
       xtrabackup:   innodb_log_file_size = 5242880 
      
       35 
       >> log scanned up to (0 44243) 
      
       36 
       [01] Copying ./ibdata1 to /home/ftp/b/backup_data/wwwroot/2013-11-23_09-22-31/ibdata1 
      
       37 
       [01]        ...done 
      
       38 
         
       39 
       131123 09:22:35  innobackupex: Continuing after ibbackup has suspended 
      
       40 
       131123 09:22:35  innobackupex: Starting mysql with options:  --defaults-file='/etc/my.cnf' --password=xxxxxxxx --user='root' --unbuffered -- 
      
       41 
       131123 09:22:35  innobackupex: Connected to database with mysql child process (pid=30874) 
      
       42 
       131123 09:22:37  innobackupex: Starting to lock all tables... 
      
       43 
       >> log scanned up to (0 44243) 
      
       44 
       >> log scanned up to (0 44243) 
      
       45 
       131123 09:22:47  innobackupex: All tables locked and flushed to disk 
      
       46 
         
       47 
       131123 09:22:47  innobackupex: Starting to backup .frm, .MRG, .MYD, .MYI, 
      
       48 
       innobackupex: .TRG, .TRN, .ARM, .ARZ, .CSM, .CSV and .opt files in 
      
       49 
       innobackupex: subdirectories of '/var/lib/mysql' 
      
       50 
       innobackupex: Backing up files '/var/lib/mysql/blog/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (49 files) 
      
       51 
       innobackupex: Backing up file '/var/lib/mysql/info/db.opt' 
      
       52 
       innobackupex: Backing up files '/var/lib/mysql/bd_2kdp_com/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (49 files) 
      
       53 
       >> log scanned up to (0 44243) 
      
       54 
       innobackupex: Backing up file '/var/lib/mysql/www_2kdp_com/db.opt' 
      
       55 
       innobackupex: Backing up files '/var/lib/mysql/mysql/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (69 files) 
      
       56 
       innobackupex: Backing up file '/var/lib/mysql/clean_cache/db.opt' 
      
       57 
       innobackupex: Backing up file '/var/lib/mysql/union/db.opt' 
      
       58 
       innobackupex: Backing up files '/var/lib/mysql/movie/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (49 files) 
      
       59 
       innobackupex: Backing up file '/var/lib/mysql/link_2kdp/db.opt' 
      
       60 
       innobackupex: Backing up files '/var/lib/mysql/silkime_com/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (295 files) 
      
       61 
       >> log scanned up to (0 44243) 
      
       62 
       innobackupex: Backing up file '/var/lib/mysql/copy_site/db.opt' 
      
       63 
       innobackupex: Backing up files '/var/lib/mysql/sell_bdl/*.{frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (133 files) 
      
       64 
       131123 09:22:59  innobackupex: Finished backing up .frm, .MRG, .MYD, .MYI, .TRG, .TRN, .ARM, .ARZ, .CSV, .CSM and .opt files 
      
       65 
         
       66 
       innobackupex: Resuming ibbackup 
      
       67 
         
       68 
       xtrabackup: The latest check point (for incremental): '0:44243' 
      
       69 
       xtrabackup: Stopping log copying thread. 
      
       70 
       .>> log scanned up to (0 44243) 
      
       71 
       >> log scanned up to (0 44243) 
      
       72 
         
       73 
       xtrabackup: Transaction log of lsn (0 44243) to (0 44243) was copied. 
      
       74 
       131123 09:23:01  innobackupex: All tables unlocked 
      
       75 
       131123 09:23:01  innobackupex: Connection to database server closed 
      
       76 
         
       77 
       innobackupex: Backup created in directory '/home/ftp/b/backup_data/wwwroot/2013-11-23_09-22-31' 
      
       78 
       # 這一句我特別喜歡 真的。。。折騰那麼久 就爲了這個。。。。。 
      
       79 
       innobackupex: MySQL binlog position: filename 'mysql-bin.000001', position 25959 
      
       80 
       131123 09:23:01  innobackupex: completed OK!

 
       01 
       # 如今咱們cd到備份目錄 看看搞了些什麼. 
      
       02 
       # 除了數據庫自己的文件外 發現還有 另外5個文件 有用的寫下備註 
      
       03 
       backup-my.cnf # 這個是用做數據庫數據文件指向到這個備份目錄的時候用的 直接把裏面的內容複製到系統的my.cnf 
      
       04 
       xtrabackup_binlog_info # 記錄了備份完成時候的 二進制日誌和 Position指針位置 
      
       05 
       xtrabackup_logfile 
      
       06 
       xtrabackup_binary 
      
       07 
       xtrabackup_checkpoints # 這個裏面指明瞭備份類型backup_type 如 full-backuped 增量... 
      
       08 
       # 這個東西能夠寫個腳原本讀取 從服務器那邊那個作成自動配置 
      
       09 
       cat xtrabackup_binlog_info 
      
       10 
       mysql-bin.000001        25959

 
       1 
       # 如今再來測試下壓縮備份 
      
       2 
       # 一些比較有用的選項 
      
       3 
         # --slave-info(slave-info能夠記錄備份恢 復後，做爲slave須要的一些信息，根據這些信息，能夠很方便的利用備份來重作slave。) 
      
       4 
         # --no-lock(備份過程不鎖定表) 
      
       5 
         # 2>$BACKUP_DIR/`date +%Y-%m-%d_%H-%M-%S`/mysqlbackup.log(備份過程當中的輸出信息保存,適合封裝到本身的腳本里面去什麼的) 
      
       6 
         
       7 
       #TIME1=`date +%Y%m%d%H%M%S`;echo 勤勞的Jrobot:我在`date +%Y/%m/%d_%H:%M:%S`開始備份! 
      
       8 
       #echo "勤勞的Jrobot:我在`date +%Y/%m/%d_%H:%M:%S`開始備份!" >> /home/ftp/b/backup_data/`date +%Y-%m-%d_%H-%M-%S`/backup.log

 
       1 
       BACKUP_DIR="/home/ftp/b/backup_data/wwwroot" 
      
       2 
       USER="用戶" 
      
       3 
       PSWD="密碼" 
      
       4 
       MY="/etc/my.cnf" 
      
       5 
       LOG="MySQL_Last_Backup.LOG" 
      
       6 
       LAST_GZIP_BACKUP="LASTBACKUP.TAR.GZ" 
      
       7 
       #mkdir -p $BACKUP_DIR/`date +%Y-%m-%d_%H-%M-%S`/

記錄備份日誌多線程

 
       1 
       innobackupex --user=$USER --password=$PSWD --slave-info --defaults-file=$MY $BACKUP_DIR/ 2>$BACKUP_DIR/$LOG

gzip壓縮備份post

 
       1 
       innobackupex --user=$USER --password=$PSWD --slave-info --defaults-file=$MY $BACKUP_DIR/ --stream=tar | gzip>$BACKUP_DIR/$LAST_GZIP_BACKUP

解壓這個包看看或者直接SCP到從機測試

 
       1 
       tar xvzfi LASTBACKUP.TAR.GZ 
      
       2 
       cat xtrabackup_binlog_info # 哈哈開心了吧

在從服務器上解壓這個後開始配置同步ui

 
       1 
       #slave stop; 
      
       2 
       #CHANGE MASTER TO MASTER_HOST='主機地址',MASTER_USER='從複製帳號',MASTER_PASSWORD='密碼',MASTER_LOG_FILE='mysql-bin.00000X',MASTER_LOG_POS=1; 
      
       3 
       #slave start;

總結這個東西的封裝後的腳本是很強大用來作主從配置也很快可是有個問題就是不支持遠程備份。你好比說你想從Win服務器備份到Linux的就蛋疼了。這個軟件的主要文檔和參考資料的環境幾乎都是基於LINUX的。WIN下着實蛋疼。。。url