Mysql/Mariadb主從複製

概念

什麼是·Mysql/Mariadb主從複製？　　　　

Mysql/Mariadb主從複製：當Master（主）數據庫發生變化的時候，變化實時會同步到slave（從）數據庫中；
相似於：Samba共享文件（C/S）、NFS網絡文件共享（C/S），當服務端（Server）發生變化時，客戶端（client）數據內容會根據服務端進行改變；

好處

• 水平擴展數據庫的負載能力，後備數據庫，主數據庫服務器故障後，可切換到從數據庫繼續工做；
• 容錯、高可用，從數據庫可用來作備份、數據統計等工做，這樣不影響主數據庫的性能；
• 數據分佈；
• 數據備份；

實現原理

在master機器上，主從同步事件會被寫到特殊的log文件中(binary-log);

主從同步事件有3種形式:statement、row、mixed。

 statement：會將對數據庫操做的sql語句寫入到binlog中。
 row：會將每一條數據的變化寫入到binlog中。
 mixed：statement與row的混合。Mysql決定何時寫statement格式的，何時寫row格式的binlog。

總體上來講，複製有3個步驟：

• master將改變記錄到二進制日誌(binary log)中（這些記錄叫作二進制日誌事件，binary log events)；
• slave將master的binary log events拷貝到它的中繼日誌(relay log)；
• slave重作中繼日誌中的事件，將改變反映它本身的數據。

下面這章圖能夠詳細解釋其原理：

說的簡單一些就是：

當對Master數據庫無論作了增、刪、改仍是建立了數據庫、表等操做時，Slave就會快速的接受這些數據以及對象的操做，從而實現主從數據複製，保證數據的一致性。　　

實戰

我記得我學PHP開發的時候，教員常常說的一句話就是：學習半小時，實戰一分鐘；
好了，接下來到咱們實戰的時刻了，認真聽講喲！！！ 

環境介紹

系統環境：系統基本上都差很少，通常多數都是Linux平臺和Windows平臺比較多，無論什麼樣的系統環境對此次實戰的操做都影響不大，我在這裏使用的是Docker虛擬出來的CentOS操做系統，固然您能夠選用Ubuntu、RedHat以及Windows系統，這些都不會影響到大的操做；

我這裏使用的系統版本：

[root@master /]# cat /etc/redhat-release
CentOS Linux release 8.0.1905 (Core) 

這裏會用到兩臺服務器：其中一臺MasterIP172.18.0.2，另一個slaveIP172.18.0.3
數據庫版本：（我這裏使用的Mariadb，你能夠使用mysql數據庫）

[root@master /]# mysql --version
mysql  Ver 15.1 Distrib 10.3.11-MariaDB, for Linux (x86_64) using readline 5.1

配置Master數據庫

　　1.更改Master配置文件
　　　　找到下面文件：

mysql數據庫：/etc/mysql/mysql,conf.d/mysqld.cnf
mariadb數據庫：/etc/my.cnf.d/mariadb.cnf

注意：我這裏是使用yum進行安裝的因此默認配置文件是在/etc下面，建議在修改上面兩個文件時要先將配置文件進行備份　

修改如下配置：　 

bind-address=172.18.0.2		\\指定Master地址
server-id = 1					\\指定惟一的serverid		部分版本沒有需手動寫入
log_bin = /var/log/mariadb/mariadb-bin.log				\\開啓binlog			部分版本沒有需手動寫入

注意：log_bin這個字段需根據實際狀況來定，需找到數據庫的日誌文件，默認實在 /var/log

 　　2.從新啓動數據庫

[root@master my.cnf.d]# systemctl restart mariadb		\\centos七、centos八、ubuntu從新啓動方式
[root@master my.cnf.d]# server  mariadb  restart		\\centos6及如下版本使用這個從新啓動方式

　　mysql從新啓動： 

[root@master my.cnf.d]# systemctl restart mysqld		\\centos七、centos八、ubuntu從新啓動方式
[root@master my.cnf.d]# server  mysqld  restart		\\centos6及如下版本使用這個從新啓動方式

　　3.初始化數據庫

[root@master my.cnf.d]# mysql_secure_installation 

NOTE: RUNNING ALL PARTS OF THIS SCRIPT IS RECOMMENDED FOR ALL MariaDB
      SERVERS IN PRODUCTION USE!  PLEASE READ EACH STEP CAREFULLY!

In order to log into MariaDB to secure it, we'll need the current
password for the root user.  If you've just installed MariaDB, and
you haven't set the root password yet, the password will be blank,
so you should just press enter here.

Enter current password for root (enter for none): 					//這裏敲回車
OK, successfully used password, moving on...

Setting the root password ensures that nobody can log into the MariaDB
root user without the proper authorisation.

Set root password? [Y/n] y						//這裏是設置root密碼，可不進行設置
New password: 					//新密碼
Re-enter new password: 			//舊密碼
Password updated successfully!
Reloading privilege tables..
 ... Success!


By default, a MariaDB installation has an anonymous user, allowing anyone
to log into MariaDB without having to have a user account created for
them.  This is intended only for testing, and to make the installation
go a bit smoother.  You should remove them before moving into a
production environment.

Remove anonymous users? [Y/n] y
 ... Success!

Normally, root should only be allowed to connect from 'localhost'.  This
ensures that someone cannot guess at the root password from the network.

Disallow root login remotely? [Y/n] y
 ... Success!

By default, MariaDB comes with a database named 'test' that anyone can
access.  This is also intended only for testing, and should be removed
before moving into a production environment.

Remove test database and access to it? [Y/n] y
 - Dropping test database...
 ... Success!
 - Removing privileges on test database...
 ... Success!

Reloading the privilege tables will ensure that all changes made so far
will take effect immediately.

Reload privilege tables now? [Y/n] y
 ... Success!

Cleaning up...

All done!  If you've completed all of the above steps, your MariaDB
installation should now be secure.

Thanks for using MariaDB!
[root@master my.cnf.d]# 

　　4.建立主從同步的用戶 

 [root@master ~]# mysql -u root -p				\\登錄數據庫
Enter password: 			\\輸入root密碼
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 18
Server version: 10.3.11-MariaDB-log MariaDB Server

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MariaDB [(none)]> GRANT REPLICATION SLAVE on *.* to 'slave'@'%' IDENTIFIED BY 'redhat';		
\\建立用戶，並設置相應的權限
	\\此處%表示容許從任何地方（除本地外）使用此帳號進行登錄使用，在正式環境建議具體到某臺主機IP
Query OK, 0 rows affected (0.000 sec)			\\表示sql語句執行成功

　　5.更新Slave用戶權限 

 MariaDB [(none)]> flush privileges;		\\每次修改用戶權限，都要使用這個sql語句進行更新
Query OK, 0 rows affected (0.000 sec)

　　6.導出數據庫中全部數據（此步驟取決於slave的權限）

[root@master ~]# mysqldump -u root -p --all-databases --master-data > mariadb.bat.sql
	--all-databases		\\此參數表示備份全部數據庫
	--master-data		\\此參數表示將二進制的信息寫入到輸出文件中，在這裏是寫入到備份的sql文件中
Enter password:

　　7.查看MASTERr REPLICATION LOG位置

 MariaDB [(none)]> show master status;
+--------------------+----------+--------------+------------------+
| File               | Position | Binlog_Do_DB | Binlog_Ignore_DB |
+--------------------+----------+--------------+------------------+
| mariadb-bin.000002 |     1974 |              |                  |
+--------------------+----------+--------------+------------------+
1 row in set (0.000 sec)

配置Slave數據庫

　　1.更改Slave配置文件

　　　文件位置與Master位置一致

mysql數據庫：/etc/mysql/mysql,conf.d/mysqld.cnf
mariadb數據庫：/etc/my.cnf.d/mariadb.cnf

　　　注意：我這裏是使用yum進行安裝的因此默認配置文件是在/etc下面，建議在修改上面兩個文件時要先將配置文件進行備份

　　修改如下配置：

bind-address=172.18.0.3		\\指定Master地址
server-id = 2					\\指定惟一的serverid		部分版本沒有需手動寫入
log_bin = /var/log/mariadb/mariadb-bin.log				\\開啓binlog			部分版本沒有需手動寫入

　　注意：log_bin這個字段需根據實際狀況來定，需找到數據庫的日誌文件，默認實在 /var/log

　　2.從新啓動數據庫

[root@master my.cnf.d]# systemctl restart mariadb		\\centos七、centos八、ubuntu從新啓動方式
[root@master my.cnf.d]# server  mariadb  restart		\\centos6及如下版本使用這個從新啓動方式

　　mysql從新啓動：

[root@master my.cnf.d]# systemctl restart mysqld		\\centos七、centos八、ubuntu從新啓動方式
[root@master my.cnf.d]# server  mysqld  restart		\\centos6及如下版本使用這個從新啓動方式

　　3.初始化數據庫

[root@master my.cnf.d]# mysql_secure_installation 

NOTE: RUNNING ALL PARTS OF THIS SCRIPT IS RECOMMENDED FOR ALL MariaDB
      SERVERS IN PRODUCTION USE!  PLEASE READ EACH STEP CAREFULLY!

In order to log into MariaDB to secure it, we'll need the current
password for the root user.  If you've just installed MariaDB, and
you haven't set the root password yet, the password will be blank,
so you should just press enter here.

Enter current password for root (enter for none): 					//這裏敲回車
OK, successfully used password, moving on...

Setting the root password ensures that nobody can log into the MariaDB
root user without the proper authorisation.

Set root password? [Y/n] y						//這裏是設置root密碼，可不進行設置
New password: 					//新密碼
Re-enter new password: 			//舊密碼
Password updated successfully!
Reloading privilege tables..
 ... Success!


By default, a MariaDB installation has an anonymous user, allowing anyone
to log into MariaDB without having to have a user account created for
them.  This is intended only for testing, and to make the installation
go a bit smoother.  You should remove them before moving into a
production environment.

Remove anonymous users? [Y/n] y
 ... Success!

Normally, root should only be allowed to connect from 'localhost'.  This
ensures that someone cannot guess at the root password from the network.

Disallow root login remotely? [Y/n] y
 ... Success!

By default, MariaDB comes with a database named 'test' that anyone can
access.  This is also intended only for testing, and should be removed
before moving into a production environment.

Remove test database and access to it? [Y/n] y
 - Dropping test database...
 ... Success!
 - Removing privileges on test database...
 ... Success!

Reloading the privilege tables will ensure that all changes made so far
will take effect immediately.

Reload privilege tables now? [Y/n] y
 ... Success!

Cleaning up...

All done!  If you've completed all of the above steps, your MariaDB
installation should now be secure.

Thanks for using MariaDB!
[root@master my.cnf.d]# 

　　4.從Master將數據庫備份複製到slave服務器

[root@slave my.cnf.d]# scp jia@172.18.0.2:/opt/mariadb.bat.sql /opt/
jia@172.18.0.2's password: 
mariadb.bat.sql                   

　　5.將備份數據恢復到slave數據庫

[root@slave my.cnf.d]# mysql -u root -p < /opt/mariadb.bat.sql 
 Enter password: 

　　6.使slave與master創建鏈接

[root@slave my.cnf.d]# mysql -u root -p
Enter password: 
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
[root@slave my.cnf.d]# mysql -u root -p
Enter password: 
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 22
Server version: 10.3.11-MariaDB-log MariaDB Server

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MariaDB [(none)]> stop slave;
Query OK, 0 rows affected, 1 warning (0.000 sec)

MariaDB [(none)]> CHANGE MASTER TO
    -> MASTER_HOST = '172.18.0.2',		\\指定Master數據庫地址
    -> MASTER_USER = 'slave',			\\指定主從複製用戶名
    -> MASTER_PASSWORD = 'redhat',			\\指定主從複製用戶密碼
    -> MASTER_LOG_FILE = 'mariadb-bin.000002',		\\指定Master數據庫的binlog文件名
    -> MASTER_LOG_POS=1974;			
Query OK, 0 rows affected (0.290 sec)

MariaDB [(none)]> start slave;			\\開啓複製功能
Query OK, 0 rows affected (0.019 sec)

MariaDB [(none)]>

　　注意：lMASTER_LOG_FILE='mariadb-bin.000002與MASTER_LOG_POS=1974的值，是從上面的 SHOW MASTER STATUS 獲得的。

　　到這裏已經能夠作到主從複製了下面讓咱們測試一下吧

驗證數據庫是否同步

測試方法很簡單，只須要在主數據庫上面建立數據庫或者增長一條記錄就能夠測試是否主從複製配置成功

MariaDB [(none)]> show  databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
+--------------------+
3 rows in set (0.018 sec)

MariaDB [(none)]> create database a;			\\在主數據庫建立a數據庫
Query OK, 1 row affected (0.063 sec)
MariaDB [(none)]> show databases;
+--------------------+
| Database           |
+--------------------+
| a                  |
| information_schema |
| mysql              |
| performance_schema |
+--------------------+
4 rows in set (0.000 sec)

　　下面咱們來看看從數據庫上面有沒有a這個數據庫吧

MariaDB [(none)]> show databases;
+--------------------+
| Database           |
+--------------------+
| a                  |
| information_schema |
| mysql              |
| performance_schema |
+--------------------+
4 rows in set (0.075 sec)

　　咱們會發現已經有了a這個數據庫