搭建mysql的主從複製和讀寫分離
搭建mysql的主從複製和讀寫分離
+--------+ (write) +--------+
| client | +---------------------+| master |
+--------+| | +--------+|
| | |
| | |
| +--------+ (read) |
(read) +--------+| amoeba |+---------------------|-----------+
(write) | +--------+| | |
| | | |
| (read)| | |
+--------+| | +--------+ | +--------+
| client | +-| slave1 |+---------+----------+| slave2 |
+--------+ +--------+ (replication) +--------+
master mysql:172.17.0.4
slave1 mysql:172.17.0.5
slave2 mysql:172.17.0.6
mysql-proxy(amoeba):172.17.0.8
Test host:172.17.0.7
主從複製：
master mysql
：
安裝mysqlserver和mysql
yum install mysql-server mysql -y
修改配置文件
vim /etc/my.cnf.d/server.cnf
[mysqld]
server-id = 1
log-bin = master-bin
啓動mysql
/etc/init.d/mysql start
修改root密碼
mysqladmin -uroot -p password mysql
登錄mysql測試並查看master狀態
mysql -uroot -pmysql
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 22449
Server version: 5.5.47-MariaDB-log MariaDB Server
Copyright (c) 2000, 2015, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> show master status;
+------------------+----------+--------------+------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB |
+------------------+----------+--------------+------------------+
| mysql-bin.000001 | 3648 | | |
+------------------+----------+--------------+------------------+
1 row in set (0.03 sec)
建立主從同步帳號
MariaDB [(none)]> grant replication slave on *.* to 'mysqlmaster'@'172.17.0.%' identified by '123456';
slave1 mysql
：
安裝mysqlserver和mysql
yum install mysql-server mysql -y
修改配置文件
vim /etc/my.cnf.d/server.cnf
[mysqld]
server-id = 2 #id必須惟一
log-bin = slave-bin
啓動mysql
/etc/init.d/mysql start
修改root密碼
mysqladmin -uroot -p password mysql
建立同步文件
MariaDB [(none)]> change master to master_host='172.17.0.4',master_user='mysqlmaster',master_password='123456',master_log_file='mysql-bin.000001',master_log_pos=3648;
MariaDB [(none)]> start slave;
查看是否成功，確保下面兩項爲Yes
MariaDB [(none)]> show slave status\G;
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
master mysql
：
在master mysql上建立數據查看slave1 mysql是否同步
MariaDB [(none)]> create database new1;
Query OK, 1 row affected (0.00 sec)
MariaDB [(none)]> create database new2;
Query OK, 1 row affected (0.00 sec)
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| new1 |
| new2 |
| performance_schema |
| test |
+--------------------+
6 rows in set (0.00 sec)
slave1 mysql
:
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| new1 |
| new2 |
| performance_schema |
| test |
+--------------------+
6 rows in set (0.00 sec)
咱們生產環境中會碰到這種狀況：備份主機數據，或者添加一臺主機。進行雙主機的結構。
另外就是在線上中途添加更多的從機。
而咱們知道，從機上設置 slave 時要指定 master_log_file 和 master_log_pos, 即指定binlog文件和偏移值。
這也就是說，從機是能夠從任意位置的 binlog 文件中進行數據的同步。好比：咱們將 binlog 文件備份到其它某處放置，某天，數據庫出問題了，須要對某些數據進行數據恢復，這時候從該文件中進行恢復。
添加一個新的從機，能夠有兩種方式：從 master 機器複製; 另外一種是直接從 slave 複製.
mysql-主從結構添加新的slave
兩種解決辦法
1.copy master
master mysql
：
鎖定數據庫
MariaDB [(none)]> flush tables with read lock;
Query OK, 0 rows affected (0.04 sec)
查看主機狀態，幾下file position參數
MariaDB [(none)]> show master status;
+------------------+----------+--------------+------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB |
+------------------+----------+--------------+------------------+
| mysql-bin.000001 | 3974 | | |
+------------------+----------+--------------+------------------+
備份全部數據庫
mysqldump --all-databases -uroot -pmysql > backup.sql
拷貝到準備新加的slave主機
scp backup.sql root@172.17.0.6:/root
slave2 mysql
:
安裝mysqlserver和mysql
yum install mysql-server mysql -y
修改配置文件
vim /etc/my.cnf.d/server.cnf
[mysqld]
server-id = 3 #id必須惟一
log-bin = slave2-bin
啓動mysql
/etc/init.d/mysql start
修改root密碼
mysqladmin -uroot -p password mysql
導入主服務器scp過來的數據庫
mysql -uroot -pmysql < backup.sql
建立同步文件
MariaDB [(none)]> change master to master_host='172.17.0.4',master_user='mysqlmaster',master_password='123456',master_log_file='mysql-bin.000001',master_log_pos=3974;
MariaDB [(none)]> start slave;
查看是否成功，確保下面兩項爲Yes
MariaDB [(none)]> show slave status\G;
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
master mysql
：
建立數據驗證是否添加成功
MariaDB [(none)]> create database new3;
Query OK, 1 row affected (0.00 sec)
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| new1 |
| new2 |
| new3 |
| performance_schema |
| test |
+--------------------+
6 rows in set (0.00 sec)
slave2 mysql
:
MariaDB [(none)]> create database new3;
Query OK, 1 row affected (0.00 sec)
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| new1 |
| new2 |
| new3 |
| performance_schema |
| test |
+--------------------+
6 rows in set (0.00 sec)
2 copy slave
複製從庫要步驟：
====================
能夠看到，從主庫複製會有段時間鎖表，這段時間會影響主庫的使用。若是咱們能直接從從庫進行復制，就不會對主庫產生影響了。可是，從從庫複製要保證的是複製過程當中從庫上的數據不會發生變化，因此要先停掉從庫。
1.中止從庫: mysql> stop slave;
2.看當前從庫的狀態。和前面的看主庫狀態同樣。但如今是從從庫複製，因此查看從庫狀態：mysql> show slave status;
記下 Relay_Master_Log_file 和 Exec_Master_Log_Pos, 用處和前面同樣.
3.備份從庫數據.用 mysqldump
4.在新的從庫上還原數據
5.設置新從庫的 slave 參數.change master to master_host = '192.168.3.119',master_port = 3306,master_user = 'repl_user',master_password='root',master_log_file='master-bin.000005',master_log_pos=194244;
能夠看到，雖然新從庫是從從庫複製的數據，但實際上 binlog 的 master 仍是指向的主庫。
另外，這裏將 master_log_file 和 master_log_pos 設置成第 2 步中的 Relay_Master_Log_file 和 Exec_Master_Log_Pos
start slave;
mysql的主從複製+讀寫分離
+--------+ (write) +--------+
| client | +---------------------+| master |
+--------+| | +--------+|
| | |
| | |
| +--------+ (read) |
(read) +--------+| amoeba |+---------------------|-----------+
(write) | +--------+| | |
| | | |
| (read)| | |
+--------+| | +--------+ | +--------+
| client | +-| slave1 |+---------+----------+| slave2 |
+--------+ +--------+ (replication) +--------+
讀寫分離
Amoeba(變形蟲)項目，專一 分佈式數據庫 proxy 開發。座落與Client、DB Server(s)之間。對客戶端透明。具備負載均衡、高可用性、sql過濾、讀寫分離、可路由相關的query到目標數據庫、可併發請求多臺數據庫合併結果。再看下上面的架構圖。
由於amoeba是java編寫的，因此須要先安裝java框架
Amoeba
：
java安裝
下載java
wget http://download.oracle.com/otn-pub/java/jdk/7u79-b15/jdk-7u79-linux-x64.tar.gz
建立java目錄，並解壓
mkdir -p /usr/jdk
tar -xzvf jdk-7u79-linux-x64.tar.gz -C /usr/jdk
配置環境變量，在/etc/profile文件最後添加以下配置
vim /etc/profile
export JAVA_HOME=/usr/jdk/
export CLASSPATH=${JAVA_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH
使配置文件生效
source /etc/profile
測試
java -version
java version "1.7.0_79"
Java(TM) SE Runtime Environment (build 1.7.0_79-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.79-b02, mixed mode)
證實已經安裝完成
amoeba安裝配置
下載解壓
wget http://ufpr.dl.sourceforge.net/project/amoeba/Amoeba%20for%20mysql/3.x/amoeba-mysql-3.0.5-RC-distribution.zip
unzip amoeba-mysql-3.0.5-RC-distribution.zip
mv amoeba-mysql-3.0.5-RC /usr/local/
配置
vim amoeba-mysql-3.0.5-RC/conf/amoeba.xml （前段鏈接文件）
<service name="Amoeba for Mysql" class="com.meidusa.amoeba.mysql.server.MySQLService">
<!-- port -->
<property name="port">8066</property> ///////amoeba監聽端口/////////
<!-- bind ipAddress -->
<!--
<property name="ipAddress">127.0.0.1</property> ///////amoeba監聽地址/////////
-->
<property name="connectionFactory">
<bean class="com.meidusa.amoeba.mysql.net.MysqlClientConnectionFactory">
<property name="sendBufferSize">128</property>
<property name="receiveBufferSize">64</property>
</bean>
</property>
<property name="authenticateProvider">
<bean class="com.meidusa.amoeba.mysql.server.MysqlClientAuthenticator">
<property name="user">root</property> ///Amoeba代理用戶名/////
<property name="password">mysql</property> ///Amoeba代理用戶密碼/////
<property name="filter">
<bean class="com.meidusa.toolkit.net.authenticate.server.IPAccessController">
<property name="ipFile">${amoeba.home}/conf/access_list.conf</property>
</bean>
</property>
</bean>
</property>
</service>
.......................
.......................
<queryRouter class="com.meidusa.amoeba.mysql.parser.MysqlQueryRouter">
<property name="ruleLoader">
<bean class="com.meidusa.amoeba.route.TableRuleFileLoader">
<property name="ruleFile">${amoeba.home}/conf/rule.xml</property>
<property name="functionFile">${amoeba.home}/conf/ruleFunctionMap.xml</property>
</bean>
</property>
<property name="sqlFunctionFile">${amoeba.home}/conf/functionMap.xml</property>
<property name="LRUMapSize">1500</property>
<property name="defaultPool">master</property> ///////默認地址池////////
<property name="writePool">master</property> //////寫地址池///////////
<property name="readPool">vipdb</property> //////讀地址池////////
<property name="needParse">true</property>
</queryRouter>
vim amoeba-mysql-3.0.5-RC/conf/dbServers.xml （後端數據庫參數文件）
<dbServer name="abstractServer" abstractive="true">
<factoryConfig class="com.meidusa.amoeba.mysql.net.MysqlServerConnectionFactory">
<property name="connectionManager">${defaultManager}</property>
<property name="sendBufferSize">64</property>
<property name="receiveBufferSize">128</property>
<!-- mysql port -->
<property name="port">3306</property> /////數據庫鏈接端口///////
<!-- mysql schema -->
<property name="schema">test</property> ////默認數據庫////
<!-- mysql user -->
<property name="user">amoeba</property> ///主從數據庫默認鏈接用戶////
<property name="password">mysql</property> ////主從數據庫默認鏈接用戶密碼////
</factoryConfig>
............................
............................
</dbServer>
<dbServer name="master" parent="abstractServer"> +---+
<factoryConfig> |
<!-- mysql ip --> |
<property name="ipAddress">172.17.0.4</property> |
</factoryConfig> |
</dbServer> |
|
<dbServer name="slave1" parent="abstractServer"> |
<factoryConfig> |
<!-- mysql ip --> |+-------//////定義後端數據庫，dbServer能夠隨意命名，但本身必須清楚哪一個是主，那個是從，並且主服務器命名要和amoeba.xml中writePool相對應，從服務器對應下面
<property name="ipAddress">172.17.0.5</property> |virturl dbServer中的poolNames ip對應各個db///////
</factoryConfig> |
</dbServer> |
<dbServer name="slave2" parent="abstractServer"> |
<factoryConfig> |
<!-- mysql ip --> |
<property name="ipAddress">172.17.0.6</property> |
</factoryConfig> +---|
</dbServer>
<dbServer name="vipdb" virtual="true"> +---+
<poolConfig class="com.meidusa.amoeba.server.MultipleServerPool"> |
<!-- Load balancing strategy: 1=ROUNDROBIN , 2=WEIGHTBASED , 3=HA--> |
<property name="loadbalance">1</property> |
|+-------///第一行的dbserver name命名必定和amoeba.xml的readPool相對應，property name配置從服務器的集合，能夠是一個，能夠是多個！
<!-- Separated by commas,such as: server1,server2,server1 --> |
<property name="poolNames">slave1,slave2</property> |
</poolConfig> |
</dbServer> +---+
vim amoeba-mysql-3.0.5-RC/jvm.properties （java虛擬機配置）
把原來的這一句JVM_OPTIONS="-server -Xms256m -Xmx1024m -Xss196k -XX:PermSize=16m -XX:MaxPermSize=96m"
改爲JVM_OPTIONS="-server -Xms1024m -Xmx1024m -Xss256k -XX:PermSize=16m -XX:MaxPermSize=96m"
在master，slave1，slave2分別受權dbServer.xml中定義的用戶名和密碼
MariaDB [(none)]> grant all on *.* to 'amoeba'@'%' identified by "mysql";
MariaDB [(none)]> grant all on *.* to 'amoeba'@'localhost' identified by "mysql";
啓動amoeba
/usr/local/amoeba-mysql-3.0.5-RC/bin/launcher&
查看進程(若是啓動成功，會看到以下進程)
ps -ef
root 467 337 0 12:51 pts/0 00:00:00 /bin/bash amoeba-mysql-3.0.5-RC/bin/launcher
root 472 467 0 12:51 pts/0 00:00:05 /usr/local/jdk1.7.0_67/bin/java -server -Xms1024m -Xmx1024m -Xss256k -XX:PermSize=16m
root 473 467 0 12:51 pts/0 00:00:00 tail -f /usr/local/amoeba-mysql-3.0.5-RC/logs/console.log
查看監聽端口
netstat -anpl
tcp 0 0 :::8066 :::* LISTEN 472/java
tcp 0 0 ::ffff:172.17.0.8:8066 ::ffff:172.17.0.7:39978 ESTABLISHED 472/java
tcp 0 0 ::ffff:172.17.0.8:46624 ::ffff:172.17.0.5:3306 ESTABLISHED 472/java
tcp 0 0 ::ffff:172.17.0.8:41286 ::ffff:172.17.0.4:3306 ESTABLISHED 472/java
Test host測試
測試是拿amoeba.xml中定義的用戶名密碼去測試，千萬別被這地方繞進去
[root@7898596a875b ~]# mysql -uroot -p -h172.17.0.8 -P8066
Enter password:
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MySQL connection id is 1265630343
Server version: 5.1.45-mysql-amoeba-proxy-3.0.4-BETA MariaDB Server
Copyright (c) 2000, 2016, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MySQL [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| new1 |
| new2 |
| performance_schema |
| test |
+--------------------+
6 rows in set (0.00 sec)
測試讀寫分離
master mysql
:
在master上建表
MariaDB [(none)]> use new1;
MariaDB [new1]> create table student( id int(4) not null AUTO_INCREMENT, name char(20) not null, age tinyint(2) NOT NULL default '0', dept varchar(16) default NULL, primary key(id), KEY index_name (name) );
slave1,slave2
:
slave1
停掉slave
MariaDB [(none)]> stop slave;
Query OK, 0 rows affected (0.02 sec)
MariaDB [new1]> insert into new1.student(id,name) values(2,'slave');
Query OK, 1 row affected (0.03 sec)
MariaDB [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 2 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
slave2
MariaDB [(none)]> stop slave;
Query OK, 0 rows affected (0.02 sec)
MariaDB [(none)]> insert into new1.student(id,name) values(3,'slave');
Query OK, 1 row affected (0.04 sec)
MariaDB [(none)]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 3 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
master上也插入一條數據
MariaDB [new1]> insert into new1.student(id,name) values(1,'slave');
Query OK, 1 row affected (0.02 sec)
查詢插入
MariaDB [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 1 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
Test host測試
MySQL [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 3 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
第一次查詢發現只查詢到slave的數據，覺得另外一個slave讀寫分離沒有作成功，再次查詢發現
amoeba是輪詢着從從數據庫池裏讀取數據
MySQL [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 2 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
再插入一條數據，發現查詢不到插入的，仍是隻能查詢到slave上數據
MySQL [new1]> insert into student(id,name) values(4,'yufyang');
Query OK, 1 row affected (0.02 sec)
MySQL [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 3 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.00 sec)
MySQL [new1]> select * from new1.student;
+----+-------+-----+------+
| id | name | age | dept |
+----+-------+-----+------+
| 2 | slave | 0 | NULL |
+----+-------+-----+------+
1 row in set (0.01 sec)
master mysql
：
MariaDB [new1]> select * from new1.student;
+----+---------+-----+------+
| id | name | age | dept |
+----+---------+-----+------+
| 1 | slave | 0 | NULL |
| 4 | yufyang | 0 | NULL |
+----+---------+-----+------+
2 rows in set (0.00 sec)
發現剛纔在測試機上經過amoeba插入的數據已經出如今主數據庫的表中
開啓slave
再次查詢slave上的數據
MariaDB [new1]> select * from new1.student;
+----+---------+-----+------+
| id | name | age | dept |
+----+---------+-----+------+
| 1 | slave | 0 | NULL |
| 2 | slave | 0 | NULL |
| 4 | yufyang | 0 | NULL |
+----+---------+-----+------+
發現已經同步master，amoeba測試機上的數據了
相關文章
- 1. MysqL主從複製和讀寫分離
- 2. mysql主從複製和讀寫分離
- 3. MySQL主從複製和讀寫分離
- 4. Mysql主從複製和讀寫分離
- 5. MYSQL主從複製和讀寫分離
- 6. mysql的主從複製讀寫分離
- 7. MySQL主從複製與讀寫分離
- 8. mysql主從複製、讀寫分離
- 9. MySQL主從複製讀寫分離
- 10. MYSQL主從複製+讀寫分離
- 更多相關文章...
- • Redis主從複製的配置方法和執行過程 - Redis教程
- • C# 二進制文件的讀寫 - C#教程
- • 漫談MySQL的鎖機制
- • Docker容器實戰(六) - 容器的隔離與限制
相關標籤/搜索
每日一句
-
每一个你不满意的现在，都有一个你没有努力的曾经。
最新文章
- 1. CVPR 2020 論文大盤點-光流篇
- 2. Photoshop教程_ps中怎麼載入圖案？PS圖案如何導入？
- 3. org.pentaho.di.core.exception.KettleDatabaseException:Error occurred while trying to connect to the
- 4. SonarQube Scanner execution execution Error --- Failed to upload report - 500: An error has occurred
- 5. idea 導入源碼包
- 6. python學習 day2——基礎學習
- 7. 3D將是頁遊市場新賽道？
- 8. osg--交互
- 9. OSG-交互
- 10. Idea、spring boot 圖片(pgn顯示、jpg不顯示)解決方案
歡迎關注本站公眾號,獲取更多信息
相關文章
- 1. MysqL主從複製和讀寫分離
- 2. mysql主從複製和讀寫分離
- 3. MySQL主從複製和讀寫分離
- 4. Mysql主從複製和讀寫分離
- 5. MYSQL主從複製和讀寫分離
- 6. mysql的主從複製讀寫分離
- 7. MySQL主從複製與讀寫分離
- 8. mysql主從複製、讀寫分離
- 9. MySQL主從複製讀寫分離
- 10. MYSQL主從複製+讀寫分離