Mysql的binlog日誌與mysqlbinlog命令

binlog相關html

MySQL 的二進制日誌 binlog 能夠說是 MySQL 最重要的日誌,它記錄了全部的 DDL 和 DML 語句(除了數據查詢語句select、show等),以事件形式記錄,還包含語句所執行的消耗的時間,MySQL的二進制日誌是事務安全型的。binlog 的主要目的是複製和恢復。mysql

Binlog日誌的兩個最重要的使用場景
MySQL主從複製:MySQL Replication在Master端開啓binlog,Master把它的二進制日誌傳遞給slaves來達到master-slave數據一致的目的
數據恢復:經過使用 mysqlbinlog工具來使恢復數據sql


整體的關於binlog的參數以下數據庫

sync_binlog = 1
log-bin = mysql-bin
binlog_format = row
expire_logs_days = 10
binlog_cache_size =4M
max_binlog_cache_size =8M
max_binlog_size =1024M

相關參數講解安全

log-bin
決定了msyql 的binlog的名字,⽣成的binlog名字爲mysql-bin.000001服務器


binlog_format
規定binlog的格式, binlog有三種格式statement, row以及mixed,默認使⽤默認使⽤statement(5.7.7以前),建議使⽤row格式(5.7.7以後默認)網絡


expire_logs_days
過時時間session


binlog_do_db
此參數表示只記錄指定數據庫的⼆進制⽇志app


binlog_ignore_db
此參數表示不記錄指定的數據庫的⼆進制⽇志socket


sync_binlog
在提交n次事務後,進⾏binlog的落盤, 0爲不進⾏強⾏的刷新操做,⽽是由⽂件系統控制刷新⽇志⽂件
若是是在線交易和賬有關的數據建議設置成1, 若是是其它數據能夠保持爲0便可。


max_binlog_size
binlog⽂件的最⼤值,默認和最⼤是1GB,並不能嚴格限定⼆進制⽂件的⼤⼩


max_binlog_cache_size 表示的是binlog 可以使⽤的最⼤cache 內存⼤⼩
當咱們執⾏多語句事務的時候 全部session的使⽤的內存超過max_binlog_cache_size的值時
就會報錯: 「Multi-statement transaction required more than 'max_binlog_cache_size' bytes ofstorage」

mysqlbinlog格式

statment格式
特色:記錄每⼀條數據的SQL,將執⾏的每⼀條SQL記錄在binlog中,減小⽇志量,節省IO,提⾼性能。
缺點:某些SQL中的函數⽆法使⽤,⽐如SYSDATE(),在同步過程當中會出現⽆法同步的問題。
mixed格式
特色:⼀般的語句使⽤SQL語句來記錄,遇到特殊的語句使⽤row格式來記錄,保證數據的⼀致性和複製的準確性。
row格式
特色: binlog中僅僅記錄哪⼀條記錄被修改,不記錄dml的sql語句,會詳細記錄每⼀行的更改細節,不會出現⽆法複製的問題。
缺點:由於要記錄每⼀條修改記錄的⽇志,因此⼤量佔⽤磁盤IO和⼤量使⽤硬盤空間。

注:將二進制日誌格式設置爲ROW時,有些更改仍然使用基於語句的格式,包括全部DDL語句,例如CREATE TABLE, ALTER TABLE,或 DROP TABLE。

開啓binlog

因爲log_bin是個只讀系統變量,不能動態的修改,只能再my.cnf裏[mysqld]模塊添加log-bin 配置,表示啓用binlog,若是沒有給定值,寫成 log-bin=,則默認名稱爲主機名。(注:名稱若帶有小數點,則只取第一個小數點前的部分做爲名稱)

[mysqld]
log-bin=mysql-bin

此方法須要重啓數據庫方能生效,若是想臨時關掉binlog而又不想重啓數據庫,可使用sql_log_bin,sql_log_bin 是一個動態變量,修改該變量時,能夠只對當前會話生效(Session),也能夠是全局的(Global),當全局修改這個變量時,只會對新的會話生效(這意味當對當前會話也不會生效),所以通常全局修改了這個變量後,都要把原來的全部鏈接 kill 掉,全局只在MariaDB 5.5以前和MySQL 5.6.22以前生效,後面的版本都已經不支持全局,由於太危險了。
用處:
當還原數據庫的時候,若是不關閉二進制日誌,那麼你還原的過程仍然會記錄在二進制日誌裏面,不只浪費資源,那麼增長了磁盤的容量,尚未必要(特別是利用二進制還原數據庫的時候)因此通常還原的時候會選擇關閉二進制日誌,能夠經過修改配置文件,重啓關閉二進制日誌。
也能夠動態命令關閉sql_log_bin,而後導入數據庫。

set sql_log_bin=0;# 設爲0後,在當前會話上執行的語句都不記錄binlog
set sql_log_bin=1; # 取消限制

經常使用的binlog命令

# 是否啓用binlog日誌
show variables like 'log_bin';

# 查看詳細的日誌配置信息
show global variables like '%log%';

# 查看binlog的目錄
show global variables like "%log_bin%";

# 查看當前服務器使用的biglog文件及大小
show binary logs;

# 查看最新一個binlog日誌文件名稱和Position
show master status;

# 清除全部的binlog⽂件,而且重置爲⼀個
reset master

清理binlog日誌

自動清理:
經過binlog參數(expire_logs_days )來實現mysql⾃動刪除binlog

show binary logs;
show variables like 'expire_logs_days';
set global expire_logs_days=3; # 過時刪除,單位是天

手動清理:

一、使⽤reset master 重置binlog⽂件(#reset master後,會形成slave⽆法找到master的嚴重後果)

二、直接rm本地刪除binlog

# 查看正在使用的binlog
show master status;

直接使⽤rm 命令刪除不是當前使⽤的binlog(切記不要刪除正在使⽤的binlog)

 

mysqlbinlog命令

root@localhost localhost 15:23:43 (none)>show global variables like "%log_bin%";
+---------------------------------+-----------------------------+
| Variable_name | Value |
+---------------------------------+-----------------------------+
| log_bin | ON |
| log_bin_basename | /data/mysql/mysql-bin |
| log_bin_index | /data/mysql/mysql-bin.index |
| log_bin_trust_function_creators | ON |
| log_bin_use_v1_row_events | OFF |
+---------------------------------+-----------------------------+
5 rows in set (0.00 sec)

root@localhost localhost 15:29:21 test1>show global variables like "binlog_format";
+---------------+-------+
| Variable_name | Value |
+---------------+-------+
| binlog_format | ROW |
+---------------+-------+
1 row in set (0.01 sec)

root@localhost localhost 15:25:06 abc>create database test1;
Query OK, 1 row affected (0.00 sec)

root@localhost localhost 15:25:28 abc>use test1;
Database changed
root@localhost localhost 15:25:34 test1>CREATE TABLE `abc` (
-> `id` int(11) NOT NULL AUTO_INCREMENT,
-> `c1` int(11) DEFAULT NULL,
-> PRIMARY KEY (`id`),
-> KEY `shouji` (`c1`) USING BTREE
-> ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
Query OK, 0 rows affected (0.01 sec)

root@localhost localhost 15:26:12 test1>insert into abc(c1) values (1);
Query OK, 1 row affected (0.13 sec)

root@localhost localhost 15:26:23 test1>insert into abc(c1) values (2),(3);
Query OK, 2 rows affected (0.02 sec)
Records: 2 Duplicates: 0 Warnings: 0

root@localhost localhost 15:26:43 test1>delete from abc where id=2;
Query OK, 1 row affected (0.00 sec)

root@localhost localhost 15:26:58 test1>select * from abc;
+----+------+
| id | c1 |
+----+------+
| 1 | 1 |
| 3 | 3 |
+----+------+
2 rows in set (0.00 sec)

root@localhost localhost 15:47:38 test1>show master status;
+------------------+----------+--------------+------------------+------------------------------------------+
| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+------------------------------------------+
| mysql-bin.000001 | 1361 | | | 0f943fa6-3117-11ea-a98d-005056b351ef:1-5 |
+------------------+----------+--------------+------------------+------------------------------------------+
1 row in set (0.00 sec)

root@localhost localhost 15:48:27 test1>show binlog events in 'mysql-bin.000001'\G;
*************************** 1. row ***************************
Log_name: mysql-bin.000001
Pos: 4
Event_type: Format_desc
Server_id: 1007231
End_log_pos: 123
Info: Server ver: 5.7.19-log, Binlog ver: 4
*************************** 2. row ***************************
Log_name: mysql-bin.000001
Pos: 123
Event_type: Previous_gtids
Server_id: 1007231
End_log_pos: 150
Info:
*************************** 3. row ***************************
Log_name: mysql-bin.000001
Pos: 150
Event_type: Gtid
Server_id: 1007231
End_log_pos: 211
Info: SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:1'
*************************** 4. row ***************************
Log_name: mysql-bin.000001
Pos: 211
Event_type: Query
Server_id: 1007231
End_log_pos: 304
Info: create database test1
*************************** 5. row ***************************
Log_name: mysql-bin.000001
Pos: 304
Event_type: Gtid
Server_id: 1007231
End_log_pos: 365
Info: SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:2'
*************************** 6. row ***************************
Log_name: mysql-bin.000001
Pos: 365
Event_type: Query
Server_id: 1007231
End_log_pos: 629
Info: use `test1`; CREATE TABLE `abc` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`c1` int(11) DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `shouji` (`c1`) USING BTREE
) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
*************************** 7. row ***************************
Log_name: mysql-bin.000001
Pos: 629
Event_type: Gtid
Server_id: 1007231
End_log_pos: 690
Info: SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:3'
*************************** 8. row ***************************
Log_name: mysql-bin.000001
Pos: 690
Event_type: Query
Server_id: 1007231
End_log_pos: 759
Info: BEGIN
*************************** 9. row ***************************
Log_name: mysql-bin.000001
Pos: 759
Event_type: Table_map
Server_id: 1007231
End_log_pos: 803
Info: table_id: 220 (test1.abc)
*************************** 10. row ***************************
Log_name: mysql-bin.000001
Pos: 803
Event_type: Write_rows
Server_id: 1007231
End_log_pos: 843
Info: table_id: 220 flags: STMT_END_F
*************************** 11. row ***************************
Log_name: mysql-bin.000001
Pos: 843
Event_type: Xid
Server_id: 1007231
End_log_pos: 870
Info: COMMIT /* xid=52 */
*************************** 12. row ***************************
Log_name: mysql-bin.000001
Pos: 870
Event_type: Gtid
Server_id: 1007231
End_log_pos: 931
Info: SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:4'
*************************** 13. row ***************************
Log_name: mysql-bin.000001
Pos: 931
Event_type: Query
Server_id: 1007231
End_log_pos: 1000
Info: BEGIN
*************************** 14. row ***************************
Log_name: mysql-bin.000001
Pos: 1000
Event_type: Table_map
Server_id: 1007231
End_log_pos: 1044
Info: table_id: 220 (test1.abc)
*************************** 15. row ***************************
Log_name: mysql-bin.000001
Pos: 1044
Event_type: Write_rows
Server_id: 1007231
End_log_pos: 1093
Info: table_id: 220 flags: STMT_END_F
*************************** 16. row ***************************
Log_name: mysql-bin.000001
Pos: 1093
Event_type: Xid
Server_id: 1007231
End_log_pos: 1120
Info: COMMIT /* xid=53 */
*************************** 17. row ***************************
Log_name: mysql-bin.000001
Pos: 1120
Event_type: Gtid
Server_id: 1007231
End_log_pos: 1181
Info: SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:5'
*************************** 18. row ***************************
Log_name: mysql-bin.000001
Pos: 1181
Event_type: Query
Server_id: 1007231
End_log_pos: 1250
Info: BEGIN
*************************** 19. row ***************************
Log_name: mysql-bin.000001
Pos: 1250
Event_type: Table_map
Server_id: 1007231
End_log_pos: 1294
Info: table_id: 220 (test1.abc)
*************************** 20. row ***************************
Log_name: mysql-bin.000001
Pos: 1294
Event_type: Delete_rows
Server_id: 1007231
End_log_pos: 1334
Info: table_id: 220 flags: STMT_END_F
*************************** 21. row ***************************
Log_name: mysql-bin.000001
Pos: 1334
Event_type: Xid
Server_id: 1007231
End_log_pos: 1361
Info: COMMIT /* xid=54 */
21 rows in set (0.00 sec)

 

下面是mysqlbinlog命令的參數,摘自官方文檔

選項名稱 描述 引用 棄用
--base64-output
使用base-64編碼打印二進制日誌條目    
--bind-address 使用指定的網絡接口鏈接到MySQL Server    
--binlog-row-event-max-size 二進制日誌最大事件大小    
--character-sets-dir 字符集的安裝目錄    
--connection-server-id 用於測試和調試。有關適用的默認值和其餘詳細信息,請參見文本 5.7.5  
--database
僅列出該數據庫的條目    
--debug 編寫調試日誌    
--debug-check 程序退出時打印調試信息    
--debug-info 程序退出時打印調試信息,內存和CPU統計信息    
--default-auth 身份驗證插件使用    
--defaults-extra-file 除了一般的選項文件,還讀取命名的選項文件    
--defaults-file 只讀命名的選項文件    
--defaults-group-suffix 選項組後綴值    
--disable-log-bin 禁用二進制日誌記錄    
--exclude-gtids 不要顯示提供的GTID集中的任何組    
--force-if-open 讀取二進制日誌文件,即便打開或未正確關閉    
--force-read 若是mysqlbinlog讀取了沒法識別的二進制日誌事件,則會輸出警告    
--get-server-public-key 從服務器請求RSA公鑰 5.7.23  
--help 顯示幫助信息並退出    
--hexdump 顯示登陸註釋的十六進制轉儲    
--host MySQL服務器所在的主機    
--idempotent 僅在處理來自此會話的二進制日誌更新時,致使服務器使用冪等模式 5.7.0  
--include-gtids 僅顯示提供的GTID集中的組    
--local-load 在指定目錄中爲LOAD DATA準備本地臨時文件    
--login-path 從.mylogin.cnf中讀取登陸路徑選項    
--no-defaults 不讀取選項文件    
--offset 跳過日誌中的前N個條目    
open_files_limit 指定要保留的打開文件描述符的數量    
--password 鏈接服務器時使用的密碼    
--plugin-dir 安裝插件的目錄    
--port 用於鏈接的TCP / IP端口號    
--print-defaults 打印默認選項    
--protocol 使用的鏈接協議    
--raw 將事件以原始(二進制)格式寫入輸出文件    
--read-from-remote-master 從MySQL主服務器讀取二進制日誌,而不是讀取本地日誌文件    
--read-from-remote-server 從MySQL服務器而不是本地日誌文件中讀取二進制日誌    
--result-file 直接輸出到命名文件    
--rewrite-db 從基於行的格式編寫的日誌中播放時,爲數據庫建立重寫規則。可屢次使用 5.7.1  
--secure-auth 不要以舊(4.1以前)格式向服務器發送密碼 5.7.4 5.7.5
--server-id 僅提取由具備給定服務器ID的服務器建立的那些事件    
--server-id-bits 告訴mysqlbinlog當mysqld編寫的server-id-bits設置爲小於最大值時,如何解釋二進制日誌中的服務器ID;僅受MySQL Cluster版本的mysqlbinlog支持    
--server-public-key-path 包含RSA公鑰的文件的路徑名 5.7.23  
--set-charset 在輸出中添加SET NAMES charset_name語句    
--shared-memory-base-name 用於共享內存鏈接的共享內存的名稱    
--short-form 僅顯示日誌中包含的語句    
--skip-gtids 不要打印任何GTID。從包含GTID的二進制日誌寫入轉儲文件時使用此功能    
--socket Unix套接字文件或Windows命名管道使用    
--ssl 啓用鏈接加密 5.7.3  
--ssl-ca 包含受信任的SSL證書頒發機構列表的文件 5.7.3  
--ssl-capath 包含受信任的SSL證書頒發機構證書文件的目錄 5.7.3  
--ssl-cert 包含X.509證書的文件 5.7.3  
--ssl-cipher 鏈接加密的容許密碼 5.7.3  
--ssl-crl 包含證書吊銷列表的文件    
--ssl-crlpath 包含證書吊銷列表文件的目錄    
--ssl-key 包含X.509密鑰的文件 5.7.3  
--ssl-mode 與服務器鏈接的所需安全狀態 5.7.11  
--ssl-verify-server-cert 根據服務器證書的公用名身份驗證主機名 5.7.3  
--start-datetime 從第一個事件中讀取時間戳等於或晚於datetime參數的二進制日誌    
--start-position 從位置等於或大於參數的第一個事件讀取二進制日誌    
--stop-datetime 在時間戳等於或大於datetime參數的第一個事件時中止讀取二進制日誌    
--stop-never 讀取最後一個二進制日誌文件後保持與服務器的鏈接    
--stop-never-slave-server-id 鏈接到服務器時要報告的從服務器ID    
--stop-position 在第一個事件中中止讀取二進制日誌,且位置等於或大於參數    
--tls-version 容許的TLS協議進行加密鏈接 5.7.10  
--to-last-log 不要在從MySQL服務器請求的二進制日誌的結尾處中止,而要繼續打印到最後一個二進制日誌的結尾    
--user 鏈接服務器時要使用的MySQL用戶名    
--verbose 將行事件重建爲SQL語句    
--verify-binlog-checksum 驗證二進制日誌中的校驗和    

 

[root@localhost mysql]# mysqlbinlog mysql-bin.000001 >/data/tmp/mysqlbinlog.sql
[root@localhost mysql]# cat /data/tmp/mysqlbinlog.sql
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at 4
#200107 15:45:15 server id 1007231  end_log_pos 123     Start: binlog v 4, server v 5.7.19-log created 200107 15:45:15 at startup
# Warning: this binlog is either in use or was not closed properly.
ROLLBACK/*!*/;
BINLOG '
CzcUXg9/Xg8AdwAAAHsAAAABAAQANS43LjE5LWxvZwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAALNxReEzgNAAgAEgAEBAQEEgAAXwAEGggAAAAICAgCAAAACgoKKioAEjQA
AEJXKj0=
'/*!*/;
# at 123
#200107 15:45:15 server id 1007231  end_log_pos 150     Previous-GTIDs
# [empty]
# at 150
#200107 15:45:53 server id 1007231  end_log_pos 211     GTID    last_committed=0    sequence_number=1    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:1'/*!*/;
# at 211
#200107 15:45:53 server id 1007231  end_log_pos 304     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383153/*!*/;
SET @@session.pseudo_thread_id=3/*!*/;
SET @@session.foreign_key_checks=1, @@session.sql_auto_is_null=0, @@session.unique_checks=1, @@session.autocommit=1/*!*/;
SET @@session.sql_mode=1344274432/*!*/;
SET @@session.auto_increment_increment=1, @@session.auto_increment_offset=1/*!*/;
/*!\C utf8mb4 *//*!*/;
SET @@session.character_set_client=224,@@session.collation_connection=224,@@session.collation_server=224/*!*/;
SET @@session.lc_time_names=0/*!*/;
SET @@session.collation_database=DEFAULT/*!*/;
create database test1
/*!*/;
# at 304
#200107 15:46:38 server id 1007231  end_log_pos 365     GTID    last_committed=1    sequence_number=2    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:2'/*!*/;
# at 365
#200107 15:46:38 server id 1007231  end_log_pos 629     Query    thread_id=3    exec_time=0    error_code=0
use `test1`/*!*/;
SET TIMESTAMP=1578383198/*!*/;
CREATE TABLE `abc` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`c1` int(11) DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `shouji` (`c1`) USING BTREE
 ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
/*!*/;
# at 629
#200107 15:47:15 server id 1007231  end_log_pos 690     GTID    last_committed=2    sequence_number=3    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:3'/*!*/;
# at 690
#200107 15:47:15 server id 1007231  end_log_pos 759     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383235/*!*/;
BEGIN
/*!*/;
# at 759
#200107 15:47:15 server id 1007231  end_log_pos 803     Table_map: `test1`.`abc` mapped to number 220
# at 803
#200107 15:47:15 server id 1007231  end_log_pos 843     Write_rows: table id 220 flags: STMT_END_F

BINLOG '
gzcUXhN/Xg8ALAAAACMDAAAAANwAAAAAAAEABXRlc3QxAANhYmMAAgMDAAI=
gzcUXh5/Xg8AKAAAAEsDAAAAANwAAAAAAAEAAgAC//wBAAAAAQAAAA==
'/*!*/;
# at 843
#200107 15:47:15 server id 1007231  end_log_pos 870     Xid = 52
COMMIT/*!*/;
# at 870
#200107 15:47:23 server id 1007231  end_log_pos 931     GTID    last_committed=3    sequence_number=4    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:4'/*!*/;
# at 931
#200107 15:47:23 server id 1007231  end_log_pos 1000     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383243/*!*/;
BEGIN
/*!*/;
# at 1000
#200107 15:47:23 server id 1007231  end_log_pos 1044     Table_map: `test1`.`abc` mapped to number 220
# at 1044
#200107 15:47:23 server id 1007231  end_log_pos 1093     Write_rows: table id 220 flags: STMT_END_F

BINLOG '
izcUXhN/Xg8ALAAAABQEAAAAANwAAAAAAAEABXRlc3QxAANhYmMAAgMDAAI=
izcUXh5/Xg8AMQAAAEUEAAAAANwAAAAAAAEAAgAC//wCAAAAAgAAAPwDAAAAAwAAAA==
'/*!*/;
# at 1093
#200107 15:47:23 server id 1007231  end_log_pos 1120     Xid = 53
COMMIT/*!*/;
# at 1120
#200107 15:47:30 server id 1007231  end_log_pos 1181     GTID    last_committed=4    sequence_number=5    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:5'/*!*/;
# at 1181
#200107 15:47:30 server id 1007231  end_log_pos 1250     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383250/*!*/;
BEGIN
/*!*/;
# at 1250
#200107 15:47:30 server id 1007231  end_log_pos 1294     Table_map: `test1`.`abc` mapped to number 220
# at 1294
#200107 15:47:30 server id 1007231  end_log_pos 1334     Delete_rows: table id 220 flags: STMT_END_F

BINLOG '
kjcUXhN/Xg8ALAAAAA4FAAAAANwAAAAAAAEABXRlc3QxAANhYmMAAgMDAAI=
kjcUXiB/Xg8AKAAAADYFAAAAANwAAAAAAAEAAgAC//wCAAAAAgAAAA==
'/*!*/;
# at 1334
#200107 15:47:30 server id 1007231  end_log_pos 1361     Xid = 54
COMMIT/*!*/;
SET @@SESSION.GTID_NEXT= 'AUTOMATIC' /* added by mysqlbinlog */ /*!*/;
DELIMITER ;
# End of log file
/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/;

發現有不少base64編碼的BINLOG語句,好比

BINLOG '
CzcUXg9/Xg8AdwAAAHsAAAABAAQANS43LjE5LWxvZwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAALNxReEzgNAAgAEgAEBAQEEgAAXwAEGggAAAAICAgCAAAACgoKKioAEjQA
AEJXKj0=
'/*!*/;
這樣的,這就須要加上--base64-output=DECODE-ROWS --verbose來解成一個sql語句。
[root@localhost mysql]# mysqlbinlog --base64-output=DECODE-ROWS -v mysql-bin.000001 >/data/tmp/mysqlbinlog2.sql
[root@localhost mysql]# cat /data/tmp/mysqlbinlog2.sql
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at 4
#200107 15:45:15 server id 1007231  end_log_pos 123     Start: binlog v 4, server v 5.7.19-log created 200107 15:45:15 at startup
# Warning: this binlog is either in use or was not closed properly.
ROLLBACK/*!*/;
# at 123
#200107 15:45:15 server id 1007231  end_log_pos 150     Previous-GTIDs
# [empty]
# at 150
#200107 15:45:53 server id 1007231  end_log_pos 211     GTID    last_committed=0    sequence_number=1    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:1'/*!*/;
# at 211
#200107 15:45:53 server id 1007231  end_log_pos 304     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383153/*!*/;
SET @@session.pseudo_thread_id=3/*!*/;
SET @@session.foreign_key_checks=1, @@session.sql_auto_is_null=0, @@session.unique_checks=1, @@session.autocommit=1/*!*/;
SET @@session.sql_mode=1344274432/*!*/;
SET @@session.auto_increment_increment=1, @@session.auto_increment_offset=1/*!*/;
/*!\C utf8mb4 *//*!*/;
SET @@session.character_set_client=224,@@session.collation_connection=224,@@session.collation_server=224/*!*/;
SET @@session.lc_time_names=0/*!*/;
SET @@session.collation_database=DEFAULT/*!*/;
create database test1
/*!*/;
# at 304
#200107 15:46:38 server id 1007231  end_log_pos 365     GTID    last_committed=1    sequence_number=2    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:2'/*!*/;
# at 365
#200107 15:46:38 server id 1007231  end_log_pos 629     Query    thread_id=3    exec_time=0    error_code=0
use `test1`/*!*/;
SET TIMESTAMP=1578383198/*!*/;
CREATE TABLE `abc` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`c1` int(11) DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `shouji` (`c1`) USING BTREE
 ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
/*!*/;
# at 629
#200107 15:47:15 server id 1007231  end_log_pos 690     GTID    last_committed=2    sequence_number=3    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:3'/*!*/;
# at 690
#200107 15:47:15 server id 1007231  end_log_pos 759     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383235/*!*/;
BEGIN
/*!*/;
# at 759
#200107 15:47:15 server id 1007231  end_log_pos 803     Table_map: `test1`.`abc` mapped to number 220
# at 803
#200107 15:47:15 server id 1007231  end_log_pos 843     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=1
###   @2=1
# at 843
#200107 15:47:15 server id 1007231  end_log_pos 870     Xid = 52
COMMIT/*!*/;
# at 870
#200107 15:47:23 server id 1007231  end_log_pos 931     GTID    last_committed=3    sequence_number=4    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:4'/*!*/;
# at 931
#200107 15:47:23 server id 1007231  end_log_pos 1000     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383243/*!*/;
BEGIN
/*!*/;
# at 1000
#200107 15:47:23 server id 1007231  end_log_pos 1044     Table_map: `test1`.`abc` mapped to number 220
# at 1044
#200107 15:47:23 server id 1007231  end_log_pos 1093     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=2
###   @2=2
### INSERT INTO `test1`.`abc`
### SET
###   @1=3
###   @2=3
# at 1093
#200107 15:47:23 server id 1007231  end_log_pos 1120     Xid = 53
COMMIT/*!*/;
# at 1120
#200107 15:47:30 server id 1007231  end_log_pos 1181     GTID    last_committed=4    sequence_number=5    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:5'/*!*/;
# at 1181
#200107 15:47:30 server id 1007231  end_log_pos 1250     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383250/*!*/;
BEGIN
/*!*/;
# at 1250
#200107 15:47:30 server id 1007231  end_log_pos 1294     Table_map: `test1`.`abc` mapped to number 220
# at 1294
#200107 15:47:30 server id 1007231  end_log_pos 1334     Delete_rows: table id 220 flags: STMT_END_F
### DELETE FROM `test1`.`abc`
### WHERE
###   @1=2
###   @2=2
# at 1334
#200107 15:47:30 server id 1007231  end_log_pos 1361     Xid = 54
COMMIT/*!*/;
SET @@SESSION.GTID_NEXT= 'AUTOMATIC' /* added by mysqlbinlog */ /*!*/;
DELIMITER ;
# End of log file
/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/;

這樣就能看出來具體的sql了。

還能夠根據時間來篩選語句:

[root@localhost mysql]# mysqlbinlog --base64-output=DECODE-ROWS -v --start-datetime="2020-01-07 15:47:14" --stop-datetime="2020-01-07 15:47:24" mysql-bin.000001 >/data/tmp/mysqlbinlog3.sql
[root@localhost mysql]# cat /data/tmp/mysqlbinlog3.sql
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at 4
#200107 15:45:15 server id 1007231  end_log_pos 123     Start: binlog v 4, server v 5.7.19-log created 200107 15:45:15 at startup
# Warning: this binlog is either in use or was not closed properly.
ROLLBACK/*!*/;
# at 629
#200107 15:47:15 server id 1007231  end_log_pos 690     GTID    last_committed=2    sequence_number=3    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:3'/*!*/;
# at 690
#200107 15:47:15 server id 1007231  end_log_pos 759     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383235/*!*/;
SET @@session.pseudo_thread_id=3/*!*/;
SET @@session.foreign_key_checks=1, @@session.sql_auto_is_null=0, @@session.unique_checks=1, @@session.autocommit=1/*!*/;
SET @@session.sql_mode=1344274432/*!*/;
SET @@session.auto_increment_increment=1, @@session.auto_increment_offset=1/*!*/;
/*!\C utf8mb4 *//*!*/;
SET @@session.character_set_client=224,@@session.collation_connection=224,@@session.collation_server=224/*!*/;
SET @@session.lc_time_names=0/*!*/;
SET @@session.collation_database=DEFAULT/*!*/;
BEGIN
/*!*/;
# at 759
#200107 15:47:15 server id 1007231  end_log_pos 803     Table_map: `test1`.`abc` mapped to number 220
# at 803
#200107 15:47:15 server id 1007231  end_log_pos 843     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=1
###   @2=1
# at 843
#200107 15:47:15 server id 1007231  end_log_pos 870     Xid = 52
COMMIT/*!*/;
# at 870
#200107 15:47:23 server id 1007231  end_log_pos 931     GTID    last_committed=3    sequence_number=4    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:4'/*!*/;
# at 931
#200107 15:47:23 server id 1007231  end_log_pos 1000     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383243/*!*/;
BEGIN
/*!*/;
# at 1000
#200107 15:47:23 server id 1007231  end_log_pos 1044     Table_map: `test1`.`abc` mapped to number 220
# at 1044
#200107 15:47:23 server id 1007231  end_log_pos 1093     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=2
###   @2=2
### INSERT INTO `test1`.`abc`
### SET
###   @1=3
###   @2=3
# at 1093
#200107 15:47:23 server id 1007231  end_log_pos 1120     Xid = 53
COMMIT/*!*/;
SET @@SESSION.GTID_NEXT= 'AUTOMATIC' /* added by mysqlbinlog */ /*!*/;
DELIMITER ;
# End of log file
/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/;

 

根據位置篩選,比我咱們上面用show binlog events in 'mysql-bin.000001'\G;看到的有條刪除類型的語句

*************************** 20. row ***************************
   Log_name: mysql-bin.000001
        Pos: 1294
 Event_type: Delete_rows
  Server_id: 1007231
End_log_pos: 1334
       Info: table_id: 220 flags: STMT_END_F

 

[root@localhost mysql]# mysqlbinlog --base64-output=DECODE-ROWS -v  --stop-position="1334" mysql-bin.000001 >/data/tmp/mysqlbinlog4.sql

You have new mail in /var/spool/mail/root
[root@localhost mysql]# cat /data/tmp/mysqlbinlog4.sql
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at 4
#200107 15:45:15 server id 1007231  end_log_pos 123     Start: binlog v 4, server v 5.7.19-log created 200107 15:45:15 at startup
# Warning: this binlog is either in use or was not closed properly.
ROLLBACK/*!*/;
# at 123
#200107 15:45:15 server id 1007231  end_log_pos 150     Previous-GTIDs
# [empty]
# at 150
#200107 15:45:53 server id 1007231  end_log_pos 211     GTID    last_committed=0    sequence_number=1    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:1'/*!*/;
# at 211
#200107 15:45:53 server id 1007231  end_log_pos 304     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383153/*!*/;
SET @@session.pseudo_thread_id=3/*!*/;
SET @@session.foreign_key_checks=1, @@session.sql_auto_is_null=0, @@session.unique_checks=1, @@session.autocommit=1/*!*/;
SET @@session.sql_mode=1344274432/*!*/;
SET @@session.auto_increment_increment=1, @@session.auto_increment_offset=1/*!*/;
/*!\C utf8mb4 *//*!*/;
SET @@session.character_set_client=224,@@session.collation_connection=224,@@session.collation_server=224/*!*/;
SET @@session.lc_time_names=0/*!*/;
SET @@session.collation_database=DEFAULT/*!*/;
create database test1
/*!*/;
# at 304
#200107 15:46:38 server id 1007231  end_log_pos 365     GTID    last_committed=1    sequence_number=2    rbr_only=no
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:2'/*!*/;
# at 365
#200107 15:46:38 server id 1007231  end_log_pos 629     Query    thread_id=3    exec_time=0    error_code=0
use `test1`/*!*/;
SET TIMESTAMP=1578383198/*!*/;
CREATE TABLE `abc` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`c1` int(11) DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `shouji` (`c1`) USING BTREE
 ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
/*!*/;
# at 629
#200107 15:47:15 server id 1007231  end_log_pos 690     GTID    last_committed=2    sequence_number=3    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:3'/*!*/;
# at 690
#200107 15:47:15 server id 1007231  end_log_pos 759     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383235/*!*/;
BEGIN
/*!*/;
# at 759
#200107 15:47:15 server id 1007231  end_log_pos 803     Table_map: `test1`.`abc` mapped to number 220
# at 803
#200107 15:47:15 server id 1007231  end_log_pos 843     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=1
###   @2=1
# at 843
#200107 15:47:15 server id 1007231  end_log_pos 870     Xid = 52
COMMIT/*!*/;
# at 870
#200107 15:47:23 server id 1007231  end_log_pos 931     GTID    last_committed=3    sequence_number=4    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:4'/*!*/;
# at 931
#200107 15:47:23 server id 1007231  end_log_pos 1000     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383243/*!*/;
BEGIN
/*!*/;
# at 1000
#200107 15:47:23 server id 1007231  end_log_pos 1044     Table_map: `test1`.`abc` mapped to number 220
# at 1044
#200107 15:47:23 server id 1007231  end_log_pos 1093     Write_rows: table id 220 flags: STMT_END_F
### INSERT INTO `test1`.`abc`
### SET
###   @1=2
###   @2=2
### INSERT INTO `test1`.`abc`
### SET
###   @1=3
###   @2=3
# at 1093
#200107 15:47:23 server id 1007231  end_log_pos 1120     Xid = 53
COMMIT/*!*/;
# at 1120
#200107 15:47:30 server id 1007231  end_log_pos 1181     GTID    last_committed=4    sequence_number=5    rbr_only=yes
/*!50718 SET TRANSACTION ISOLATION LEVEL READ COMMITTED*//*!*/;
SET @@SESSION.GTID_NEXT= '0f943fa6-3117-11ea-a98d-005056b351ef:5'/*!*/;
# at 1181
#200107 15:47:30 server id 1007231  end_log_pos 1250     Query    thread_id=3    exec_time=0    error_code=0
SET TIMESTAMP=1578383250/*!*/;
BEGIN
/*!*/;
# at 1250
#200107 15:47:30 server id 1007231  end_log_pos 1294     Table_map: `test1`.`abc` mapped to number 220
# at 1294
#200107 15:47:30 server id 1007231  end_log_pos 1334     Delete_rows: table id 220 flags: STMT_END_F
### DELETE FROM `test1`.`abc`
### WHERE
###   @1=2
###   @2=2
ROLLBACK /* added by mysqlbinlog */ /*!*/;
SET @@SESSION.GTID_NEXT= 'AUTOMATIC' /* added by mysqlbinlog */ /*!*/;
DELIMITER ;
# End of log file
/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/;

其餘選項能夠根據需求添加使用。

相關文章
相關標籤/搜索