logstash輸出到mysql

logstash輸出到mysql

logstash版本：6.5.3，確保 JDK 的版本是 1.8

1  安裝logstash-output-jdbc

/usr/share/logstash/bin/logstash-plugin install logstash-output-jdbc

2  JDBC插件依賴mysql-connector-java-5.1.47

下載

https://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.47.zip

解壓安裝

mkdir /etc/logstash/jdbc

cd /etc/logstash/jdbc

解壓到/etc/logstash/jdbc目錄

unzip mysql-connector-java-5.1.47.zip

3  數據庫服務器建立的表結構

CREATE TABLE test(

    ID INT NOT NULL AUTO_INCREMENT,

    TIME VARCHAR(25) NOT NULL,

    IP VARCHAR(20) NOT NULL,

    MESSAGES VARCHAR(255) NOT NULL,

    PRIMARY KEY (ID)

);

4  配置logstash的output

output {

jdbc {

    driver_jar_path => "/etc/logstash/jdbc/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar"

    driver_class => "com.mysql.jdbc.Driver"

    connection_string => "jdbc:mysql://mysql服務器ip:端口/數據庫?user=數據庫用戶名&password=數據庫密碼"

    statement => [ "insert into 數據表 (TIME ,IP,MESSAGES) values (?,?,?)","%{@timestamp}" ,"%{host}","%{message}" ]

  }

}