結合keepalived實現redis羣集高可用故障自動切換

   系統架構圖:
html

wKioL1NYeY7CE3KNAAGRzA16SNA956.jpg


咱們所要實現的目的很簡單,node

104,107 爲keepalive和redis主從架構,其他服務器好比10五、106均爲redis從庫而且掛在vip 192.168.56.180下面。linux

主keepalive負責主要平常工做,從keepalive擔任備機角色,一旦主keepalive掛掉,從keepalive服務器當即使從redis轉變角色切換成master狀態開始接管任務提供服務,實現業務的無縫切換,當掛掉的服務器修好上線後繼續擔任主的角色,從庫會自動切換到slave狀態而且不影響掛載在vip下的從redis的數據同步,一知足高併發架構的需求。redis


keepalive在ubuntu的安裝很簡單 shell

apt-get install libssl-dev
apt-get install openssl
apt-get install libpopt-dev
apt-get install keepalived

redis的安裝也很簡單:ubuntu

網上不少方法,也可參考個人另外一篇文章: redis的shell安裝腳本,實如今linux下本機主從架構bash

網上有一篇郭冬的一篇文章給了我很大啓發故拿來參考:經過Keepalived實現Redis Failover自動故障切換服務器

下面咱們看192.168.56.104主keepalived的配置架構

/etc/keepalived/keepalived.conf併發


global_defs {
        notification_email {
                409011500@qq.com
        }
        notification_email_from  409011500@qq.com
                smtp_server 127.0.0.1  (若是本機配置的話)
                smtp_connect_timeout 30
                router_id redis-ha
}
vrrp_script chk_redis {
                script "/home/lhb/sh/redis_check.sh"   ###監控腳本
                interval 2                                        ###監控時間
}
vrrp_instance VI_1 {
        state MASTER                            ###設置爲MASTER
        interface eth0                          ###監控網卡
        virtual_router_id 52
        priority 101                            ###權重值
        authentication {
                     auth_type PASS             ###加密
                     auth_pass redis            ###密碼
        }
        track_script {
                chk_redis                       ###執行上面定義的chk_redis
        }
        virtual_ipaddress {
             192.168.56.180                        ###VIP
        }
        notify_master /home/lhb/sh/redis_master.sh
        notify_backup /home/lhb/sh/redis_backup.sh
}

/home/lhb/sh/redis_master.sh

#!/bin/bash
REDISCLI="/usr/local/redis/bin/redis-cli"
LOGFILE="/usr/local/redis/log/keepalived-redis-state.log"
echo "[master]" >> $LOGFILE
date >> $LOGFILE
echo "Being master...." >> $LOGFILE 2>&1
echo "Run SLAVEOF cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF 192.168.56.107 6379 >> $LOGFILE  2>&1
sleep 10 #延遲10秒之後待數據同步完成後再取消同步狀態
echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1


/home/lhb/sh/redis_backup.sh

#!/bin/bash
REDISCLI="/usr/local/redis/bin/redis-cli"
LOGFILE="/usr/local/redis/log/keepalived-redis-state.log"
echo "[backup]" >> $LOGFILE
date >> $LOGFILE
echo "Being slave...." >> $LOGFILE 2>&1
sleep 15 #延遲15秒待數據被對方同步完成以後再切換主從角色
echo "Run SLAVEOF cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF 192.168.56.107 6379 >> $LOGFILE  2>&1


/usr/local/redis/etc/redis.conf

daemonize yes
pidfile /var/run/redis.pid
port 6379
tcp-backlog 511
timeout 0
tcp-keepalive 0
loglevel notice
logfile "/usr/local/redis/log/redis.log"
databases 16
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
dir /usr/local/redis/data
slave-serve-stale-data yes
slave-read-only no
repl-disable-tcp-nodelay no
slave-priority 100
appendonly yes
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-entries 512
list-max-ziplist-value 64
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes


192.168.56.107從keepalived的配置

/etc/keepalived/keepalived.conf

global_defs {
        notification_email {
                409011500@qq.com
        }
        notification_email_from 409011500@qq.com
                smtp_server 127.0.0.1
                smtp_connect_timeout 30
                router_id redis-ha
}
vrrp_script chk_redis {
                script "/home/lhb/sh/redis_check.sh"   ###監控腳本
                interval 2                                        ###監控時間
}
vrrp_instance VI_1 {
        state BACKUP                                ###設置爲BACKUP
        interface eth0                              ###監控網卡
        virtual_router_id 52
        priority 100                                ###比MASTRE權重值低
        authentication {
                     auth_type PASS
                     auth_pass redis                ###密碼與MASTRE相同
        }
        track_script {
                chk_redis                       ###執行上面定義的chk_redis
        }
        virtual_ipaddress {
             192.168.56.180                         ###VIP
        }
        notify_master /home/lhb/sh/redis_master.sh
        notify_backup /home/lhb/sh/redis_backup.sh
}


/home/lhb/sh/redis_master.sh

#!/bin/bash
REDISCLI="/usr/local/redis/bin/redis-cli"
LOGFILE="/usr/local/redis/log/keepalived-redis-state.log"
echo "[master]" >> $LOGFILE
date >> $LOGFILE
echo "Being master...." >> $LOGFILE 2>&1
echo "Run SLAVEOF cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF 192.168.56.104 6379 >> $LOGFILE  2>&1
sleep 10 #延遲10秒之後待數據同步完成後再取消同步狀態
echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1


/home/lhb/sh/redis_backup.sh

#!/bin/bash
REDISCLI="/usr/local/redis/bin/redis-cli"
LOGFILE="/usr/local/redis/log/keepalived-redis-state.log"
echo "[backup]" >> $LOGFILE
date >> $LOGFILE
echo "Being slave...." >> $LOGFILE 2>&1
sleep 15 #延遲15秒待數據被對方同步完成以後再切換主從角色
echo "Run SLAVEOF cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF 192.168.56.104 6379 >> $LOGFILE  2>&1


/home/lhb/sh/redis_check.sh

#!/bin/bash
ALIVE=`/usr/local/redis/bin/redis-cli PING`
if [ "$ALIVE" == "PONG" ]; then
  echo $ALIVE
  exit 0
else
  echo $ALIVE
  exit 1
fi


/usr/local/redis/etc/redis_slave.conf

daemonize yes
pidfile /var/run/redis_salve.pid
port 6379
tcp-backlog 511
timeout 0
tcp-keepalive 0
loglevel notice
logfile "/usr/local/redis/log/redis_slave.log"
databases 16
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump_salve.rdb
dir /usr/local/redis/data
slave-serve-stale-data yes
slave-read-only no
repl-disable-tcp-nodelay no
slave-priority 100
appendonly yes
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-entries 512
list-max-ziplist-value 64
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes
SLAVEOF 192.168.56.104 6379


192.168.56.10五、192.168.56.106 redis配置文件相同:

/usr/local/redis/etc/redis_salve.conf

daemonize yes
pidfile /var/run/redis_salve.pid
port 6379
tcp-backlog 511
timeout 0
tcp-keepalive 0
loglevel notice
logfile "/usr/local/redis/log/redis_slave.log"
databases 16
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump_salve.rdb
dir /usr/local/redis/data
slave-serve-stale-data yes
slave-read-only no
repl-disable-tcp-nodelay no
slave-priority 100
appendonly no
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-entries 512
list-max-ziplist-value 64
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit slave 256mb 64mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
aof-rewrite-incremental-fsync yes
SLAVEOF 192.168.56.180 6379


好了,下面咱們就來展現一下是不是咱們期待的那樣?


啓動192.168.56.104,192.168.56.107上的redis,keepalvied,以及192.168.56.105,192.168.56.106上的redis

在192.168.56.104 咱們看到如下結果,已經獲取vip:192.168.56.180

wKiom1NYiejyYscZAAJldQVu4Ss388.jpg


wKiom1NYinnxIpddAAFCuP5SdOw780.jpg


在192.168.56.107 咱們看到如下結果,並無得到vip192.168.56.180

wKioL1NYi1zBOgf1AAKBRQPf020589.jpg


wKiom1NYi4biZ_S3AAF73oQ0smY062.jpg


在192.168.56.105,192.168.56.106咱們看到相同結果redis掛載在vip:192.168.56.180下

wKiom1NYjBuzgpjdAAEyqSBY5RY919.jpg


這時咱們把192.168.56.104下的redis給關閉掉,看一下結果:vip已經釋放

wKioL1NYjPXQ4BV_AAMw36SD3cA511.jpg

而後到192.168.56.107下看一下信息: 已經獲取vip,而且redis已經從salve切換到master,而且從庫10五、106狀態均爲online

wKiom1NYjeDguOWsAAJWPJYKPGI184.jpg

wKioL1NYjbbxEHjuAAFUpLSSi1g578.jpg


192.168.56.10五、192.168.56.106 redis結果:一直掛載在vip下面而且link_status處於up狀態

wKiom1NYlL3DwQmnAAEXRmwk9Vc332.jpg

因而可知,當主redis掛掉後,備機上的redis當即切換爲master,而且不影響業務正常運行。


咱們而後把主上redis重新啓動,看到下面結果: 主服務器獲取vip

wKioL1NYlefRP8S_AAQN0ZwQ7F8168.jpg

redis信息:咱們能夠看到192.168.56.107備機已經出如今master的slave列表中

wKioL1NYlkaj5aC2AAFGW2SCmkA345.jpg

而後切換到:192.168.56.107看一下信息: 已經釋放vip,而且redis已經從master切換到slave狀態,而且指向的master是192.168.56.104

wKiom1NYlw2SQ3b_AAIcAEkp6cU174.jpg


wKioL1NYluSyuVL6AAFzkvp_rMo237.jpg


在看192.168.56.10五、192.168.56.106 redis信息,亦然指向192.168.56.180

wKiom1NYl6ywM19YAAEZ8YuEbtI608.jpg


看到這裏,已經知足咱們系統架構最初的全部設想功能。有感興趣的同窗能夠一塊兒交流。謝謝

相關文章
相關標籤/搜索