Redis Cluster集羣搭建

時間  2019-12-06
標籤 redis cluster 集羣 搭建 欄目 Redis 简体版
原文   原文鏈接

1、redis集羣基本介紹

Redis 集羣是一個能夠在多個 Redis 節點之間進行數據共享的設施installation。node

Redis 集羣不支持那些須要同時處理多個鍵的 Redis 命令， 由於執行這些命令須要在多個 Redis 節點之間移動數據， 而且在高負載的狀況下， 這些命令將下降Redis集羣的性能， 並致使不可預測的行爲。redis

Redis 集羣經過分區partition來提供必定程度的可用性availability： 即便集羣中有一部分節點失效或者沒法進行通信， 集羣也能夠繼續處理命令請求。數據庫

將數據自動切分(split)到多個節點的能力。vim

當集羣中的一部分節點失效或者沒法進行通信時，仍然能夠繼續處理命令請求的能力。ruby

2、redis集羣數據共享

Redis集羣使用數據分片(sharding)而非一致性哈希(consistency hashing)來實現：一個Redis集羣包含16384個哈希槽(hash slot)，數據庫中的每一個鍵都屬於這16384個哈希槽的其中一個，集羣使用公CRC16(key)%16384來計算鍵key屬於哪一個槽，其中CRC16(key)語句用於計算鍵key的CRC16校驗和。服務器

節點A負責處理0號至5500號哈希槽。app

節點B負責處理5501號至11000號哈希槽。ide

節點C負責處理11001號至16384號哈希槽。性能

3、redis cluster

4、集羣安裝部署

6個redis實例，通常會放到3臺硬件服務器
注：在企業規劃中，一個分片的兩個分到不一樣的物理機，防止硬件主機宕機形成整個分片數據丟失。spa

4.1 安裝基礎軟件

# 安裝redis，帶有redis-trib.rb命令
wget http://download.redis.io/releases/redis-3.2.12.tar.gz
tar xf redis-3.2.12.tar.gz -C /usr/local/
mv /usr/local/redis-3.2.12/ /usr/local/redis
cd /usr/local/redis/
make
PATH=/usr/local/redis/src:$PATH
source /etc/profile

# 安裝ruby軟件支持
yum install ruby rubygems -y
gem sources -l

# 修改成國內源
gem sources -a http://mirrors.aliyun.com/rubygems/
gem sources --remove https://rubygems.org/
gem sources -l

# 安裝redis集羣軟件，能夠指定版本，不然爲最新版本
gem install redis -v 3.3.3

4.2 建立各節點配置文件

mkdir -p /data/700{0..5}
vim /data/7000/redis.conf
port 7000
daemonize yes
pidfile /data/7000/redis.pid
loglevel notice
logfile /data/7000/redis.log
dbfilename dump.rdb
dir /data/7000
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7001/redis.conf
port 7001
daemonize yes
pidfile /data/7001/redis.pid
loglevel notice
logfile /data/7001/redis.log
dbfilename dump.rdb
dir /data/7001
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7002/redis.conf
port 7002
daemonize yes
pidfile /data/7002/redis.pid
loglevel notice
logfile /data/7002/redis.log
dbfilename dump.rdb
dir /data/7002
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7003/redis.conf
port 7003
daemonize yes
pidfile /data/7003/redis.pid
loglevel notice
logfile /data/7003/redis.log
dbfilename dump.rdb
dir /data/7003
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7004/redis.conf
port 7004
daemonize yes
pidfile /data/7004/redis.pid
loglevel notice
logfile /data/7004/redis.log
dbfilename dump.rdb
dir /data/7004
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7005/redis.conf
port 7005
daemonize yes
pidfile /data/7005/redis.pid
loglevel notice
logfile /data/7005/redis.log
dbfilename dump.rdb
dir /data/7005
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

4.3 啓動節點服務

redis-server /data/7000/redis.conf
redis-server /data/7001/redis.conf
redis-server /data/7002/redis.conf
redis-server /data/7003/redis.conf
redis-server /data/7004/redis.conf
redis-server /data/7005/redis.conf

4.4 將節點加入集羣

　　會自動將前3個節點認爲是master節點，後三個做爲對應的從節點。主節點和從節點應該分佈到不一樣的物理節點。

redis-trib.rb create --replicas 1 127.0.0.1:7000 127.0.0.1:7001 127.0.0.1:7002 127.0.0.1:7003 127.0.0.1:7004 127.0.0.1:7005
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
127.0.0.1:7000
127.0.0.1:7001
127.0.0.1:7002
Adding replica 127.0.0.1:7003 to 127.0.0.1:7000
Adding replica 127.0.0.1:7004 to 127.0.0.1:7001
Adding replica 127.0.0.1:7005 to 127.0.0.1:7002
M: c4983be04f95d9c9c848ba692cd42cb9201ff4b5 127.0.0.1:7000
   slots:0-5460 (5461 slots) master
M: 4223ef9cb913d796bb96187f7a737bc232a68d93 127.0.0.1:7001
   slots:5461-10922 (5462 slots) master
M: 4bb6c9008c10530a13379b738eaee8611ac96738 127.0.0.1:7002
   slots:10923-16383 (5461 slots) master
S: 5d112be8cd376d039a4ab2c66141d2fc25c50486 127.0.0.1:7003
   replicates c4983be04f95d9c9c848ba692cd42cb9201ff4b5
S: 9c758f060663f92e60e4c5c2389e33279e72cb7b 127.0.0.1:7004
   replicates 4223ef9cb913d796bb96187f7a737bc232a68d93
S: 78540a81d3d6d9bb6f73f848b7e5fb6b1d3bc5d2 127.0.0.1:7005
   replicates 4bb6c9008c10530a13379b738eaee8611ac96738
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join...
>>> Performing Cluster Check (using node 127.0.0.1:7000)
M: c4983be04f95d9c9c848ba692cd42cb9201ff4b5 127.0.0.1:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 4223ef9cb913d796bb96187f7a737bc232a68d93 127.0.0.1:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
M: 4bb6c9008c10530a13379b738eaee8611ac96738 127.0.0.1:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 5d112be8cd376d039a4ab2c66141d2fc25c50486 127.0.0.1:7003
   slots: (0 slots) slave
   replicates c4983be04f95d9c9c848ba692cd42cb9201ff4b5
S: 9c758f060663f92e60e4c5c2389e33279e72cb7b 127.0.0.1:7004
   slots: (0 slots) slave
   replicates 4223ef9cb913d796bb96187f7a737bc232a68d93
S: 78540a81d3d6d9bb6f73f848b7e5fb6b1d3bc5d2 127.0.0.1:7005
   slots: (0 slots) slave
   replicates 4bb6c9008c10530a13379b738eaee8611ac96738
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
redis-trib.rb create --replicas 1 127.0.0.1:7000 127.0.0.1:7001 127.0.0.1:7002 127.0.0.1:7003 127.0.0.1:7004 127.0.0.1:7005

4.5 集羣狀態查看

redis-cli -p 7000 cluster nodes| grep master
redis-cli -p 7000 cluster nodes| grep slave

5、集羣管理

5.1 新增節點，建立兩個節點的目錄及配置文件

mkdir /data/700{6,7}
vim /data/7006/redis.conf
port 7006
daemonize yes
pidfile /data/7006/redis.pid
loglevel notice
logfile /data/7006/redis.log
dbfilename dump.rdb
dir /data/7006
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

vim /data/7007/redis.conf
port 7007
daemonize yes
pidfile /data/7007/redis.pid
loglevel notice
logfile /data/7007/redis.log
dbfilename dump.rdb
dir /data/7007
protected-mode no
cluster-enabled yes
cluster-config-file nodes.conf
cluster-node-timeout 5000
appendonly yes

5.2 啓動新增兩節點的服務

redis-server /data/7006/redis.conf
redis-server /data/7007/redis.conf

5.3 添加主節點，把7006添加到7000節點所在的主集羣中

# redis-trib.rb add-node 127.0.0.1:7006 127.0.0.1:7000
# redis-cli -p 7000 cluster nodes | grep master
c4983be04f95d9c9c848ba692cd42cb9201ff4b5 127.0.0.1:7000 myself,master - 0 0 1 connected 0-5460
10b8ae75c548e46dbabbc5667c0b749813f855e5 127.0.0.1:7006 master - 0 1559015085602 0 connected                     # 添加到集羣以後，並無分配slot槽位，須要咱們手動來平均分配
4223ef9cb913d796bb96187f7a737bc232a68d93 127.0.0.1:7001 master - 0 1559015085602 2 connected 5461-10922          # 平均分配計算：16384/4=4096
4bb6c9008c10530a13379b738eaee8611ac96738 127.0.0.1:7002 master - 0 1559015084101 3 connected 10923-16383

5.4 轉移slot（從新分片）

redis-trib.rb reshard 127.0.0.1:7000
>>> Performing Cluster Check (using node 127.0.0.1:7000)
M: c4983be04f95d9c9c848ba692cd42cb9201ff4b5 127.0.0.1:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
M: 10b8ae75c548e46dbabbc5667c0b749813f855e5 127.0.0.1:7006
   slots: (0 slots) master
   0 additional replica(s)
M: 4223ef9cb913d796bb96187f7a737bc232a68d93 127.0.0.1:7001
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
M: 4bb6c9008c10530a13379b738eaee8611ac96738 127.0.0.1:7002
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 5d112be8cd376d039a4ab2c66141d2fc25c50486 127.0.0.1:7003
   slots: (0 slots) slave
   replicates c4983be04f95d9c9c848ba692cd42cb9201ff4b5
S: 9c758f060663f92e60e4c5c2389e33279e72cb7b 127.0.0.1:7004
   slots: (0 slots) slave
   replicates 4223ef9cb913d796bb96187f7a737bc232a68d93
S: 78540a81d3d6d9bb6f73f848b7e5fb6b1d3bc5d2 127.0.0.1:7005
   slots: (0 slots) slave
   replicates 4bb6c9008c10530a13379b738eaee8611ac96738
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 4096                     # 要移動槽位的大小：4096
What is the receiving node ID? 10b8ae75c548e46dbabbc5667c0b749813f855e5        # 接收節點的ID：7006的ID
Please enter all the source node IDs.
  Type 'all' to use all the nodes as source nodes for the hash slots.          # 鍵入all以將全部節點用做散列槽的源節點。
  Type 'done' once you entered all the source nodes IDs.                       # 輸入全部源節點ID後，鍵入done。
Source node #1:all                                                             # 輸入all全部節點分配槽位
……
Do you want to proceed with the proposed reshard plan (yes/no)? yes            # 是否繼續，選擇yes

5.5 添加從節點

# 查詢7006的ID
redis-cli -p 7000 cluster nodes | grep master
# 給7006添加7007的slave節點
redis-trib.rb add-node --slave --master-id 10b8ae75c548e46dbabbc5667c0b749813f855e5 127.0.0.1:7007 127.0.0.1:7000

5.6 刪除master槽位

redis-trib.rb reshard 127.0.0.1:7000
>>> Performing Cluster Check (using node 127.0.0.1:7000)
M: c4983be04f95d9c9c848ba692cd42cb9201ff4b5 127.0.0.1:7000
   slots:2731-5460 (2730 slots) master
   1 additional replica(s)
M: 10b8ae75c548e46dbabbc5667c0b749813f855e5 127.0.0.1:7006
   slots:0-2730,5461-8191,10923-13652 (8192 slots) master
   1 additional replica(s)
M: 4223ef9cb913d796bb96187f7a737bc232a68d93 127.0.0.1:7001
   slots:8192-10922 (2731 slots) master
   1 additional replica(s)
S: f1792f755d1b50e8e66073e5c03b1776b7cb36a7 127.0.0.1:7007
   slots: (0 slots) slave
   replicates 10b8ae75c548e46dbabbc5667c0b749813f855e5
M: 4bb6c9008c10530a13379b738eaee8611ac96738 127.0.0.1:7002
   slots:13653-16383 (2731 slots) master
   1 additional replica(s)
S: 5d112be8cd376d039a4ab2c66141d2fc25c50486 127.0.0.1:7003
   slots: (0 slots) slave
   replicates c4983be04f95d9c9c848ba692cd42cb9201ff4b5
S: 9c758f060663f92e60e4c5c2389e33279e72cb7b 127.0.0.1:7004
   slots: (0 slots) slave
   replicates 4223ef9cb913d796bb96187f7a737bc232a68d93
S: 78540a81d3d6d9bb6f73f848b7e5fb6b1d3bc5d2 127.0.0.1:7005
   slots: (0 slots) slave
   replicates 4bb6c9008c10530a13379b738eaee8611ac96738
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 8192      # 輸入要刪除master的slot的大小。
What is the receiving node ID? c4983be04f95d9c9c848ba692cd42cb9201ff4b5     # 要把槽位移動到的節點ID
Please enter all the source node IDs.
  Type 'all' to use all the nodes as source nodes for the hash slots.
  Type 'done' once you entered all the source nodes IDs.
Source node #1:10b8ae75c548e46dbabbc5667c0b749813f855e5    # 要刪除節點的ID
Source node #2:done    # 若是隻有一個的話，後面填寫done
redis-trib.rb reshard 127.0.0.1:7000

5.7 刪除master和slave節點

redis-cli -p 7000 cluster nodes
redis-trib.rb del-node 127.0.0.1:7006 10b8ae75c548e46dbabbc5667c0b749813f855e5
redis-trib.rb del-node 127.0.0.1:7007 f1792f755d1b50e8e66073e5c03b1776b7cb36a7
相關文章
相關標籤/搜索
每日一句
    每一个你不满意的现在，都有一个你没有努力的曾经。
本站公眾號
   歡迎關注本站公眾號,獲取更多信息
聯繫我們 最近搜索 最新文章 沪ICP备13005482号-10 MyBatis教程 SQL 教程 MySQL教程 Java 教程 Thymeleaf 教程 Hibernate教程 Spring教程 Redis教程