MCollective架構篇7-多MQ下MCollective高可用部署
零基礎學習Puppet自動化配置管理系列文檔html
存在這樣一種場景，當你的puppet基於mcollective環境搭建完成以後，須要考慮MQ的高可用，不然，MQ掛掉以後就不能用mco命令進行推送了哦。 如何作MQ的高可用呢，其實有兩種方法： 方法一：兩臺MQ作集羣，經過複製隊列信息進行同步，節點訪問可經過浮動IP進行。 方法二：兩臺MQ獨立，在MC Server端作failover，經過rabbtimq的plugins參數實現，可設置自動檢測，切換時間等等。node
1、配置Rabbitmq
安裝（略），可參考http://kisspuppet.com/2013/11/10/mcollective-middleware/或http://rsyslog.org/2013/11/10/mcollective-middleware/linux
1. 開啓插件rabbitmq_stomp
[root@linuxmaster1poc ~]# rabbitmq-plugins enable rabbitmq_stomp The following plugins have been enabled: rabbitmq_stomp Plugin configuration has changed. Restart RabbitMQ for changes to take effect.
2. 添加tcp監聽端口和範圍
[root@linuxmaster1poc ~]# vim /etc/rabbitmq/rabbitmq.config
[
{rabbitmq_stomp, [{tcp_listeners, [61613]}]}
].
備註：可參考 http://www.rabbitmq.com/stomp.htmlweb
3. 建立帳戶並設置權限
若是你之前配置過，建議將配置清空shell
[root@linuxmaster1poc ~]# rabbitmqctl stop_app Stopping node rabbit@linuxmaster1poc ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl reset Resetting node rabbit@linuxmaster1poc ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl start_app Starting node rabbit@linuxmaster1poc ... ...done.
刪除默認用戶guest，添加三個用戶（web_admin-http訪問用，admin--管理員，mc_rabbitmq--mcollective連接用）vim
[root@linuxmaster1poc ~]# rabbitmqctl list_users Listing users ... guest [administrator] ...done. [root@linuxmaster1poc ~]# rabbitmqctl delete_user guest Deleting user "guest" ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl add_user mc_rabbitmq 123.com Creating user "mc_rabbitmq" ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl add_user admin password=123.com Creating user "admin" ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl add_user web_admin 123.com Creating user "web_admin" ... ...done.
設置用戶的角色ruby
[root@linuxmaster1poc ~]# rabbitmqctl set_user_tags admin administrator Setting tags for user "admin" to [administrator] ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl set_user_tags web_admin monitoring Setting tags for user "web_admin" to [monitoring] ... ...done.
建立虛擬主機組app
[root@linuxmaster1poc ~]# rabbitmqctl add_vhost /mcollective Creating vhost "/mcollective" ... ...done.
設置用戶訪問虛擬主機組的權限dom
[root@linuxmaster1poc ~]# rabbitmqctl set_permissions -p "/mcollective" mc_rabbitmq ".*" ".*" ".*" Setting permissions for user "mc_rabbitmq" in vhost "/mcollective" ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl set_permissions -p "/mcollective" admin ".*" ".*" ".*" Setting permissions for user "admin" in vhost "/mcollective" ... ...done. [root@linuxmaster1poc ~]# rabbitmqctl set_permissions -p "/mcollective" web_admin ".*" ".*" ".*" Setting permissions for user "web_admin" in vhost "/mcollective" ... ...done.
重啓rabbitmq-server服務tcp
[root@linuxmaster1poc ~]# /etc/init.d/rabbitmq-server restart Restarting rabbitmq-server: SUCCESS rabbitmq-server.
查看用戶以及角色是否建立成功
[root@linuxmaster1poc ~]# rabbitmqctl list_users Listing users ... admin [administrator] mc_rabbitmq [] web_admin [monitoring] ...done.
查看虛擬主機組「/mcollective」中全部用戶的權限
[root@linuxmaster1poc ~]# rabbitmqctl list_permissions -p "/mcollective" Listing permissions in vhost "/mcollective" ... admin .* .* .* mc_rabbitmq .* .* .* web_admin .* .* .* ...done. [root@linuxmaster1poc ~]#
四、登陸http://192.168.100.120:15672/設置虛擬主機「/mcollective」的exchanges
默認配置
[root@linuxmaster1poc ~]# rabbitmqctl list_exchanges -p "/mcollective" Listing exchanges ... direct amq.direct direct amq.fanout fanout amq.headers headers amq.match headers amq.rabbitmq.trace topic amq.topic topic ...done.
exchanges設置
設置後更新配置
exchanges設置
[root@linuxmaster1poc ~]# rabbitmqctl list_exchanges -p "/mcollective" Listing exchanges ... direct amq.direct direct amq.fanout fanout amq.headers headers amq.match headers amq.rabbitmq.trace topic amq.topic topic mcollective_broadcast topic mcollective_directed direct ...done.
備註：可參考官網設置 https://www.rabbitmq.com/man/rabbitmqctl.1.man.html
2、 配置MCollective:
1. 配置mcollective client端
[root@linuxmaster1poc testing]# cat /etc/mcollective/client.cfg topicprefix = /topic/ main_collective = mcollective collectives = mcollective libdir = /usr/libexec/mcollective logger_type = console #loglevel = debug loglevel = warn # Plugins securityprovider = psk plugin.psk = a36cd839414370e10fd281b8a38a4f48 direct_addressing = 1 connector = rabbitmq plugin.rabbitmq.vhost = /mcollective #虛擬主機 plugin.rabbitmq.pool.size = 2 #設置地址池裏有兩個mq plugin.rabbitmq.initial_reconnect_delay = 0.01 plugin.rabbitmq.max_reconnect_delay = 30.0 #重連時間 plugin.rabbitmq.use_exponential_back_off = true plugin.rabbitmq.back_off_multiplier = 2 plugin.rabbitmq.max_reconnect_attempts = 0 plugin.rabbitmq.randomize = false plugin.rabbitmq.timeout = -1 plugin.rabbitmq.pool.1.host = 192.168.100.120 plugin.rabbitmq.pool.1.port = 61613 plugin.rabbitmq.pool.1.user = mc_rabbitmq plugin.rabbitmq.pool.1.password = 123.com plugin.rabbitmq.pool.1.ssl = false plugin.rabbitmq.pool.2.host = 192.168.100.121 plugin.rabbitmq.pool.2.port = 61613 plugin.rabbitmq.pool.2.user = mc_rabbitmq plugin.rabbitmq.pool.2.password = 123.com plugin.rabbitmq.pool.2.ssl = false # Facts factsource = yaml plugin.yaml = /etc/mcollective/facts.yaml
2. 配置mcollective server端
[root@linux57poc tmp]# cat /etc/mcollective/server.cfg # --Global-- topicprefix = /topic/ main_collective = mcollective collectives = mcollective libdir = /usr/libexec/mcollective logfile = /var/log/puppet/mcollective.log loglevel = info daemonize = 1 # --rabbitmq Plugins-- securityprovider = psk plugin.psk = a36cd839414370e10fd281b8a38a4f48 direct_addressing = 1 connector = rabbitmq plugin.rabbitmq.vhost = /mcollective plugin.rabbitmq.pool.size = 2 plugin.rabbitmq.initial_reconnect_delay = 0.01 plugin.rabbitmq.max_reconnect_delay = 30.0 plugin.rabbitmq.use_exponential_back_off = true plugin.rabbitmq.back_off_multiplier = 2 plugin.rabbitmq.max_reconnect_attempts = 0 plugin.rabbitmq.randomize = false plugin.rabbitmq.timeout = -1 plugin.rabbitmq.pool.1.host = 192.168.100.120 plugin.rabbitmq.pool.1.port = 61613 plugin.rabbitmq.pool.1.user = mc_rabbitmq plugin.rabbitmq.pool.1.password = 123.com plugin.rabbitmq.pool.1.ssl = false plugin.rabbitmq.pool.2.host = 192.168.100.121 plugin.rabbitmq.pool.2.port = 61613 plugin.rabbitmq.pool.2.user = mc_rabbitmq plugin.rabbitmq.pool.2.password = 123.com plugin.rabbitmq.pool.2.ssl = false # --Puppet provider specific options-- plugin.service.provider = puppet plugin.service.puppet.hasstatus = true plugin.service.puppet.hasrestart = true plugin.puppet.command = puppet agent plugin.puppet.splay = true plugin.puppet.splaylimit = 30 plugin.puppet.config = /etc/puppet/puppet.conf # --Facts-- factsource = yaml ##factsource = facter plugin.yaml = /etc/mcollective/facts.yaml
3、高可用測試
特別注意： 節點mcollective的server.cfg中pool是有優先級的，默認數字小的生效，這點須要注意，也就是說當全部節點都鏈接在MQ2上的時候，啓動MQ1，mco命令是沒法使用的，由於它在運行的時候鏈接的是MQ1，而全部節點都鏈接在MQ2上。
1. 中止MQ1，查看切換狀態
1.1 先看當前的節點鏈接狀態
[root@linuxmaster1poc ~]# mco ping #查看鏈接的節點 linux57poc time=69.46 ms linux58poc time=70.05 ms linux64poc time=70.59 ms ---- ping statistics ---- 3 replies max: 70.59 min: 69.46 avg: 70.03 [root@linuxmaster1poc ~]# mco shell "lsof -i:61613" #查看全部節點監聽的端口狀況，能夠看到目前都鏈接在linuxmaster1poc上。 Do you really want to send this command unfiltered? (y/n): y Discovering hosts using the mc method for 2 second(s) .... 3 Host: linux64poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 36625 root 6u IPv4 27771 0t0 TCP linux64poc:40493->linuxmaster1poc:61613 (ESTABLISHED) Host: linux58poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 11060 root 6u IPv4 34046 0t0 TCP linux58poc:36295->linuxmaster1poc:61613 (ESTABLISHED) Host: linux57poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME ruby 18076 root 6u IPv4 1351365 TCP linux57poc:24698->linuxmaster1poc:61613 (ESTABLISHED) [root@linuxmaster1poc ~]# /etc/init.d/rabbitmq-server stop Stopping rabbitmq-server: rabbitmq-server.
1.2 再次運行mco查看切換狀態
[root@linuxmaster1poc ~]# mco ping linux58poc time=73.54 ms linux64poc time=74.61 ms linux57poc time=75.39 ms ---- ping statistics ---- 3 replies max: 75.39 min: 73.54 avg: 74.51 [root@linuxmaster1poc ~]# mco shell "lsof -i:61613" Do you really want to send this command unfiltered? (y/n): y Discovering hosts using the mc method for 2 second(s) .... 3 Host: linux58poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 11060 root 6u IPv4 34046 0t0 TCP linux58poc:36295->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 11060 root 9u IPv4 34137 0t0 TCP linux58poc:47200->linuxmaster2poc:61613 (ESTABLISHED) Host: linux64poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 36625 root 6u IPv4 27771 0t0 TCP linux64poc:40493->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 36625 root 8u IPv4 27877 0t0 TCP linux64poc:37472->linuxmaster2poc:61613 (ESTABLISHED) Host: linux57poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME ruby 18076 root 9u IPv4 1351484 TCP linux57poc:9309->linuxmaster2poc:61613 (ESTABLISHED)
經過日誌查看
[root@linuxmaster1poc ~]# mco shell "lsof -i:61613" Do you really want to send this command unfiltered? (y/n): y Discovering hosts using the mc method for 2 second(s) .... 3 Host: linux58poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 11428 root 6u IPv4 34283 0t0 TCP linux58poc:36300->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 11428 root 8u IPv4 34338 0t0 TCP linux58poc:47205->linuxmaster2poc:61613 (ESTABLISHED) Host: linux57poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME ruby 18447 root 6u IPv4 1351559 TCP linux57poc:59343->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 18447 root 8u IPv4 1351622 TCP linux57poc:29757->linuxmaster2poc:61613 (ESTABLISHED) Host: linux64poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 37054 root 4u IPv4 28036 0t0 TCP linux64poc:37476->linuxmaster2poc:61613 (ESTABLISHED) ruby 37054 root 6u IPv4 27990 0t0 TCP linux64poc:40497->linuxmaster1poc:61613 (CLOSE_WAIT)
總結：能夠看到以前的鏈接已經變成CLOSE_WAIT，新的鏈接被創建
2. 中止MQ2，啓動MQ1 查看切換狀態
[root@linuxmaster2poc rabbitmq]# /etc/init.d/rabbitmq-server stop Stopping rabbitmq-server: rabbitmq-server. [root@linux57poc service]# lsof -i:61613 COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME ruby 18447 root 6u IPv4 1351559 TCP linux57poc:59343->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 18447 root 8u IPv4 1351622 TCP linux57poc:29757->linuxmaster2poc:61613 (CLOSE_WAIT) [root@linux58poc ~]# lsof -i:61613 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 11428 root 6u IPv4 34283 0t0 TCP linux58poc:36300->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 11428 root 8u IPv4 34338 0t0 TCP linux58poc:47205->linuxmaster2poc:61613 (CLOSE_WAIT) [root@linux64poc ~]# lsof -i:61613 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 37054 root 4u IPv4 28036 0t0 TCP linux64poc:37476->linuxmaster2poc:61613 (CLOSE_WAIT) ruby 37054 root 6u IPv4 27990 0t0 TCP linux64poc:40497->linuxmaster1poc:61613 (CLOSE_WAIT) [root@linuxmaster1poc ~]# /etc/init.d/rabbitmq-server start Starting rabbitmq-server: SUCCESS rabbitmq-server.
根據 plugin.rabbitmq.max_reconnect_delay = 30.0，須要過最多30秒，mcollective服務端會從新創建鏈接請求
[root@linuxmaster1poc ~]# tailf /var/log/rabbitmq/rabbit\@linuxmaster1poc.log =INFO REPORT==== 24-Dec-2013::11:00:45 === accepting STOMP connection <0.332.0> (192.168.100.126:36316 -> 192.168.100.120:61613) =INFO REPORT==== 24-Dec-2013::11:00:45 === accepting STOMP connection <0.348.0> (192.168.100.125:18945 -> 192.168.100.120:61613) =INFO REPORT==== 24-Dec-2013::11:00:45 === accepting STOMP connection <0.382.0> (192.168.100.127:40513 -> 192.168.100.120:61613) [root@linuxmaster1poc ~]# mco ping linux58poc time=70.60 ms linux57poc time=71.32 ms linux64poc time=111.56 ms ---- ping statistics ---- 3 replies max: 111.56 min: 70.60 avg: 84.49 [root@linuxmaster1poc ~]# mco shell "lsof -i:61613" Do you really want to send this command unfiltered? (y/n): y Discovering hosts using the mc method for 2 second(s) .... 3 Host: linux58poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 11428 root 6u IPv4 34283 0t0 TCP linux58poc:36300->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 11428 root 8u IPv4 34338 0t0 TCP linux58poc:47205->linuxmaster2poc:61613 (CLOSE_WAIT) ruby 11428 root 10u IPv4 34444 0t0 TCP linux58poc:36316->linuxmaster1poc:61613 (ESTABLISHED) Host: linux57poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME ruby 18447 root 10u IPv4 1351723 TCP linux57poc:18945->linuxmaster1poc:61613 (ESTABLISHED) Host: linux64poc Statuscode: 0 Output: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME ruby 37054 root 4u IPv4 28036 0t0 TCP linux64poc:37476->linuxmaster2poc:61613 (CLOSE_WAIT) ruby 37054 root 6u IPv4 27990 0t0 TCP linux64poc:40497->linuxmaster1poc:61613 (CLOSE_WAIT) ruby 37054 root 9u IPv4 28206 0t0 TCP linux64poc:40513->linuxmaster1poc:61613 (ESTABLISHED)
相關文章
- 1. MCollective架構篇2-MCollective+MQ架構的部署
- 2. MCollective架構篇4-MCollective各類插件的部署及測試
- 3. MCollective架構篇1-MCollective架構的引入
- 4. MCollective架構篇3-Puppet插件的部署及測試
- 5. MCollective 安裝配置
- 6. foreman架構的引入7-Foreman結合mcollective完成push動做
- 7. grafana部署高可用架構
- 8. Rancher On K3s 高可用架構部署
- 9. CentOS 7 部署百萬pv項目（高可用架構）
- 10. 高可用架構篇 MyCat集羣部署（HAProxy + MyCat）
- 更多相關文章...
- • Maven 自動化部署 - Maven教程
- • Docker 架構 - Docker教程
- • 使用阿里雲OSS+CDN部署前端頁面與加速靜態資源
- • Git可視化極簡易教程 — Git GUI使用方法
相關標籤/搜索
每日一句
-
每一个你不满意的现在，都有一个你没有努力的曾经。
最新文章
- 1. eclipse設置粘貼字符串自動轉義
- 2. android客戶端學習-啓動模擬器異常Emulator: failed to initialize HAX: Invalid argument
- 3. android.view.InflateException: class com.jpardogo.listbuddies.lib.views.ListBuddiesLayout問題
- 4. MYSQL8.0數據庫恢復 MYSQL8.0ibd數據恢復 MYSQL8.0恢復數據庫
- 5. 你本是一個肉體，是什麼驅使你前行【1】
- 6. 2018.04.30
- 7. 2018.04.30
- 8. 你本是一個肉體，是什麼驅使你前行【3】
- 9. 你本是一個肉體，是什麼驅使你前行【2】
- 10. 【資訊】LocalBitcoins達到每週交易比特幣的7年低點
歡迎關注本站公眾號,獲取更多信息
相關文章
- 1. MCollective架構篇2-MCollective+MQ架構的部署
- 2. MCollective架構篇4-MCollective各類插件的部署及測試
- 3. MCollective架構篇1-MCollective架構的引入
- 4. MCollective架構篇3-Puppet插件的部署及測試
- 5. MCollective 安裝配置
- 6. foreman架構的引入7-Foreman結合mcollective完成push動做
- 7. grafana部署高可用架構
- 8. Rancher On K3s 高可用架構部署
- 9. CentOS 7 部署百萬pv項目（高可用架構）
- 10. 高可用架構篇 MyCat集羣部署（HAProxy + MyCat）