puppet使用rsync模塊

puppet使用rsync模塊同步目錄和文件  

環境說明：

OS :    CentOS5.4                         i686
puppet版本:                               2.7.14
puppetmaster.manzuoinfo.com            192.168.0.12
puppet1.manzuoinfo.com                 192.168.0.64
rsync server                           192.168.0.12


同步需求簡介：

須要把 rsync server 192.168.0.12 上的 /tmp/default 和  /tmp/test 目錄 分別同步到 puppet1.manzuinfo.com 192.168.0.12 上的 /tmp/test1 下和/tmp/test。

點擊(此處)摺疊或打開

[root@puppetmaster test]# cd /tmp/
[root@puppetmaster tmp]# ls
default test
[root@puppetmaster tmp]# cd test
/tmp/test
[root@puppetmaster test]# ls -l
total 4
-rw-r--r-- 1 root root 0 Sep 22 17:32 10.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 1.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 2.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 3.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 4.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 5.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 6.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 7.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 8.txt
-rw-r--r-- 1 root root 0 Sep 22 17:32 9.txt
-rw-r--r-- 1 root root 17 Sep 22 17:32 test.txt


[root@puppetmaster default]# pwd
/tmp/default
[root@puppetmaster default]# ls
de.txt

1、下載安裝rsync 模塊

puppet 的rsync 模塊在GitHub位置 https://github.com/onyxpoint/pupmod-rsync ，你們能夠上去查看。

點擊(此處)摺疊或打開

[root@puppetmaster ~]# cd /etc/puppet/modules/

[root@puppetmaster modules]# git clone https://github.com/onyxpoint/pupmod-concat && mv pupmod-concat concat
[root@puppetmaster modules]# git clone https://github.com/onyxpoint/pupmod-rsync && mv pupmod-rsync rsync

說明:我這裏是使用git,若是機器沒有安裝,能夠使用yum -y install git 來安裝,如不想安裝git能夠下載zip壓縮包.解壓到相應目錄.
注意：在server, clent 端都下載安裝concat 和rsync 模塊。

2、服務端配置文件


1). 新建node.pp

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# pwd
/etc/puppet/manifests

[root@puppetmaster manifests]# cat node.pp
node 'puppetmaster.manzuoinfo.com' {
include 'rsync::server'
rsync::server::global { 'global':
  address => '192.168.0.12'
}


rsync::server::section { 'default':
  comment => 'The default file path',
  path => '/tmp/default',
  hosts_allow => '192.168.0.64'
}


rsync::server::section { 'test':
# auth_users => 'testuser',
   comment => 'Test comment',
   path => '/tmp/test',
   hosts_allow => '192.168.0.64',
   outgoing_chmod => 'o-w'
  }
}


node 'puppet1.manzuoinfo.com' {
include 'rsync'
}

2). 新建modules.pp 載入rsync 模塊

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# pwd
/etc/puppet/manifests

[root@puppetmaster manifests]# cat modules.pp
import "rsync"

3). 把 node.pp modules.pp 包進site.pp

點擊(此處)摺疊或打開

[root@puppetmaster test]# cat /etc/puppet/manifests/site.pp
import 'node.pp'
import 'modules.pp'

4). 測試配置文件

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# puppet agent --server=puppetmaster.manzuoinfo.com --test -v
info: Caching catalog for puppetmaster.manzuoinfo.com
info: /Stage[main]/Rsync/Tidy[/etc/rsync]: File does not exist
info: Applying configuration version '1379830750'
notice: /Stage[main]/Rsync/File[/etc/rsync]/ensure: created
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[default]/Concat_fragment[rsync+default.section]/content: content changed '' to '[default]
comment = The default file path
path = /home/sky
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Global[global]/Concat_fragment[rsync+global]/content: content changed '' to 'pid file = /var/run/rsyncd.pid
syslog facility = daemon
port = 873
address = 192.168.0.12
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[test]/Concat_fragment[rsync+test.section]/content: content changed '' to '[test]
comment = Test comment
path = /home/skywu
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]/Rsync::Server/Concat_build[rsync]/target: global*.section used for ordering
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/mode: mode changed '0644' to '0400'
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/content: audit change: newly-recorded value {md5}2148062cf8d2f7220279fd0ca07b9329
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
notice: /Stage[main]/Rsync::Server/Service[rsync]/ensure: ensure changed 'stopped' to 'running'
err: /Stage[main]/Rsync::Server/Service[rsync]: Failed to call refresh: Could not stop Service[rsync]: Execution of '/bin/kill `cat \`grep "pid file" /etc/rsyncd.conf | cut -f4 -d' '\``' returned 1: at /etc/puppet/modules/rsync/manifests/server.pp:56
info: Creating state file /var/lib/puppet/state/state.yaml
notice: Finished catalog run in 2.70 seconds
[root@puppetmaster manifests]#

注意：err: 這裏出現了一個錯誤，請根據本身的狀況來修改中止rsync,例如:
    stop => "ps -ef | grep [r]sync |awk '{print $2}'|xargs kill -9",

5). 在server 端生成rsync配置

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# puppetd --test --server puppetmaster.manzuoinfo.com
info: Caching catalog for puppetmaster.manzuoinfo.com
notice: /Stage[main]/Rsync/Tidy[/etc/rsync]: Tidying File[/etc/rsync]
info: /File[/etc/rsync]: Duplicate generated resource; skipping
info: Applying configuration version '1379837152'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[default]/Concat_fragment[rsync+default.section]/content: content changed '[default]
comment = The default file path
path = /home/sky
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
' to '[default]
comment = The default file path
path = /tmp/default
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]//Node[puppetmaster.manzuoinfo.com]/Rsync::Server::Section[test]/Concat_fragment[rsync+test.section]/content: content changed '[test]
comment = Test comment
path = /home/skywu
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
' to '[test]
comment = Test comment
path = /tmp/test
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
'
notice: /Stage[main]/Rsync::Server/Concat_build[rsync]/target: global*.section used for ordering
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/mode: mode changed '0644' to '0400'
notice: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]/content: audit change: previously recorded value {md5}2148062cf8d2f7220279fd0ca07b9329 has been changed to {md5}8063eb4c3129b055fb0106eb2cfd7912
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
info: /Stage[main]/Rsync::Server/File[/etc/rsyncd.conf]: Scheduling refresh of Service[rsync]
notice: /Stage[main]/Rsync::Server/Service[rsync]/ensure: ensure changed 'stopped' to 'running'
notice: /Stage[main]/Rsync::Server/Service[rsync]: Triggered 'refresh' from 2 events
notice: Finished catalog run in 3.66 seconds

注意：/etc/rsyncd.conf 是生成的，而不是手動建立的。

內容以下：

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# cat /etc/rsyncd.conf
pid file = /var/run/rsyncd.pid
syslog facility = daemon
port = 873
address = 192.168.0.12
[default]
comment = The default file path
path = /tmp/default
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
[test]
comment = Test comment
path = /tmp/test
use chroot = false
max connections = 0
max verbosity = 1
lock file = /var/run/rsyncd.lock
read only = true
write only = false
list = false
uid = root
gid = root
outgoing chmod = o-w
ignore nonreadable = true
transfer logging = true
log format = "%o %h [%a] %m (%u) %f %l"
dont compress = *.gz *.tgz *.zip *.z *.rpm *.deb *.iso *.bz2 *.tbz *.rar *.jar *.pdf *.sar *.war
hosts allow = 192.168.0.64
hosts deny = *
[root@puppetmaster manifests]#

6). 啓動rsync 服務

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# /etc/init.d/xinetd restart
Stopping xinetd: [ OK ]
Starting xinetd: [ OK ]

[root@puppetmaster manifests]# ps -ef | grep rsync
root 13227 1 0 16:16 ? 00:00:00 /usr/bin/rsync --daemon --config=/etc/rsyncd.conf
root 13266 3142 0 16:19 pts/0 00:00:00 grep rsync

7).  客戶端須要執行rsync類中,咱們編輯puppetmaster上的代碼文件,添加default 和test。

點擊(此處)摺疊或打開

[root@puppetmaster manifests]# vim /etc/puppet/modules/rsync/manifests/init.pp
class rsync {
  package { "rsync": ensure => "latest" }

  # This define provides a useful abstraction for common rsync client side
  # activities.
  exec { "rsync_stub":
    command => "/bin/true",
    refreshonly => true
  }


  file { '/etc/rsync':
    ensure => 'directory',
    owner => 'root',
    group => 'root',
    mode => '750'
  }


  tidy { '/etc/rsync':
    size => "0b",
    recurse => 'true',
    rmdirs => 'true'
  }


  rsync { 'default':
    source => 'default',
    target => '/tmp/test1',
    server => '192.168.0.12'
  }


  rsync { 'test':
    source => 'test',
    target => '/tmp/test',
    server => '192.168.0.12'
  }
}

3、puppet1 客戶端測試

點擊(此處)摺疊或打開

[root@puppet1 tmp]# puppetd --test --server puppetmaster.manzuoinfo.com
info: Caching catalog for puppet1.manzuoinfo.com
notice: /Stage[main]/Rsync/Tidy[/etc/rsync]: Tidying File[/etc/rsync]
info: /File[/etc/rsync]: Duplicate generated resource; skipping
info: Applying configuration version '1379841152'
notice: /Stage[main]/Rsync/Rsync[test]/do: executed successfully
notice: Finished catalog run in 0.75 seconds


或者用命令：
[root@puppet1 tmp]# puppet agent --test --server puppetmaster.manzuoinfo.com

點擊(此處)摺疊或打開

[root@puppet1 test1]# pwd
/tmp/test1
[root@puppet1 test1]# ls
de.txt
[root@puppet1 test]# pwd
/tmp/test
[root@puppet1 test]# ls -l
total 4
-rw-r--r-- 1 root root 0 Sep 23 11:42 10.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 1.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 2.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 3.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 4.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 5.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 6.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 7.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 8.txt
-rw-r--r-- 1 root root 0 Sep 23 11:42 9.txt
-rw-r--r-- 1 root root 17 Sep 23 11:42 test.txt

在客戶端查看/tmp/test 和 /tmp/test1 目錄及文件已經同步過來了。 參考文檔：http://www.mysqlops.com/2012/02/20/puppet-rsync.html