运维自动化之svn+puppet实现监控系统的版本控制与自动部署监控系统

之前发布了一篇“运维自动化之使用PHP+MYSQL+SHELL打造私有监控系统”地址为：http://dl528888.blog.51cto.com/2382721/1034992大家给了我很多的建议，现在我在把我如何的对监控系统做版本控制与自动化部署来给大家描述一下，希望对大家有益。

在描述之前，先把流程图给大家，希望能使大家清楚流程：

下面是是svn与puppet部分的详细说明

1. rpm -Uvh http://download.fedora.redhat.com/pub/epel/5/i386/epel-release-5-4.noarch.rpm  

1. wget http://dl.fedoraproject.org/pub/epel/5/x86_64/epel-release-5-4.noarch.rpm    
2. rpm -ivh epel-release-5-4.noarch.rpm  

1. yum -y install puppet-server openssl* 

（2）开启puppet服务端的服务

1. service puppetmaster start  

（3）添加到开机启动

1. chkconfig --level 345 puppet on  
2. chkconfig --level 345 puppetmaster on  

（4）在hosts里添加包含本身以及需要自动化的客户端机器主机名与ip地址

（5）接下来需要去客户端安装puppet、启动服务与进行认证了

2、在客户端

1. yum -y install puppet openssl*  
2. service puppet start   
3. chkconfig --level 345 puppet on  

然后在与服务端进行认证

1. puppetd --server master --test 

3、接下来在服务端进行允许认证

1. puppetca -s -a 

这样就完成了认证，之后就可以在puppet的client里进行获取服务端的配置，并自动的在本机更新了。

下面是我的配置，提供给大家参考（我已经贵州的puppet为例）

贵州的puppet结构为：

贵州备用为puppetmaster服务端

贵州web、贵州引擎、贵州引擎、贵州备用为客户端（主要贵州备用既为服务端与客户端是没有问题）

先看一下我的puppet服务端贵州备用的文件结构

1. [root@beiyong /]# tree /etc/puppet/  
2. /etc/puppet/  
3. |-- auth.conf  
4. |-- fileserver.conf             #puppet文件服务器配置文件  
5. |-- manifests                   #puppet主文件所在目录  
6. |   |-- guizhou_beiyong.pp      #该模块对应的文件资源，可能是要发送给slave的配置文件等  
7. |   |-- guizhou_jiaohuan.pp  
8. |   |-- guizhou_web.pp  
9. |   |-- guizhou_yinqing.pp  
10. |   `-- site.pp                 #puppet主文件（入口文件）  
11. `-- puppet.conf  
12.  
13. 1 directory, 8 files  

客户端连接的顺序：site.pp=》*.pp

比如贵州web的接收顺序为：site.pp=》guizhou_web.pp

首先，slave向发起master连接请求，进行证书验证；

接着，证书验证通过后，master会直接找到入口文件manifests目录下的site.pp文件，该文件可能包含一些全局变量，参数缺省值（当各个模块没有设置这些参数时，它们的缺省值）以及其它pp文件的调用（在该例子中，会调用manifests下的各个pp文件）；

然后，master通过manifests下的各个pp文件定位到该slave要执行的模块（site.pp是各个模块的入口），汇总这些模块代码返回给slave；

最后，slave根据master发过来的manifest，配置信息。

注意：在配置之前一定要求的服务端与客户端的时间一致，并且hosts里都加入了对方的ip与主机名，并且能互相ping通，最好在改好hosts文件后重启服务器，同时selinux与iptables关闭。

4、先看一下我fileserver的设置

1. [root@beiyong /]# cat /etc/puppet/fileserver.conf  
2. # This file consists of arbitrarily named sections/modules 
3. # defining where files are served from and to whom 
4.  
5. # Define a section 'files' 
6. # Adapt the allow/deny settings to your needs. Order 
7. # for allow/deny does not matter, allow always takes precedence 
8. # over deny 
9. # [files] 
10. #  path /var/lib/puppet/files 
11. #  allow *.example.com 
12. #  deny *.evil.example.com 
13. #  allow 192.168.0.0/24 
14. [puppet] 
15. path /usr/local/monitor/shell 
16. allow 172.16.6.0/24 

这个path就是puppet master的配置文件里从哪里获得需要给客户端传输程序的地址，同时也是svn的hook里post-commit更新的地址。

allow后面的网段是我服务器网卡的ip段，也就是需要我这个网段的ip能从这个path里或者程序。

5、贵州web的配置

1. [root@beiyong /]# cat /etc/puppet/manifests/guizhou_web.pp   
2. node web {  
3.     file { "/usr/local/monitor/shell/GuiZhou_alter80.sh":  
4.                 source=>"puppet:///puppet/GuiZhou_web/GuiZhou_web_alter80.sh",  
5.         mode=>755,  
6. }  
7.             file { "/usr/local/monitor/shell/GuiZhou_alter90.sh":  
8.                 source=>"puppet:///puppet/GuiZhou_web/GuiZhou_web_alter90.sh",  
9.                 mode=>755,  
10. }  
11.                 file { "/usr/local/monitor/shell/GuiZhou_web_check.sh":  
12.                 source=>"puppet:///puppet/GuiZhou_web/GuiZhou_web_check.sh",  
13.                 mode=>755,  
14. }  
15.                 file { "/usr/local/monitor/shell/web_tomcat.sh":  
16.                 source=>"puppet:///puppet/GuiZhou_web/web_tomcat.sh",  
17.                 mode=>755,  
18.         owner=>"lbs",  
19.         group=>"lbs",  
20. }  
21.                 file { "/usr/local/monitor/shell/web_yz_tomcat.sh":  
22.                 source=>"puppet:///puppet/GuiZhou_web/web_yz_tomcat.sh",  
23.                 mode=>755,  
24.                 owner=>"lbs",  
25.                 group=>"lbs",  
26. }  
27.         cron {  GuiZhou_web_alert80_check:  
28.         command=>"/usr/local/monitor/shell/GuiZhou_web_alter80.sh",  
29.         hour=>'*/6',  
30.         minute=>0,  
31. }  
32.                 cron {  GuiZhou_web_alert90_check:  
33.                 command=>"/usr/local/monitor/shell/GuiZhou_web_alter90.sh",  
34.                 hour=>'*/1',  
35.                 minute=>0,  
36. }  
37.                 cron {  GuiZhou_web_check:  
38.                 command=>"/usr/local/monitor/shell/GuiZhou_web_check.sh",  
39.                 minute=>'*/3',  
40. }  
41.                 cron {  GuiZhou_web_sendmail_restart:  
42.                 command=>"/etc/init.d/sendmail restart",  
43.                 hour=>'23',  
44.                 minute=>'00',  
45. }  
46. }  

6、贵州交换的配置

1. [root@beiyong /]# cat /etc/puppet/manifests/guizhou_jiaohuan.pp   
2. node jiaohuan {  
3.     file { "/usr/local/monitor/shell/GuiZhou_jiaohuan_alter80.sh":  
4.                 source=>"puppet:///puppet/GuiZhou_jiaohuan/GuiZhou_jiaohuan_alter80.sh",  
5.         mode=>755,  
6. }  
7.             file { "/usr/local/monitor/shell/GuiZhou_jiaohuan_alter90.sh":  
8.                 source=>"puppet:///puppet/GuiZhou_jiaohuan/GuiZhou_jiaohuan_alter90.sh",  
9.                 mode=>755,  
10. }  
11.                 file { "/usr/local/monitor/shell/GuiZhou_jiaohuan_check.sh":  
12.                 source=>"puppet:///puppet/GuiZhou_jiaohuan/GuiZhou_jiaohuan_check.sh",  
13.                 mode=>755,  
14. }  
15.                 file { "/usr/local/monitor/shell/GuiZhou_jiaohuan_ping.sh":  
16.                 source=>"puppet:///puppet/GuiZhou_jiaohuan/GuiZhou_jiaohuan_ping.sh",  
17.                 mode=>755,  
18. }  
19.         cron {  GuiZhou_jiaohuan_alert80_check:  
20.         command=>"/usr/local/monitor/shell/GuiZhou_jiaohuan_alter80.sh",  
21.         hour=>'*/6',  
22.         minute=>0,  
23. }  
24.                 cron {  GuiZhou_jiaohuan_alert90_check:  
25.                 command=>"/usr/local/monitor/shell/GuiZhou_jiaohuan_alter90.sh",  
26.                 hour=>'*/1',  
27.                 minute=>0,  
28. }  
29.                 cron {  GuiZhou_jiaohuan_check:  
30.                 command=>"/usr/local/monitor/shell/GuiZhou_jiaohuan_check.sh",  
31.                 minute=>'*/3',  
32. }  
33.                 cron {  GuiZhou_jiaohuan_ping:  
34.                 command=>"/usr/local/monitor/shell/GuiZhou_jiaohuan_ping.sh",  
35.                 minute=>'*/15',  
36. }  
37.                 cron {  GuiZhou_jiaohuan_sendmail_restart:  
38.                 command=>"/etc/init.d/sendmail restart",  
39.                 hour=>'23',  
40.                 minute=>'00',  
41. }  
42. }  

7、贵州引擎的配置

1. [root@beiyong /]# cat /etc/puppet/manifests/guizhou_yinqing.pp   
2. node savecenter {  
3.     file { "/usr/local/monitor/shell/GuiZhou_yinqing_alter80.sh":  
4.                 source=>"puppet:///puppet/GuiZhou_yinqing/GuiZhou_yinqing_alter80.sh",  
5.         mode=>755,  
6. }  
7.             file { "/usr/local/monitor/shell/GuiZhou_yinqing_alter90.sh":  
8.                 source=>"puppet:///puppet/GuiZhou_yinqing/GuiZhou_yinqing_alter90.sh",  
9.                 mode=>755,  
10. }  
11.                 file { "/usr/local/monitor/shell/GuiZhou_yinqing_check.sh":  
12.                 source=>"puppet:///puppet/GuiZhou_yinqing/GuiZhou_yinqing_check.sh",  
13.                 mode=>755,  
14.         owner=>lbs,  
15.         group=>lbs,  
16. }  
17.         cron {  GuiZhou_yinqing_alert80_check:  
18.         command=>"/usr/local/monitor/shell/GuiZhou_yinqing_alter80.sh",  
19.         hour=>'*/6',  
20.         minute=>0,  
21. }  
22.                 cron {  GuiZhou_yinqing_alert90_check:  
23.                 command=>"/usr/local/monitor/shell/GuiZhou_yinqing_alter90.sh",  
24.                 hour=>'*/1',  
25.                 minute=>0,  
26. }  
27.                 cron {  GuiZhou_yinqing_check:  
28.                 command=>"/usr/local/monitor/shell/GuiZhou_yinqing_check.sh",  
29.                 user=>lbs,  
30.                 minute=>'*/3',  
31. }  
32.                 cron {  GuiZhou_yinqing_sendmail_restart:  
33.                 command=>"/etc/init.d/sendmail restart",  
34.                 hour=>'23',  
35.                 minute=>'00',  
36. }  
37. }  

8、贵州备用的配置

1. [root@beiyong /]# cat /etc/puppet/manifests/guizhou_beiyong.pp   
2. node beiyong {  
3.     file { "/usr/local/monitor/shell/GuiZhou_beiyong_alter80.sh":  
4.                 source=>"puppet:///puppet/GuiZhou_beiyong/GuiZhou_beiyong_alter80.sh",  
5.         mode=>755,  
6. }  
7.             file { "/usr/local/monitor/shell/GuiZhou_beiyong_alter90.sh":  
8.                 source=>"puppet:///puppet/GuiZhou_beiyong/GuiZhou_beiyong_alter90.sh",  
9.                 mode=>755,  
10. }  
11.                 file { "/usr/local/monitor/shell/GuiZhou_beiyong_check.sh":  
12.                 source=>"puppet:///puppet/GuiZhou_beiyong/GuiZhou_beiyong_check.sh",  
13.                 mode=>755,  
14. }  
15.         cron {  GuiZhou_beiyong_alert80_check:  
16.         command=>"/usr/local/monitor/shell/GuiZhou_beiyong_alter80.sh",  
17.         hour=>'*/6',  
18.         minute=>0,  
19. }  
20.                 cron {  GuiZhou_beiyong_alert90_check:  
21.                 command=>"/usr/local/monitor/shell/GuiZhou_beiyong_alter90.sh",  
22.                 hour=>'*/1',  
23.                 minute=>0,  
24. }  
25.                 cron {  GuiZhou_beiyong_check:  
26.                 command=>"/usr/local/monitor/shell/GuiZhou_beiyong_check.sh",  
27.                 minute=>'*/3',  
28. }  
29.                 cron {  GuiZhou_beiyong_sendmail_restart:  
30.                 command=>"/etc/init.d/sendmail restart",  
31.         hour=>'23',  
32.                 minute=>'00',  
33. }  
34. }  

9、在查看一个site.pp的配置

1. [root@beiyong /]# cat /etc/puppet/manifests/site.pp   
2. import "guizhou_web.pp"  
3. import "guizhou_jiaohuan.pp"  
4. import "guizhou_yinqing.pp"  
5. import "guizhou_beiyong.pp"  

现在服务端的配置已经展现完成，在去客户端查看一下配置是否生效

1、贵州web

1. [root@web puppet]# crontab -l  
2. # HEADER: This file was autogenerated at Fri Oct 12 15:59:14 +0800 2012 by puppet.  
3. # HEADER: While it can still be managed manually, it is definitely not recommended.  
4. # HEADER: Note particularly that the comments starting with 'Puppet Name' should  
5. # HEADER: not be deleted, as doing so could cause duplicate cron jobs.  
6. # Puppet Name: GuiZhou_web_sendmail_restart  
7. 0 23 * * * /etc/init.d/sendmail restart  
8. # Puppet Name: GuiZhou_web_alert90_check  
9. 0 */1 * * * /usr/local/monitor/shell/GuiZhou_web_alter90.sh  
10. # Puppet Name: GuiZhou_web_alert80_check  
11. #0 */6 * * * /usr/local/monitor/shell/GuiZhou_web_alter80.sh  
12. # Puppet Name: GuiZhou_web_check  
13. */3 * * * * /usr/local/monitor/shell/GuiZhou_web_check.sh  

2、贵州交换

1. [root@jiaohuan ~]# crontab -l  
2. # HEADER: This file was autogenerated at Fri Oct 12 16:03:24 +0800 2012 by puppet.  
3. # HEADER: While it can still be managed manually, it is definitely not recommended.  
4. # HEADER: Note particularly that the comments starting with 'Puppet Name' should  
5. # HEADER: not be deleted, as doing so could cause duplicate cron jobs.  
6. # Puppet Name: GuiZhou_jiaohuan_sendmail_restart  
7. 0 23 * * * /etc/init.d/sendmail restart  
8. # Puppet Name: GuiZhou_jiaohuan_alert80_check  
9. 0 */6 * * * /usr/local/monitor/shell/GuiZhou_jiaohuan_alter80.sh  
10. # Puppet Name: GuiZhou_jiaohuan_alert90_check  
11. 0 */1 * * * /usr/local/monitor/shell/GuiZhou_jiaohuan_alter90.sh  
12. # Puppet Name: GuiZhou_jiaohuan_ping  
13. #*/15 * * * * /usr/local/monitor/shell/GuiZhou_jiaohuan_ping.sh  
14. # Puppet Name: GuiZhou_jiaohuan_check  
15. */3 * * * * /usr/local/monitor/shell/GuiZhou_jiaohuan_check.sh  

3、贵州引擎

由于贵州引擎有root账号与lbs用户的配置，所以我们先查看root用户的

1. [root@savecenter ~]# crontab -l  
2. # HEADER: This file was autogenerated at Fri Oct 12 16:16:41 +0800 2012 by puppet.  
3. # HEADER: While it can still be managed manually, it is definitely not recommended.  
4. # HEADER: Note particularly that the comments starting with 'Puppet Name' should  
5. # HEADER: not be deleted, as doing so could cause duplicate cron jobs.  
6. # Puppet Name: GuiZhou_yinqing_sendmail_restart  
7. 0 23 * * * /etc/init.d/sendmail restart  
8. # Puppet Name: GuiZhou_yinqing_alert80_check  
9. 0 */6 * * * /usr/local/monitor/shell/GuiZhou_yinqing_alter80.sh  
10. # Puppet Name: GuiZhou_yinqing_alert90_check  
11. 0 */1 * * * /usr/local/monitor/shell/GuiZhou_yinqing_alter90.sh  

在查看lbs用户的

1. [root@savecenter ~]# crontab -u lbs -l  
2. # HEADER: This file was autogenerated at Fri Oct 12 16:16:41 +0800 2012 by puppet.  
3. # HEADER: While it can still be managed manually, it is definitely not recommended.  
4. # HEADER: Note particularly that the comments starting with 'Puppet Name' should  
5. # HEADER: not be deleted, as doing so could cause duplicate cron jobs.  
6. #MIN HOUR DAY MONTH DAYOFWEEK COMMAND  
7. # Puppet Name: GuiZhou_yinqing_check  
8. */3 * * * * /usr/local/monitor/shell/GuiZhou_yinqing_check.sh  

4、贵州备用

1. [root@beiyong /]# crontab -l  
2. # HEADER: This file was autogenerated at Fri Oct 12 16:03:37 +0800 2012 by puppet.  
3. # HEADER: While it can still be managed manually, it is definitely not recommended.  
4. # HEADER: Note particularly that the comments starting with 'Puppet Name' should  
5. # HEADER: not be deleted, as doing so could cause duplicate cron jobs.  
6. # Puppet Name: GuiZhou_beiyong_check  
7. */3 * * * * /usr/local/monitor/shell/GuiZhou_beiyong_check.sh  
8. # Puppet Name: GuiZhou_beiyong_sendmail_restart  
9. 0 23 * * * /etc/init.d/sendmail restart  
10. # Puppet Name: GuiZhou_beiyong_alert90_check  
11. 0 */1 * * * /usr/local/monitor/shell/GuiZhou_beiyong_alter90.sh  
12. # Puppet Name: GuiZhou_beiyong_alert80_check  
13. 0 */6 * * * /usr/local/monitor/shell/GuiZhou_beiyong_alter80.sh  

现在puppet的配置已经完成，当前的配置已经在我们的生产服务器里部署。

如果大家想要在客户端的puppe设置一个时间来连接puppetmaster获取文件？

可以再客户端里的/etc/puppet/puppet.conf文件里加上：

1. runinterval =1800