fdwe2e 发表于 2014-12-3 10:00:16

Puppet 3.7 结合Dashboard 1.2

1. 环境准备   OS:CentOS 6.4   关闭selinux和iptables
   部署Puppet:1.0 Puppet 3.7部署    安装Puppet源:http://yum.puppetlabs.com/puppetlabs-release-el-6.noarch.rpm

   Dashboard是Puppet官方提供的一个简易的Web UI,可以很方便的做Puppet报告的展示和ENC的管理.但是很功能和简易。后面会更新一个更强大的Foreman,敬请期待..

2. 安装Dashboard

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
#安装dashboard包和mysql数据库
yum install puppet-dashboard mysql-server mysql -y
/etc/init.d/mysqld start
chkconfig mysqld on

#初始化数据库相关...
mysql -e 'CREATE DATABASE dashboard_production CHARACTER SET utf8;'
mysql -e "CREATE USER 'dashboard'@'localhost' IDENTIFIED BY 'dbsa.cn';"
mysql -e "GRANT ALL PRIVILEGES ON dashboard_production.* TO 'dashboard'@'localhost';"
mysql -e 'set GLOBAL max_allowed_packet = 33554432;'

#在/etc/my.cnf中增加以下参数

max_allowed_packet = 32M

#执行表迁移任务,会生成相关的数据库表..
cd /usr/share/puppet-dashboard/
sed -i 's/UTC/Beijing/' config/environment.rb                              #修改显示时区
sed -ri 's/s+password:.*/password: dbsa.cn/' config/database.yml          #修改默认的数据库密码..
rake RAILS_ENV=production db:migrate


cp /usr/share/puppet-dashboard/ext/puppet/puppet_dashboard.rb/usr/lib/ruby/site_ruby/1.8/puppet/reports

#使用默认的WEBrick服务运行dashboard测试以下...
cd /usr/share/puppet-dashboard/
./script/server -e production

#访问dashboard...
http://ip:3000/






3. 配置Puppet
    配置由dashaboard分析Puppet的报告

1
2
3
4
5
#在Puppet Master上配置...
/etc/puppet/puppet.conf

reports = store, http
reporturl = http://localhost:3000/reports/upload               #localhost是发往dashboard的地址





    配置由dashboard管理class和parameters

1
2
3
4
5
6
#在Puppet Master上配置...
/etc/puppet/puppet.conf

node_terminus = exec
#localhost是发往dashboard的地址
external_nodes = /usr/bin/env PUPPET_DASHBOARD_URL=http://localhost:3000 /usr/share/puppet-dashboard/bin/external_node






4. 配置Nginx替代默认的WEBrick
    安装Ningx和passenger

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
yum install ruby-devel rubygems gcc gcc-c++ make -y
yum install curl-devel openssl-devel zlib-devel pcre-devel -y
gem install rake -v 10.4.0 -V
gem install rack -v 1.5.2 -V
gem install passenger -v 3.0.19 -V

#更换gem 源为淘宝的,国内因为gfw更新可能会失败并且很慢.
gem sources -a
gem sources --remove http://rubygems.org/
gem sources -l

#安装nginx...
cd /tmp
wget http://mirrors.sohu.com/nginx/nginx-1.6.2.tar.gz
tar xf nginx-1.6.2.tar.gz

#使用passenger编译Nginx
passenger-install-nginx-module

#选择1,在选择2,
然后在分别输入:
/tmp/nginx-1.6.2
/usr/local/nginx
一路回车...

#puppet rack
mkdir -p /etc/puppet/rack/public
cp /usr/share/puppet/ext/rack/config.ru /etc/puppet/rack
chown -R puppet.puppet/etc/puppet/rack





    Nginx配置文件:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
cat > /usr/local/nginx/conf/nginx.conf <<eof
user root;
worker_processes 1;
events {
    worker_connections 1024;
}
http {
    passenger_root /usr/lib/ruby/gems/1.8/gems/passenger-3.0.19;
    passenger_ruby /usr/bin/ruby;
    passenger_max_pool_size 32;
    include mime.types;
    default_type application/octet-stream;
    log_format main '$remote_addr - $remote_user [$time_local] "$request" '
   '$status"$http_referer" '
   '"$http_user_agent" "$http_x_forwarded_for"'
   '$upstream_addr $upstream_cache_status $upstream_status';
    sendfile on;
    keepalive_timeout 65;
    include /usr/local/nginx/conf/puppet.conf;          #如果按照 1.0 在本机部署了Puppet这个就不用注释...
    include /usr/local/nginx/conf/dashboard.conf;
}
EOF


cat > /usr/local/nginx/conf/dashboard.conf <<eof
server {
    listen 3000;
    server_name localhost;
    root /usr/share/puppet-dashboard/public;
    passenger_enabled on;
    access_log /usr/local/nginx/logs/access-3000.log main;
}
EOF



#启动dashboard服务
/usr/local/nginx/sbin/nginx -s reload

touch /usr/share/puppet-dashboard/log/production.log
chown -R puppet-dashboard.puppet-dashboard /usr/share/puppet-dashboard/log
chown -R puppet-dashboard.puppet-dashboard /usr/share/puppet-dashboard/tmp
chmod 666 /usr/share/puppet-dashboard/log/production.log

/etc/init.d/puppet-dashboard-workers start





    报告处理过程:
    1. Puppet Master在收到Agent的报告的时候,会通过http往自身的/reports/upload 接口POST一份..
    2. dashboard接收到post来的报告会保存到/usr/share/puppet-dashboard/spool
    3. 启动puppet-dashboard-workers 会开始处理报告..。
       默认puppet-dashboard-workers 启动两个进程处理,如果报告很多, 可以再配置进程数量.

1
2
3
cat >> /etc/sysconfig/puppet-dashboard <<eof
CPUS=`cat /proc/cpuinfo |grep process|wc -l`
EOF




    4. 处理完成的报告会写入数据库
   


5. 节点管理(ENC)
    在前面的master puppet.conf中配置使用enc。

1
2
3
4
5
#下面是一个测试..
cat > /etc/puppet/manifests/site.pp <<eof
node default {
}
EOF





   1. 在Dashboard 添加一个class。。(base的class在之前的blog中已经创建过,可以查看1.0 Puppet安装)

   

   

    2. 选择一个主机..
   

    3. 给这个主机添加class和parameters
   

   

    4. 查看添加的类和参数..
   

    5. 通过执行命令,查询配置

1
2
3
4
5
6
7
# /usr/bin/env PUPPET_DASHBOARD_URL=http://localhost:3000 /usr/share/puppet-dashboard/bin/external_node agent1.dbsa.cn
---
classes:
- base
parameters:
aa: bb
name: agent1.dbsa.cn







6. 常用维护命令
    导入现有的日志

1
2
cd /usr/share/puppet-dashboard;rake RAILS_ENV=production reports:import
cd /usr/share/puppet-dashboard;rake RAILS_ENV=production reports:import REPORT_DIR=/path/to/your/reports





   当数据量过大时,优化数据库

1
cd /usr/share/puppet-dashboard;rake RAILS_ENV=production db:raw:optimize





    删除一个月之前的日志

1
cd /usr/share/puppet-dashboard;rake RAILS_ENV=production reports:prune upto=1 unit=mon





    删除15天前的日志

1
cd /usr/share/puppet-dashboard;rake RAILS_ENV=production reports:prune upto=15 unit=day





    备份数据库         

1
mysqldump --add-locks --create-options --disable-keys --extended-insert --quick --set-charset --user=dashboard --password=dbsa.cn dashboard > production.sql





    恢复数据库

1
rake RAILS_ENV=production FILE=production.sql db:raw:restore






页: [1]
查看完整版本: Puppet 3.7 结合Dashboard 1.2