leonheart 发表于 2018-11-8 12:08:49

keepalived+nginx+tomcat的简单部署

  keepalived+nginx
  Keepalived是一个基于VRRP协议来实现的服务高可用方案,也是一种高性能的服务器高可用或热备解决方案,可以利用其来避免IP单点故障,类似的工具还有heartbeat、corosync、pacemaker。但是它一般不会单独出现,而是与其它负载均衡技术(如lvs、haproxy、nginx)一起工作来达到集群的高可用。为了更好的实现页面的调用,通过部署Keepalived+nginx来实现负载均衡,使得nginx高可靠性运行。基于Keepalived设计的服务模式能够真正做到主服务器和备份服务器故障时IP瞬间无缝交接,实现Web服务器负载均衡。

  架构规划:
  tomcat服务器:172.25.0.31、172.25.0.32
  负载均衡服务器nginx、调度器:172.25.0.41、172.25.0.42
  虚拟服务器(VIP):172.25.0.251
  一、服务的安装:
  两台负载均衡服务器服务分别安装nginx
  安装nginx
  1、安装软件依赖包:
yum -y groupinstall "Development Tools""Server Platform Deveopment"  
yum -y install gcc pcre-devel zlib-devel openssl-devel
  2、在所有的主机上面都操作,在两台nginx上执行以下操作;下载nginx包:
cd /usr/local/src/  
# yum install wget –y            ##安装wget工具
  3、下载nginx包:
# wget http://nginx.org/download/nginx-1.12.0.tar.gz  4、添加nginx运行的用户:
# useradd nginx  5解压nginx包,并且安装:
# tar zxvf nginx-1.12.0.tar.gz  
# cd nginx-1.12.0/
  6、安装nginx包:
# ./configure --prefix=/usr/local/nginx--user=nginx --group=nginx --with-http_ssl_module --with-http_flv_module--with-http_stub_status_module --with-http_gzip_static_module--with-pcre  ###编译安装
# make && make install  7、然后我们可以启动nginx:
# cd /usr/local/nginx/sbin/  
# ./nginx
  8、查看一下是否监听到端口:
# netstat -ntlp  
Active Internet connections (only servers)
  
Proto Recv-Q Send-Q Local Address         Foreign Address         State       PID/Program name
  
tcp      0   0 0.0.0.0:80             0.0.0.0:*            LISTEN      8035/nginx:master
  两台tomcat服务器都安装tomcat
1、# cd /usr/local/src  
    #wgethttp://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1503469020_c118f54d6bc26126e3ac84591f244ed5
  
    # tar -xf jdk-8u111-linux-x64.gz
  
    # ln -s /usr/local/src/jdk1.8.0_111/usr/local/jdk
  2、设置环境变量JAVA_HOME,添加以下三项:
#cat/etc/procfile  
export JAVA_HOME=/usr/local/jdk
  
export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$PATH
  
export CLASSPATH=.$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$JAVA_HOME/lib/tools.jar
  3、测试看是否安装成功:
# java -version  
java version "1.8.0_111"
  
Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
  
Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixedmode)
  4
#  
Wget
  
http://mirror.bit.edu.cn/apache/tomcat/tomcat-8/v8.5.20/bin/apache-tomcat-8.5.20.tar.gz
  5、安装tomcat:
# tar zxvf apache-tomcat-8.5.20.tar.gz  
# ln -s /usr/local/src/apache-tomcat-8.5.20/usr/local/tomcat
  
# chown -R root.root /usr/local/tomcat/
  设置环境变量:
# tail -1 /etc/profile  
export TOMCAT_HOME=/usr/local/tomcat/
  

  
# vim /usr/local/tomcat/conf/server.xml
  

添加  

  
把监听端口改为80
  

  

  
# cd /usr/local/tomcat/bin/
  
# ./catalina.sh start
  配置Keepalived服务
  在nginx主机上配置该服务
#yum -y install libnl libnl-devel libnfnetlink-devel popt-devel  
#wget http://www.keepalived.org/software/keepalived-1.2.7.tar.gz
  
#tar zxvf keepalived-1.2.7.tar.gz-C /usr/local
  
#cd ../keepalived-1.2.7
  
#./configure
  
# make && make install
  
#cp/usr/local/etc/rc.d/init.d/keepalived /etc/rc.d/init.d/
  
#cp/usr/local/etc/sysconfig/keepalived /etc/sysconfig/
  
#mkdir /etc/keepalived
  
#cp/usr/local/etc/keepalived/keepalived.conf /etc/keepalived/
  
#cp/usr/local/sbin/keepalived /usr/sbin/
  加入启动服务
#echo"/usr/local/nginx/sbin/nginx" >> /etc/rc.local  
#echo"/etc/init.d/keepalived start" >> /etc/rc.local
  二、服务的配置:
  2.1配置两台的nginx反向代理
#vim/usr/local/nginx/conf/nginx.conf  
upstream web_up{
  
      server 172.25.0.31max_fails=3 fail_timeout=20s weight=2;
  
      server 172.25.0.32max_fails=3 fail_timeout=20s weight=2;
  
      }
  
server {
  
      listen       80;
  
       server_name127.0.0.1;
  
location / {
  
               proxy_pass http://web_up;
  
               proxy_set_header Host $host;
  
               proxy_set_header X-Real-IP $remote_addr;
  
               proxy_set_header X-Forwared-For $proxy_add_x_forwarded_for;
  

  
      }
  2.2 配置keepalived
  按照上面的安装方法,keepalived的配置文件在/etc/keepalived/keepalived.conf。主、从服务器的配置相关联但有所不同。如下:
Master:  
# cd /etc/keepalived/
  
#vimkeepalived.conf
! Configuration File for keepalived  

  
global_defs {
  
notification_email {
  
       notification_email {
  
   #acassen@firewall.loc
  
   #failover@firewall.loc
  
   #sysadmin@firewall.loc
  
   }
  

  

  
#notification_email_from wanghaikuo@hysec.com
  
   #smtp_serversmtp.hysec.com
  
#smtp_connect_timeout 30
  
   router_id LVS_DEVEL
  

  
}
vrrp_instance VI_1 {  
    state MASTER
  
    interface eth1
  
    virtual_router_id51
  
    priority 100
  
    advert_int 1
  
    authentication {
  
      auth_type PASS
  
      auth_pass 1111
  
    }
  
    virtual_ipaddress {
  
      172.25.0.251
  
    }
  
}
  2.3另一台nginx配置keepalived的状态为backup。
  Backup:
  # cd /etc/keepalived/
  #vimkeepalived.conf
! Configuration File for keepalived  

  
global_defs {
  
notification_email {
  
       notification_email {
  
   #acassen@firewall.loc
  
   #failover@firewall.loc
  
   #sysadmin@firewall.loc
  
   }
  

  
#notification_email_from wanghaikuo@hysec.com
  
   #smtp_serversmtp.hysec.com
  
#smtp_connect_timeout 30
  
   router_id LVS_DEVEL
  

  
}
vrrp_instance VI_1 {  
    state BACKUP
  
    interface eth1
  
    virtual_router_id51
  
    priority 99
  
    advert_int 1
  
    authentication {
  
      auth_type PASS
  
      auth_pass 1111
  
    }
  
    virtual_ipaddress {
  
      172.25.0.251
  
    }
  
}
  三、测试keepalived获取的vip情况:

[*]  先后在主、从服务器上启动keepalived:/etc/init.d/keepalived start


[*]  在主服务器上查看是否已经绑定了虚拟IP: ip addr
[*]  停止主服务器上的keepalived:/etc/init.d/keepalived stop 然后在从服务器上查看是否已经绑定了虚拟IP:
[*]  启动主服务器上的keepalived,看看主服务器能否重新接管虚拟IP
  四、配置nginx的监控脚本
  【简单脚本】
#cd /etc/keepalived/  
#Vim chk_nginx.sh
#!/bin/bash  
Pgrep ngnix
  
port=80
  
if [ $? –eq 0 ] ; then
  
echo ”nginx isrunning”
  
else
  
   /usr/local/nginx/sbin/nginx
  
fi
#chmod a+x chk_nginx.sh  然后在keepalived.conf添加脚本路径,在keepalived.conf中增加如下配置:
vrrp_script chk_http_port {  
    script " /etc/keepalived/chk_nginx.sh"
  
    interval 2
  
    weight 2
  
}
  
track_script {
  
    chk_http_port
  
}
  测试结果:当一台主机的keepalived停止时,另一台keepalived将会接管web服务。
  另加一台测试主机:
# curl 172.25.0.251  
web1
  
# curl 172.25.0.251
  
web2


页: [1]
查看完整版本: keepalived+nginx+tomcat的简单部署