当前位置:web 服务器 > Tomcat >>

solrcloud,tomcat,外部zookeeper配置详解

之前由于在项目中使用的solr3.6,服务器总是莫名其妙的挂掉,各种解决未果,于是尝试换到solr4,想试试solrcloud和zookeeper集群看看效果怎么样,实际效果比3.6稳定很多,下面说一下项目中我们的具体现在一个测试的配置。 我们配置3台zookper服务器和3台solr服务器,由于没有多台机器测试,zookeeper的集群都在一台服务器上,tomcat部署在3台服务器上。

zookeeper是什么
ZooKeeper 顾名思义 动物园管理员,他是拿来管大象(Hadoop) 、 蜜蜂(Hive) 、 小猪(Pig)  的管理员, Apache Hbase和 Apache Solr 以及LinkedIn sensei  等项目中都采用到了 Zookeeper。ZooKeeper是一个分布式的,开放源码的分布式应用程序协调服务,ZooKeeper是以Fast Paxos算法为基础,实现同步服务,配置维护和命名服务等分布式应用。
zookeeper安装及配置
 zookeeper配置
(1)解压为zookeeper[plain] view plaincopyprint?tar -xf -C /home/myuser/zookeeper/ 

tar -xf -C /home/myuser/zookeeper/复制zookeeper文件夹3份,分别重名名为zookeeperA,zookeeperB,zookeeperC。
并且创建数据快照以及日志存放文件夹,命名为zooA,zooB,zooC。
(2)编辑对应的zookeeper配置文件,复制zookeeperconf下zoo_sample.cfg为zoo.cfg
[plain]
cd /home/myuser/zookeeperA/conf 
cp zoo_sample.cfg zoo.cfg    

cd /home/myuser/zookeeperA/conf
cp zoo_sample.cfg zoo.cfg   (3)修改zoo.cfg
[html]
# The number of milliseconds of each tick 
tickTime=2000 
# The number of ticks that the initial  
# synchronization phase can take 
initLimit=10 
# The number of ticks that can pass between  
# sending a request and getting an acknowledgement 
syncLimit=5 
# the directory where the snapshot is stored. 
# do not use /tmp for storage, /tmp here is just  
# example sakes. 
dataDir=/home/myuser/zooA/data 
# the port at which the clients will connect 
clientPort=2181 
# ZooKeeper server and its port no. # ZooKeeper ensemble should know about every other machine in the ensemble # specify server id by creating 'myid' file in the dataDir # use hostname instead of IP address for convenient maintenance  
server.1=127.0.0.1:2888:3888 
server.2=127.0.0.1:2988:3988  
server.3=127.0.0.1:2088:3088 

# Be sure to read the maintenance section of the  
# administrator guide before turning on autopurge. 

# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance 

# The number of snapshots to retain in dataDir 
#autopurge.snapRetainCount=3 
# Purge task interval in hours 
# Set to "0" to disable auto purge feature 
#autopurge.purgeInterval=1 
dataLogDir=/home/myuser/zooA/log 

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/home/myuser/zooA/data
# the port at which the clients will connect
clientPort=2181
# ZooKeeper server and its port no. # ZooKeeper ensemble should know about every other machine in the ensemble # specify server id by creating 'myid' file in the dataDir # use hostname instead of IP address for convenient maintenance
server.1=127.0.0.1:2888:3888
server.2=127.0.0.1:2988:3988
server.3=127.0.0.1:2088:3088
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
dataLogDir=/home/myuser/zooA/logtickTime:心跳时间,为了确保连接存在的,以毫秒为单位,最小超时时间为两个心跳时间
initLimit:多少个心跳时间内,允许其他server连接并初始化数据,如果ZooKeeper管理的数据较大,则应相应增大这个值
clientPort:服务的监听端口
dataDir:用于存放内存数据库快照的文件夹,同时用于集群的myid文件也存在这个文件夹里(注意:一个配置文件只能包含一个dataDir字样,即使它被注释掉了。)
dataLogDir:用于单独设置transaction log的目录,transaction log分离可以避免和普通log还有快照的竞争

syncLimit:多少个tickTime内,允许follower同步,如果follower落后太多,则会被丢弃。
(4)创建myid文件
[plain]
cd /home/myuser/zooA/data 
sudo sh -c 'echo "1" >> myid'   

cd /home/myuser/zooA/data
sudo sh -c 'echo "1" >> myid'  其他文件夹类似创建myid文件,zookeeperB为2,zookeeperC为3
(5)启动zookeeper
[plain]
cd /home/myuser/zookeeperA/bin 
sudo sh  zkServer.sh start 

cd /home/myuser/zookeeperA/bin
sudo sh  zkServer.sh start查看zookeeper状态[plain] view plaincopyprint?[root@weibo bin]# sh zkServer.sh status 
JMX enabled by default 
Using config: /home/weibo/zookeeperA/bin/../conf/zoo.cfg 
Mode: follower 

[root@weibo bin]# sh zkServer.sh status
JMX enabled by default
Using config: /home/weibo/zookeeperA/bin/../conf/zoo.cfg
Mode: follower启动OK,依次启动另外两台zookeeper,启动第一台zookeeper后,你可以观察bin下的zookeeper.out可以看到报错,connection refused,没有关系,zookeeper需要等待其他另个节点的加入,全部启动之后就正常了。
(6)客户端连接zookeeper
[plain]
[root@weibo bin]# sh zkCli.sh  
Connecting to localhost:2181 
2013-05-10 15:00:25,363 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT 
2013-05-10 15:00:25,369 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=localhost 
2013-05-10 15:00:25,370 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.6.0_33 
2013-05-10 15:00:25,371 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Sun Microsystems Inc. 
2013-05-10 15:00:25,372 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/home/weibo/jdk1.6.0_33/jre 
2013-05-10 15:00:25,373 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/home/weibo/zookeeperA/bin/../build/classes:/home/weibo/zookeeperA/bin/../build/lib/*.jar:/home/weibo/zookeeperA/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/weibo/zookeeperA/bin/../lib/slf4j-api-1.6.1.jar:/home/weibo/zookeeperA/bin/../lib/netty-3.2.2.Final.jar:/home/weibo/zookeeperA/bin/../lib/log4j-1.2.15.jar:/home/weibo/zookeeperA/bin/../lib/jline-0.9.94.jar:/home/weibo/zookeeperA/bin/../zookeeper-3.4.5.jar:/home/weibo/zookeeperA/bin/../src/java/lib/*.jar:/home/weibo/zookeeperA/bin/../conf:/home/weibo/jdk1.6.0_33/lib:. 
2013-05-10 15:00:25,373 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/home/weibo/jdk1.6.0_33/jre/lib/amd64/server:/home/weibo/jdk1.6.0_33/jre/lib/amd64:/home/weibo/jdk1.6.0_33/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 
2013-05-10 15:00:25,374 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 
2013-05-10 15:00:25,375 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA> 
2013-05-10 15:00:25,375 [myid:] - INFO  [main:Environ

补充:综合编程 , 其他综合 ,
Apache
IIS
Nginx
Tomcat
如果你遇到web 服务器难题:
请访问www.zzzyk.com 试试
CopyRight © 2012 站长网 编程知识问答 www.zzzyk.com All Rights Reserved
部份技术文章来自网络,