Solr集羣（即SolrCloud）搭建與使用
一、什麼是SolrCloud
SolrCloud(solr 雲)是Solr提供的分佈式搜索方案，當你須要大規模，容錯，分佈式索引和檢索能力時使用 SolrCloud。
當一個系統的索引數據量少的時候是不須要使用SolrCloud的，當索引量很大，搜索請求併發很高，這時須要使用SolrCloud來知足這些需求。SolrCloud是基於Solr和Zookeeper的分佈式搜索方案，它的主要思想是使用Zookeeper做爲集羣的配置信息中心。
它有幾個特點功能：
1）集中式的配置信息。
2）自動容錯。
3）近實時搜索。
4）查詢時自動負載均衡。
注意：通常使用zookeeper，就是將他看成一個註冊中心使用。SolrCloud使用zookeeper是使用其的管理集羣的，請求過來，先鏈接zookeeper，而後再看看分發到那臺solr機器上面，決定了那臺服務器進行搜索的，對Solr配置文件進行集中管理。html
二、zookeeper是個什麼玩意？
顧名思義zookeeper就是動物園管理員，他是用來管hadoop（大象）、Hive(蜜蜂)、pig(小豬)的管理員， Apache Hbase和 Apache Solr 的分佈式集羣都用到了zookeeper；Zookeeper:是一個分佈式的、開源的程序協調服務，是hadoop項目下的一個子項目。java
三、SolrCloud結構
SolrCloud爲了下降單機的處理壓力，須要由多臺服務器共同來完成索引和搜索任務。實現的思路是將索引數據進行Shard（分片）拆分，每一個分片由多臺的服務器共同完成，當一個索引或搜索請求過來時會分別從不一樣的Shard的服務器中操做索引。
SolrCloud須要Solr基於Zookeeper部署，Zookeeper是一個集羣管理軟件，因爲SolrCloud須要由多臺服務器組成，由zookeeper來進行協調管理。
下圖是一個SolrCloud應用的例子：
web
對上圖進行圖解，以下圖所示：express
1 1）、物理結構 2 三個Solr實例（ 每一個實例包括兩個Core），組成一個SolrCloud。 3 2）、邏輯結構 4 索引集合包括兩個Shard（shard1和shard2），shard1和shard2分別由三個Core組成，其中一個Leader兩個Replication，Leader是由zookeeper選舉產生，zookeeper控制每一個shard上三個Core的索引數據一致，解決高可用問題。 5 用戶發起索引請求分別從shard1和shard2上獲取，解決高併發問題。 6 a、collection 7 Collection在SolrCloud集羣中是一個邏輯意義上的完整的索引結構。它經常被劃分爲一個或多個Shard（分片），它們使用相同的配置信息。 8 好比：針對商品信息搜索能夠建立一個collection。 9 collection=shard1+shard2+....+shardX 10 b、Core 11 每一個Core是Solr中一個獨立運行單位，提供 索引和搜索服務。一個shard須要由一個Core或多個Core組成。因爲collection由多個shard組成因此collection通常由多個core組成。 12 c、Master或Slave 13 Master是master-slave結構中的主結點（一般說主服務器），Slave是master-slave結構中的從結點（一般說從服務器或備服務器）。同一個Shard下master和slave存儲的數據是一致的，這是爲了達到高可用目的。 14 d、Shard 15 Collection的邏輯分片。每一個Shard被化成一個或者多個replication，經過選舉肯定哪一個是Leader。 16 注意：collection就是一個完整的索引庫，分片存儲，有兩片，兩片的內容不同的。一片存儲在三個節點，一主兩從，他們之間的內容就是同樣的。
以下圖所示：apache
四、SolrCloud搭建
本教程的這套安裝是單機版的安裝，因此採用僞集羣的方式進行安裝，若是是真正的生成環境，將僞集羣的ip改下就能夠了，步驟是同樣的。
SolrCloud結構圖以下：json
環境準備，請安裝好本身的jdk。 bootstrap
注意，我搭建的是僞集羣，一個虛擬機，分配了1G內存，而後搭建的集羣。vim
五、zookeeper集羣安裝。
第一步：解壓zookeeper，tar -zxvf zookeeper-3.4.6.tar.gz將zookeeper-3.4.6拷貝到/usr/local/solr-cloud下，複製三份分別並將目錄名改成zookeeper一、zookeeper二、zookeeper3。api
1 # 首先將zookeeper進行解壓縮操做。 2 [root@localhost package]# tar -zxvf zookeeper-3.4.6.tar.gz -C /home/hadoop/soft/ 3 # 而後建立一個solr-cloud目錄。 4 [root@localhost ~]# cd /usr/local/ 5 [root@localhost local]# ls 6 bin etc games include lib libexec sbin share solr src 7 [root@localhost local]# mkdir solr-cloud 8 [root@localhost local]# ls 9 bin etc games include lib libexec sbin share solr solr-cloud src 10 [root@localhost local]# 11 # 複製三份分別並將目錄名改成zookeeper一、zookeeper二、zookeeper3。 12 [root@localhost soft]# cp -r zookeeper-3.4.6/ /usr/local/solr-cloud/zookeeper1 13 [root@localhost soft]# cd /usr/local/solr-cloud/ 14 [root@localhost solr-cloud]# ls 15 zookeeper1 16 [root@localhost solr-cloud]# cp -r zookeeper1/ zookeeper2 17 [root@localhost solr-cloud]# cp -r zookeeper1/ zookeeper3
第二步：進入zookeeper1文件夾，建立data目錄。並在data目錄中建立一個myid文件內容爲"1"（echo 1 >> data/myid）。tomcat
1 [root@localhost solr-cloud]# ls 2 zookeeper1 zookeeper2 zookeeper3 3 [root@localhost solr-cloud]# cd zookeeper1 4 [root@localhost zookeeper1]# ls 5 bin CHANGES.txt contrib docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 6 build.xml conf dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 7 [root@localhost zookeeper1]# mkdir data 8 [root@localhost zookeeper1]# cd data/ 9 [root@localhost data]# ls 10 [root@localhost data]# echo 1 >> myid 11 [root@localhost data]# cat myid
第三步：進入conf文件夾，把zoo_sample.cfg更名爲zoo.cfg。
1 [root@localhost zookeeper1]# ls 2 bin CHANGES.txt contrib dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 3 build.xml conf data docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 4 [root@localhost zookeeper1]# cd conf/ 5 [root@localhost conf]# ls 6 configuration.xsl log4j.properties zoo_sample.cfg 7 [root@localhost conf]# mv zoo_sample.cfg zoo.cfg 8 [root@localhost conf]# ls 9 configuration.xsl log4j.properties zoo.cfg 10 [root@localhost conf]#
第四步：修改zoo.cfg。
修改：dataDir=/usr/local/solr-cloud/zookeeper1/data
注意：clientPort=2181（zookeeper2中爲218二、zookeeper3中爲2183）
能夠在末尾添加這三項配置（注意：2881和3881分別是zookeeper之間通訊的端口號、zookeeper之間選舉使用的端口號。2181是客戶端鏈接的端口號，別搞錯了哦）：
server.1=192.168.110.142:2881:3881
server.2=192.168.110.142:2882:3882
server.3=192.168.110.142:2883:3883
第五步：對zookeeper二、zookeeper3中的設置作第二步至第四步修改。
zookeeper2修改以下所示：
a）、myid內容爲2
b）、dataDir=/usr/local/solr-cloud/zookeeper2/data
c）、clientPort=2182
Zookeeper3修改以下所示：
a）、myid內容爲3
b）、dataDir=/usr/local/solr-cloud/zookeeper3/data
c）、clientPort=2183
1 [root@localhost conf]# cd ../../zookeeper2 2 [root@localhost zookeeper2]# ls 3 bin CHANGES.txt contrib docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 4 build.xml conf dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 5 [root@localhost zookeeper2]# mkdir data 6 [root@localhost zookeeper2]# cd data/ 7 [root@localhost data]# ls 8 [root@localhost data]# echo 2 >> myid 9 [root@localhost data]# ls 10 myid 11 [root@localhost data]# cat myid 12 2 13 [root@localhost data]# ls 14 myid 15 [root@localhost data]# cd .. 16 [root@localhost zookeeper2]# ls 17 bin CHANGES.txt contrib dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 18 build.xml conf data docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 19 [root@localhost zookeeper2]# cd conf/ 20 [root@localhost conf]# ls 21 configuration.xsl log4j.properties zoo_sample.cfg 22 [root@localhost conf]# mv zoo_sample.cfg zoo.cfg 23 [root@localhost conf]# ls 24 configuration.xsl log4j.properties zoo.cfg 25 [root@localhost conf]# vim zoo.cfg 26 [root@localhost conf]# cd ../.. 27 [root@localhost solr-cloud]# ls 28 zookeeper1 zookeeper2 zookeeper3 29 [root@localhost solr-cloud]# cd zookeeper3 30 [root@localhost zookeeper3]# ls 31 bin CHANGES.txt contrib docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 32 build.xml conf dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 33 [root@localhost zookeeper3]# mkdir data 34 [root@localhost zookeeper3]# ls 35 bin CHANGES.txt contrib dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 36 build.xml conf data docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 37 [root@localhost zookeeper3]# cd data/ 38 [root@localhost data]# ls 39 [root@localhost data]# echo 3 >> myid 40 [root@localhost data]# ls 41 myid 42 [root@localhost data]# cd ../.. 43 [root@localhost solr-cloud]# ls 44 zookeeper1 zookeeper2 zookeeper3 45 [root@localhost solr-cloud]# cd zookeeper3 46 [root@localhost zookeeper3]# ls 47 bin CHANGES.txt contrib dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 48 build.xml conf data docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 49 [root@localhost zookeeper3]# cd conf/ 50 [root@localhost conf]# ls 51 configuration.xsl log4j.properties zoo_sample.cfg 52 [root@localhost conf]# mv zoo_sample.cfg zoo.cfg 53 [root@localhost conf]# ls 54 configuration.xsl log4j.properties zoo.cfg 55 [root@localhost conf]# vim zoo.cfg 56 [root@localhost conf]#
第六步：啓動三個zookeeper。
/usr/local/solr-cloud/zookeeper1/bin/zkServer.sh start
/usr/local/solr-cloud/zookeeper2/bin/zkServer.sh start
/usr/local/solr-cloud/zookeeper3/bin/zkServer.sh start
查看集羣狀態：
/usr/local/solr-cloud/zookeeper1/bin/zkServer.sh status
/usr/local/solr-cloud/zookeeper2/bin/zkServer.sh status
/usr/local/solr-cloud/zookeeper3/bin/zkServer.sh status
1 [root@localhost ~]# /usr/local/solr-cloud/zookeeper1/bin/zkServer.sh start 2 JMX enabled by default 3 Using config: /usr/local/solr-cloud/zookeeper1/bin/../conf/zoo.cfg 4 Starting zookeeper ... STARTED 5 [root@localhost ~]# /usr/local/solr-cloud/zookeeper2/bin/zkServer.sh start 6 JMX enabled by default 7 Using config: /usr/local/solr-cloud/zookeeper2/bin/../conf/zoo.cfg 8 Starting zookeeper ... STARTED 9 [root@localhost ~]# /usr/local/solr-cloud/zookeeper3/bin/zkServer.sh start 10 JMX enabled by default 11 Using config: /usr/local/solr-cloud/zookeeper3/bin/../conf/zoo.cfg 12 Starting zookeeper ... STARTED 13 [root@localhost ~]# /usr/local/solr-cloud/zookeeper1/bin/zkServer.sh status 14 JMX enabled by default 15 Using config: /usr/local/solr-cloud/zookeeper1/bin/../conf/zoo.cfg 16 Mode: follower 17 [root@localhost ~]# /usr/local/solr-cloud/zookeeper2/bin/zkServer.sh status 18 JMX enabled by default 19 Using config: /usr/local/solr-cloud/zookeeper2/bin/../conf/zoo.cfg 20 Mode: leader 21 [root@localhost ~]# /usr/local/solr-cloud/zookeeper3/bin/zkServer.sh status 22 JMX enabled by default 23 Using config: /usr/local/solr-cloud/zookeeper3/bin/../conf/zoo.cfg 24 Mode: follower 25 [root@localhost ~]#
第七步：開啓zookeeper用到的端口，或者直接關閉防火牆。
service iptables stop
能夠編寫簡單的啓動腳本，以下所示：
1 [root@localhost solr-cloud]# vim start-zookeeper.sh 2 [root@localhost solr-cloud]# chmod u+x start-zookeeper.sh 3 [root@localhost solr-cloud]# ll 4 total 16 5 -rwxr--r--. 1 root root 133 Sep 13 18:32 start-zookeeper.sh 6 drwxr-xr-x. 11 root root 4096 Sep 13 02:13 zookeeper1 7 drwxr-xr-x. 11 root root 4096 Sep 13 02:35 zookeeper2 8 drwxr-xr-x. 11 root root 4096 Sep 13 02:37 zookeeper3 9 [root@localhost solr-cloud]#
查看啓動狀態的腳本信息以下所示：
六、tomcat安裝。 （注意：solrCloud部署依賴zookeeper，須要先啓動每一臺zookeeper服務器。）
注意：使用以前搭建好的solr單機版，這裏爲了節省時間，直接拷貝以前的solr單機版，而後修改配置文件便可。
http://www.javashuo.com/article/p-tfdeckvu-cp.html
第一步：將apache-tomcat-7.0.47.tar.gz解壓，tar -zxvf apache-tomcat-7.0.47.tar.gz。
1 [root@localhost solr-cloud]# tar -zxvf apache-tomcat-7.0.47.tar.gz
第二步：把解壓後的tomcat複製到/usr/local/solr-cloud/目錄下複製四份。
/usr/local/solr-cloud/tomcat1
/usr/local/solr-cloud/tomcat2
/usr/local/solr-cloud/tomcat3
/usr/local/solr-cloud/tomcat4
1 [root@localhost package]# cp -r apache-tomcat-7.0.47 /usr/local/solr-cloud/tomcat01 2 [root@localhost package]# cp -r apache-tomcat-7.0.47 /usr/local/solr-cloud/tomcat02 3 [root@localhost package]# cp -r apache-tomcat-7.0.47 /usr/local/solr-cloud/tomcat03 4 [root@localhost package]# cp -r apache-tomcat-7.0.47 /usr/local/solr-cloud/tomcat04 5 [root@localhost package]# cd /usr/local/solr-cloud/ 6 [root@localhost solr-cloud]# ls 7 start-zookeeper.sh status-zookeeper.sh stop-zookeeper.sh tomcat01 tomcat02 tomcat03 tomcat04 zookeeper1 zookeeper2 zookeeper3 8 [root@localhost solr-cloud]#
第三步：修改tomcat的server.xml，把其中的端口後都加一。保證兩個tomcat能夠正常運行不發生端口衝突。
[root@localhost solr-cloud]# vim tomcat01/conf/server.xml
[root@localhost solr-cloud]# vim tomcat02/conf/server.xml
[root@localhost solr-cloud]# vim tomcat03/conf/server.xml
[root@localhost solr-cloud]# vim tomcat04/conf/server.xml
tomcat01修改的端口分別是8005修改成8105，8080修改成8180，8009修改成8189。其餘tomcat第二位依次累加1便可。
1 <?xml version='1.0' encoding='utf-8'?> 2 <!-- 3 Licensed to the Apache Software Foundation (ASF) under one or more 4 contributor license agreements. See the NOTICE file distributed with 5 this work for additional information regarding copyright ownership. 6 The ASF licenses this file to You under the Apache License, Version 2.0 7 (the "License"); you may not use this file except in compliance with 8 the License. You may obtain a copy of the License at 9 10 http://www.apache.org/licenses/LICENSE-2.0 11 12 Unless required by applicable law or agreed to in writing, software 13 distributed under the License is distributed on an "AS IS" BASIS, 14 WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 15 See the License for the specific language governing permissions and 16 limitations under the License. 17 --> 18 <!-- Note: A "Server" is not itself a "Container", so you may not 19 define subcomponents such as "Valves" at this level. 20 Documentation at /docs/config/server.html 21 --> 22 <Server port="8105" shutdown="SHUTDOWN"> 23 <!-- Security listener. Documentation at /docs/config/listeners.html 24 <Listener className="org.apache.catalina.security.SecurityListener" /> 25 --> 26 <!--APR library loader. Documentation at /docs/apr.html --> 27 <Listener className="org.apache.catalina.core.AprLifecycleListener" SSLEngine="on" /> 28 <!--Initialize Jasper prior to webapps are loaded. Documentation at /docs/jasper-howto.html --> 29 <Listener className="org.apache.catalina.core.JasperListener" /> 30 <!-- Prevent memory leaks due to use of particular java/javax APIs--> 31 <Listener className="org.apache.catalina.core.JreMemoryLeakPreventionListener" /> 32 <Listener className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" /> 33 <Listener className="org.apache.catalina.core.ThreadLocalLeakPreventionListener" /> 34 35 <!-- Global JNDI resources 36 Documentation at /docs/jndi-resources-howto.html 37 --> 38 <GlobalNamingResources> 39 <!-- Editable user database that can also be used by 40 UserDatabaseRealm to authenticate users 41 --> 42 <Resource name="UserDatabase" auth="Container" 43 type="org.apache.catalina.UserDatabase" 44 description="User database that can be updated and saved" 45 factory="org.apache.catalina.users.MemoryUserDatabaseFactory" 46 pathname="conf/tomcat-users.xml" /> 47 </GlobalNamingResources> 48 49 <!-- A "Service" is a collection of one or more "Connectors" that share 50 a single "Container" Note: A "Service" is not itself a "Container", 51 so you may not define subcomponents such as "Valves" at this level. 52 Documentation at /docs/config/service.html 53 --> 54 <Service name="Catalina"> 55 56 <!--The connectors can use a shared executor, you can define one or more named thread pools--> 57 <!-- 58 <Executor name="tomcatThreadPool" namePrefix="catalina-exec-" 59 maxThreads="150" minSpareThreads="4"/> 60 --> 61 62 63 <!-- A "Connector" represents an endpoint by which requests are received 64 and responses are returned. Documentation at : 65 Java HTTP Connector: /docs/config/http.html (blocking & non-blocking) 66 Java AJP Connector: /docs/config/ajp.html 67 APR (HTTP/AJP) Connector: /docs/apr.html 68 Define a non-SSL HTTP/1.1 Connector on port 8080 69 --> 70 <Connector port="8180" protocol="HTTP/1.1" 71 connectionTimeout="20000" 72 redirectPort="8443" /> 73 <!-- A "Connector" using the shared thread pool--> 74 <!-- 75 <Connector executor="tomcatThreadPool" 76 port="8080" protocol="HTTP/1.1" 77 connectionTimeout="20000" 78 redirectPort="8443" /> 79 --> 80 <!-- Define a SSL HTTP/1.1 Connector on port 8443 81 This connector uses the JSSE configuration, when using APR, the 82 connector should be using the OpenSSL style configuration 83 described in the APR documentation --> 84 <!-- 85 <Connector port="8443" protocol="HTTP/1.1" SSLEnabled="true" 86 maxThreads="150" scheme="https" secure="true" 87 clientAuth="false" sslProtocol="TLS" /> 88 --> 89 90 <!-- Define an AJP 1.3 Connector on port 8009 --> 91 <Connector port="8109" protocol="AJP/1.3" redirectPort="8443" /> 92 93 94 <!-- An Engine represents the entry point (within Catalina) that processes 95 every request. The Engine implementation for Tomcat stand alone 96 analyzes the HTTP headers included with the request, and passes them 97 on to the appropriate Host (virtual host). 98 Documentation at /docs/config/engine.html --> 99 100 <!-- You should set jvmRoute to support load-balancing via AJP ie : 101 <Engine name="Catalina" defaultHost="localhost" jvmRoute="jvm1"> 102 --> 103 <Engine name="Catalina" defaultHost="localhost"> 104 105 <!--For clustering, please take a look at documentation at: 106 /docs/cluster-howto.html (simple how to) 107 /docs/config/cluster.html (reference documentation) --> 108 <!-- 109 <Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"/> 110 --> 111 112 <!-- Use the LockOutRealm to prevent attempts to guess user passwords 113 via a brute-force attack --> 114 <Realm className="org.apache.catalina.realm.LockOutRealm"> 115 <!-- This Realm uses the UserDatabase configured in the global JNDI 116 resources under the key "UserDatabase". Any edits 117 that are performed against this UserDatabase are immediately 118 available for use by the Realm. --> 119 <Realm className="org.apache.catalina.realm.UserDatabaseRealm" 120 resourceName="UserDatabase"/> 121 </Realm> 122 123 <Host name="localhost" appBase="webapps" 124 unpackWARs="true" autoDeploy="true"> 125 126 <!-- SingleSignOn valve, share authentication between web applications 127 Documentation at: /docs/config/valve.html --> 128 <!-- 129 <Valve className="org.apache.catalina.authenticator.SingleSignOn" /> 130 --> 131 132 <!-- Access log processes all example. 133 Documentation at: /docs/config/valve.html 134 Note: The pattern used is equivalent to using pattern="common" --> 135 <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs" 136 prefix="localhost_access_log." suffix=".txt" 137 pattern="%h %l %u %t "%r" %s %b" /> 138 139 </Host> 140 </Engine> 141 </Service> 142 </Server>
tomcat01修改的端口分別是8005修改成8105，8080修改成8180，8009修改成8189。其餘tomcat第二位依次累加1便可。
七、開始部署solr。將以前的solr部署到四臺tomcat下面。
1 [root@localhost solr-cloud]# cp -r ../solr/tomcat/webapps/solr-4.10.3 tomcat01/webapps/ 2 [root@localhost solr-cloud]# cp -r ../solr/tomcat/webapps/solr-4.10.3 tomcat02/webapps/ 3 [root@localhost solr-cloud]# cp -r ../solr/tomcat/webapps/solr-4.10.3 tomcat03/webapps/ 4 [root@localhost solr-cloud]# cp -r ../solr/tomcat/webapps/solr-4.10.3 tomcat04/webapps/
而後將單機版的solrhome複製四份，分別是solrhome01，solrhome02，solrhome03，solrhome04。
1 [root@localhost solr-cloud]# cp -r ../solr/solrhome/ solrhome01 2 [root@localhost solr-cloud]# cp -r ../solr/solrhome/ solrhome02 3 [root@localhost solr-cloud]# cp -r ../solr/solrhome/ solrhome03 4 [root@localhost solr-cloud]# cp -r ../solr/solrhome/ solrhome04 5 [root@localhost solr-cloud]# ls 6 solrhome01 solrhome02 solrhome03 solrhome04 start-zookeeper.sh status-zookeeper.sh stop-zookeeper.sh tomcat01 tomcat02 tomcat03 tomcat04 zookeeper1 zookeeper2 zookeeper3 7 [root@localhost solr-cloud]#
而後開始編輯solrhome01，solrhome02，solrhome03，solrhome04。下面的solr.xml配置文件（修改每一個solrhome的solr.xml文件）。讓tomcat01和solrhome01對應上，其餘依次類推，讓tomcat02和solrhome02對應上，讓tomcat03和solrhome03對應上，讓tomcat04和solrhome04對應上。
而後將solr和solrhome之間創建關係。
1 [root@localhost solr-cloud]# vim tomcat01/webapps/solr-4.10.3/WEB-INF/web.xml 2 [root@localhost solr-cloud]# vim tomcat02/webapps/solr-4.10.3/WEB-INF/web.xml 3 [root@localhost solr-cloud]# vim tomcat03/webapps/solr-4.10.3/WEB-INF/web.xml 4 [root@localhost solr-cloud]# vim tomcat04/webapps/solr-4.10.3/WEB-INF/web.xml
以下圖所示：
而後將tomcat和zookeeper創建關係。每一臺solr和zookeeper關聯。
修改每個tomcat的bin目錄下catalina.sh文件中加入DzkHost指定zookeeper服務器地址： JAVA_OPTS="-DzkHost=192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183"
注意：可使用vim的查找功能查找到JAVA_OPTS的定義的位置，而後添加。
1 [root@localhost solr-cloud]# vim tomcat01/bin/catalina.sh 2 [root@localhost solr-cloud]# vim tomcat02/bin/catalina.sh 3 [root@localhost solr-cloud]# vim tomcat03/bin/catalina.sh 4 [root@localhost solr-cloud]# vim tomcat04/bin/catalina.sh
如今，每一個部署在tomcat下面的solr都有本身的獨立的solrhome。在solr集羣環境下， solrhome下面的配置文件應該只有一份，因此這裏將配置文件上傳到zookeeper，讓zookeeper進行管理配置文件。將solrhome下面的conf目錄上傳到zookeeper。使用solr自帶的工具執行，將cong目錄上傳到zookeeper。
注意：因爲zookeeper統一管理solr的配置文件（主要是schema.xml、solrconfig.xml）， solrCloud各各節點使用zookeeper管理的配置文件。./zkcli.sh此命令在solr-4.10.3/example/scripts/cloud-scripts/目錄下。
1 [root@localhost solrhome01]# cd /home/hadoop/soft/ 2 [root@localhost soft]# ls 3 apache-tomcat-7.0.47 jdk1.7.0_55 solr-4.10.3 zookeeper-3.4.6 4 [root@localhost soft]# cd solr-4.10.3/ 5 [root@localhost solr-4.10.3]# ls 6 bin CHANGES.txt contrib dist docs example licenses LICENSE.txt LUCENE_CHANGES.txt NOTICE.txt README.txt SYSTEM_REQUIREMENTS.txt 7 [root@localhost solr-4.10.3]# cd example/ 8 [root@localhost example]# ls 9 contexts etc example-DIH exampledocs example-schemaless lib logs multicore README.txt resources scripts solr solr-webapp start.jar webapps 10 [root@localhost example]# cd scripts/ 11 [root@localhost scripts]# ls 12 cloud-scripts map-reduce 13 [root@localhost scripts]# cd cloud-scripts/ 14 [root@localhost cloud-scripts]# ls 15 log4j.properties zkcli.bat zkcli.sh 16 [root@localhost cloud-scripts]# ./zkcli.sh -zkhost 192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183 -cmd upconfig -confdir /usr/local/solr-cloud/solrhome01/collection1/conf -confname myconf
而後登錄zookeeper服務器查詢配置文件，查看是否上傳成功。上傳成功之後全部節點共用這一份配置文件的。
1 [root@localhost cloud-scripts]# cd /usr/local/solr-cloud/ 2 [root@localhost solr-cloud]# ls 3 solrhome01 solrhome02 solrhome03 solrhome04 start-zookeeper.sh status-zookeeper.sh stop-zookeeper.sh tomcat01 tomcat02 tomcat03 tomcat04 zookeeper1 zookeeper2 zookeeper3 4 [root@localhost solr-cloud]# cd zookeeper1/ 5 [root@localhost zookeeper1]# ls 6 bin CHANGES.txt contrib dist-maven ivysettings.xml lib NOTICE.txt README.txt src zookeeper-3.4.6.jar.asc zookeeper-3.4.6.jar.sha1 7 build.xml conf data docs ivy.xml LICENSE.txt README_packaging.txt recipes zookeeper-3.4.6.jar zookeeper-3.4.6.jar.md5 zookeeper.out 8 [root@localhost zookeeper1]# cd bin/ 9 [root@localhost bin]# ls 10 README.txt zkCleanup.sh zkCli.cmd zkCli.sh zkEnv.cmd zkEnv.sh zkServer.cmd zkServer.sh 11 [root@localhost bin]# ./zkCli.sh 12 Connecting to localhost:2181 13 2019-09-13 20:06:46,748 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 14 2019-09-13 20:06:46,756 [myid:] - INFO [main:Environment@100] - Client environment:host.name=localhost 15 2019-09-13 20:06:46,757 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.7.0_55 16 2019-09-13 20:06:46,776 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation 17 2019-09-13 20:06:46,776 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/home/hadoop/soft/jdk1.7.0_55/jre 18 2019-09-13 20:06:46,776 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/usr/local/solr-cloud/zookeeper1/bin/../build/classes:/usr/local/solr-cloud/zookeeper1/bin/../build/lib/*.jar:/usr/local/solr-cloud/zookeeper1/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/solr-cloud/zookeeper1/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/solr-cloud/zookeeper1/bin/../lib/netty-3.7.0.Final.jar:/usr/local/solr-cloud/zookeeper1/bin/../lib/log4j-1.2.16.jar:/usr/local/solr-cloud/zookeeper1/bin/../lib/jline-0.9.94.jar:/usr/local/solr-cloud/zookeeper1/bin/../zookeeper-3.4.6.jar:/usr/local/solr-cloud/zookeeper1/bin/../src/java/lib/*.jar:/usr/local/solr-cloud/zookeeper1/bin/../conf: 19 2019-09-13 20:06:46,776 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib 20 2019-09-13 20:06:46,777 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 21 2019-09-13 20:06:46,782 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA> 22 2019-09-13 20:06:46,783 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux 23 2019-09-13 20:06:46,798 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=i386 24 2019-09-13 20:06:46,798 [myid:] - INFO [main:Environment@100] - Client environment:os.version=2.6.32-358.el6.i686 25 2019-09-13 20:06:46,798 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root 26 2019-09-13 20:06:46,798 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root 27 2019-09-13 20:06:46,798 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/usr/local/solr-cloud/zookeeper1/bin 28 2019-09-13 20:06:46,803 [myid:] - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@932892 29 Welcome to ZooKeeper! 30 2019-09-13 20:06:46,983 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 31 JLine support is enabled 32 2019-09-13 20:06:47,071 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 33 2019-09-13 20:06:47,163 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x16d2d6bfd280001, negotiated timeout = 30000 34 35 WATCHER:: 36 37 WatchedEvent state:SyncConnected type:None path:null 38 [zk: localhost:2181(CONNECTED) 0] ls / 39 [configs, zookeeper] 40 [zk: localhost:2181(CONNECTED) 1] ls /configs 41 [myconf] 42 [zk: localhost:2181(CONNECTED) 2] ls /configs/myconf 43 [admin-extra.menu-top.html, currency.xml, protwords.txt, mapping-FoldToASCII.txt, _schema_analysis_synonyms_english.json, _rest_managed.json, solrconfig.xml, _schema_analysis_stopwords_english.json, stopwords.txt, lang, spellings.txt, mapping-ISOLatin1Accent.txt, admin-extra.html, xslt, scripts.conf, synonyms.txt, update-script.js, velocity, elevate.xml, admin-extra.menu-bottom.html, schema.xml, clustering]
而後將全部的tomcat啓動便可。而後也寫一個批處理啓動tomcat的腳本。
1 [root@localhost solr-cloud]# vim start-tomcat.sh 2 [root@localhost solr-cloud]# ls 3 solrhome01 solrhome02 solrhome03 solrhome04 start-tomcat.sh start-zookeeper.sh status-zookeeper.sh stop-zookeeper.sh tomcat01 tomcat02 tomcat03 tomcat04 zookeeper1 zookeeper2 zookeeper3 4 [root@localhost solr-cloud]# chmod u+x start-tomcat.sh 5 [root@localhost solr-cloud]#
以下圖所示：
而後啓動你的腳本文件：
1 [root@localhost solr-cloud]# ./start-tomcat.sh 2 Using CATALINA_BASE: /usr/local/solr-cloud/tomcat01 3 Using CATALINA_HOME: /usr/local/solr-cloud/tomcat01 4 Using CATALINA_TMPDIR: /usr/local/solr-cloud/tomcat01/temp 5 Using JRE_HOME: /home/hadoop/soft/jdk1.7.0_55 6 Using CLASSPATH: /usr/local/solr-cloud/tomcat01/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat01/bin/tomcat-juli.jar 7 Using CATALINA_BASE: /usr/local/solr-cloud/tomcat02 8 Using CATALINA_HOME: /usr/local/solr-cloud/tomcat02 9 Using CATALINA_TMPDIR: /usr/local/solr-cloud/tomcat02/temp 10 Using JRE_HOME: /home/hadoop/soft/jdk1.7.0_55 11 Using CLASSPATH: /usr/local/solr-cloud/tomcat02/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat02/bin/tomcat-juli.jar 12 Using CATALINA_BASE: /usr/local/solr-cloud/tomcat03 13 Using CATALINA_HOME: /usr/local/solr-cloud/tomcat03 14 Using CATALINA_TMPDIR: /usr/local/solr-cloud/tomcat03/temp 15 Using JRE_HOME: /home/hadoop/soft/jdk1.7.0_55 16 Using CLASSPATH: /usr/local/solr-cloud/tomcat03/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat03/bin/tomcat-juli.jar 17 Using CATALINA_BASE: /usr/local/solr-cloud/tomcat04 18 Using CATALINA_HOME: /usr/local/solr-cloud/tomcat04 19 Using CATALINA_TMPDIR: /usr/local/solr-cloud/tomcat04/temp 20 Using JRE_HOME: /home/hadoop/soft/jdk1.7.0_55 21 Using CLASSPATH: /usr/local/solr-cloud/tomcat04/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat04/bin/tomcat-juli.jar
而後查看啓動的情況，以下所示：
1 [root@localhost solr-cloud]# jps 2 3628 Bootstrap 3 3641 Bootstrap 4 3714 Jps 5 3026 QuorumPeerMain 6 3058 QuorumPeerMain 7 2999 QuorumPeerMain 8 3618 Bootstrap 9 3654 Bootstrap 10 [root@localhost solr-cloud]# ps -aux | grep tomcat 11 Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.8/FAQ 12 root 3618 14.3 10.0 403096 104072 pts/0 Sl 20:18 0:14 /home/hadoop/soft/jdk1.7.0_55/bin/java -Djava.util.logging.config.file=/usr/local/solr-cloud/tomcat01/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -DzkHost=192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183 -Djava.endorsed.dirs=/usr/local/solr-cloud/tomcat01/endorsed -classpath /usr/local/solr-cloud/tomcat01/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat01/bin/tomcat-juli.jar -Dcatalina.base=/usr/local/solr-cloud/tomcat01 -Dcatalina.home=/usr/local/solr-cloud/tomcat01 -Djava.io.tmpdir=/usr/local/solr-cloud/tomcat01/temp org.apache.catalina.startup.Bootstrap start 13 root 3628 14.3 10.2 403652 105664 pts/0 Sl 20:18 0:14 /home/hadoop/soft/jdk1.7.0_55/bin/java -Djava.util.logging.config.file=/usr/local/solr-cloud/tomcat02/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -DzkHost=192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183 -Djava.endorsed.dirs=/usr/local/solr-cloud/tomcat02/endorsed -classpath /usr/local/solr-cloud/tomcat02/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat02/bin/tomcat-juli.jar -Dcatalina.base=/usr/local/solr-cloud/tomcat02 -Dcatalina.home=/usr/local/solr-cloud/tomcat02 -Djava.io.tmpdir=/usr/local/solr-cloud/tomcat02/temp org.apache.catalina.startup.Bootstrap start 14 root 3641 14.5 10.4 406084 107252 pts/0 Sl 20:18 0:14 /home/hadoop/soft/jdk1.7.0_55/bin/java -Djava.util.logging.config.file=/usr/local/solr-cloud/tomcat03/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -DzkHost=192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183 -Djava.endorsed.dirs=/usr/local/solr-cloud/tomcat03/endorsed -classpath /usr/local/solr-cloud/tomcat03/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat03/bin/tomcat-juli.jar -Dcatalina.base=/usr/local/solr-cloud/tomcat03 -Dcatalina.home=/usr/local/solr-cloud/tomcat03 -Djava.io.tmpdir=/usr/local/solr-cloud/tomcat03/temp org.apache.catalina.startup.Bootstrap start 15 root 3654 14.8 10.6 405740 109760 pts/0 Sl 20:18 0:14 /home/hadoop/soft/jdk1.7.0_55/bin/java -Djava.util.logging.config.file=/usr/local/solr-cloud/tomcat04/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -DzkHost=192.168.110.142:2181,192.168.110.142:2182,192.168.110.142:2183 -Djava.endorsed.dirs=/usr/local/solr-cloud/tomcat04/endorsed -classpath /usr/local/solr-cloud/tomcat04/bin/bootstrap.jar:/usr/local/solr-cloud/tomcat04/bin/tomcat-juli.jar -Dcatalina.base=/usr/local/solr-cloud/tomcat04 -Dcatalina.home=/usr/local/solr-cloud/tomcat04 -Djava.io.tmpdir=/usr/local/solr-cloud/tomcat04/temp org.apache.catalina.startup.Bootstrap start 16 root 3808 0.0 0.0 4356 732 pts/0 S+ 20:20 0:00 grep tomcat 17 [root@localhost solr-cloud]#
啓動之後能夠訪問一下，看看啓動的情況。你能夠能夠查看啓動日誌的。個人這個應該是沒有啓動成功的。而後檢查一下緣由。
上圖中的collection1集羣只有一片，能夠經過下邊的方法配置新的集羣。
若是集羣中有四個solr節點建立新集羣collection2，將集羣分爲兩片，每片兩個副本。
作到這裏報了一堆莫名奇妙的錯誤，百度了好久，沒有找到具體緣由，就是起不來，多是分配1G的內存過小了，我調到1.5G內存，而後將單機版solr，集羣版solr，所有刪除了，而後從新搭建，才成功了。以下圖所示，這玩意，仍是建議多研究，搭建的時候仔細點，否則一不當心就錯了。
這內存顯示都快使用完了，分配的1.5G內存，那以前的1G內存確定是不夠用了。
網絡圖以下所示：
注意：訪問任意一臺solr，左側菜單出現Cloud。
上圖中的collection1集羣只有一片，能夠經過下邊的方法配置新的集羣。
建立collection的命令以下所示（注意：若是集羣中有四個solr節點建立新集羣collection2，將集羣分爲兩片，每片兩個副本）：
http://192.168.110.142:8180/solr/admin/collections?action=CREATE&name=collection2&numShards=2&replicationFactor=2
刷新頁面以下所示：
建立成功之後，就是一個collection分紅了兩片，一主一備（192.168.110.142:8180、192.168.110.142:8280，依次類比便可）。
刪除collection的命令以下所示：http://192.168.110.142:8180/solr/admin/collections?action=DELETE&name=collection1
那麼以前的collection1能夠刪除或者本身留着也行的。
提示tips：啓動solrCloud注意，啓動solrCloud須要先啓動solrCloud依賴的全部zookeeper服務器，再啓動每臺solr服務器。
待續......
相關文章
- 1. Solr集羣搭建——SolrCloud
- 2. solr集羣SolrCloud
- 3. Solr集羣—SolrCloud
- 4. solrCloud集羣搭建（solr-6.5.1，zookeeper-3.4.10）
- 5. solr學習(6.1)solrcloud集羣的搭建
- 6. solrcloud集羣搭建
- 7. SolrCloud集羣搭建
- 8. solrCloud 集羣搭建
- 9. solrCloud集羣搭建
- 10. solr集羣solrCloud的搭建 zookeeper集羣的安裝
- 更多相關文章...
- • Swarm 集羣管理 - Docker教程
- • Swift 環境搭建 - Swift 教程
- • Composer 安裝與使用
- • Java Agent入門實戰（一）-Instrumentation介紹與使用
相關標籤/搜索
每日一句
-
每一个你不满意的现在，都有一个你没有努力的曾经。
歡迎關注本站公眾號,獲取更多信息
