經過Cloudera Manager部署CDH5.15.1的webUI界面詳解

　　　　　　　　　　　　經過Cloudera Manager部署CDH5.15.1的webUI界面詳解

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　 　　做者：尹正傑

版權聲明：原創做品，謝絕轉載！不然將追究法律責任。

 

 

　　本篇博客CDH的部署徹底經過Cloudera Manager的webUI的安裝嚮導來完成的，關於CM的部署詳情請參考：http://www.javashuo.com/article/p-nktpvjqu-bz.html。

 

一.安裝CHD的服務

1>.CM的webUI界面默認的用戶名/密碼都是小寫的admin,咱們輸入用戶名和密碼進行登陸。操做以下：

2>.同一CM的協議，點擊繼續

 

3>.選擇CM的免費版本

 

4>.點擊繼續

 

5>.爲 CDH 羣集安裝指定主機

 

 

6>.選擇CDH本地版本（即咱們本身下載好的版本）

 

7>.CDH的默認存放路徑介紹

8>.當CDH安裝完畢後，點擊繼續

 

9>.等待檢查主機完成

 

 

10>.咱們能夠根據下面的提示去相應的服務器作具體的操做，作完操做後點擊「從新運行」以驗證你是否配置成功！

 

11>.解決告警信息後，點擊完成

[root@node101 ~]# xcall.sh date -R
============= node101.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:15 +0800
命令執行成功
============= node102.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:11 +0800
命令執行成功
============= node103.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:11 +0800
命令執行成功
[root@node101 ~]# 

驗證時區是否修改過來了（[root@node101 ~]# xcall.sh date -R）

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"
============= node101.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令執行成功
============= node102.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令執行成功
============= node103.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令執行成功
[root@node101 ~]# 
[root@node101 ~]# xcall.sh cat /proc/sys/vm/swappiness
============= node101.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令執行成功
============= node102.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令執行成功
============= node103.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令執行成功
[root@node101 ~]# 

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"
============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令執行成功
============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令執行成功
============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令執行成功
[root@node101 ~]# 
[root@node101 ~]# xcall.sh cat  /sys/kernel/mm/transparent_hugepage/defrag
============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令執行成功
============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令執行成功
============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令執行成功
[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"
============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令執行成功
============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令執行成功
============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令執行成功
[root@node101 ~]# 
[root@node101 ~]# xcall.sh "cat /sys/kernel/mm/transparent_hugepage/enabled"
============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令執行成功
============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令執行成功
============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令執行成功
[root@node101 ~]# 

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"

12>.自定義須要安裝的服務

 

13>.分配角色

 

 

14>.等待審覈

15>.集羣設置

 

16>.等待安裝完成

17>.完成安裝後，點擊繼續

 

18>.CDH部署成功界面

 

19>.進入CDH主界面

 二.驗證CHD服務是否可用

1>.驗證zookeeper是否能夠正常使用

[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn
Connecting to node101.yinzhengjie.org.cn
2018-09-15 11:26:03,624 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19 GMT
2018-09-15 11:26:03,628 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=node101.yinzhengjie.org.cn
2018-09-15 11:26:03,628 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_131
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/soft/jdk1.8.0_131/jre
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/root
2018-09-15 11:26:03,632 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=node101.yinzhengjie.org.cn sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@506c589e
Welcome to ZooKeeper!
2018-09-15 11:26:03,650 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@975] - Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2018-09-15 11:26:03,710 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@852] - Socket connection established, initiating session, client: /172.30.1.101:60205, server: node101.yinzhengjie.org.cn/172.30.1.101:2181
2018-09-15 11:26:03,720 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x265db13b97d0001, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: node101.yinzhengjie.org.cn(CONNECTED) 0] 

登陸zookeeper集羣（[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn Connecting to node101.yinzhengjie.org.cn）

[zk: node101.yinzhengjie.org.cn(CONNECTED) 0] ls /
[zookeeper]
[zk: node101.yinzhengjie.org.cn(CONNECTED) 1] quit
Quitting...
2018-09-15 11:27:09,798 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x265db13b97d0001 closed
2018-09-15 11:27:09,799 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@512] - EventThread shut down
You have new mail in /var/spool/mail/root
[root@node101 ~]# 
[root@node101 ~]# 

2>.查看hdfs目錄信息（注意權限，若是你想要往指定目錄寫數據的話，能夠指定ACL）

[root@node101 ~]# hdfs dfs -ls -R /
drwxrwxrwt   - hdfs supergroup          0 2018-09-15 11:06 /tmp
drwxrwxrwt   - mapred hadoop              0 2018-09-15 11:06 /tmp/logs
drwxr-xr-x   - hdfs   supergroup          0 2018-09-15 11:06 /user
drwxrwxrwx   - mapred hadoop              0 2018-09-15 11:06 /user/history
drwxrwx---   - mapred hadoop              0 2018-09-15 11:06 /user/history/done
ls: Permission denied: user=root, access=READ_EXECUTE, inode="/user/history/done":mapred:hadoop:drwxrwx---
drwxrwxrwt   - mapred hadoop              0 2018-09-15 11:06 /user/history/done_intermediate
[root@node101 ~]# 

3>.查看hdfs的webUI界面

 

 　　查看hdfs的界面以下，試試有種似曾相識的感腳？