Cloudera Manager安裝之利用parcels方式安裝3或4節點集羣（包含最新穩定版本或指定版本的安裝）（添加服務）（CentOS6.5）（五）

時間  2019-11-17
標籤 cloudera manager 安裝 利用 parcels 方式 節點 集羣 包含 最新 穩定 版本 指定 添加 服務 centos6.5 centos 欄目 雲服務 简体版
原文   原文鏈接

 

參考博客html

Cloudera Manager安裝之利用parcels方式安裝單節點集羣

 Cloudera Manager安裝之Cloudera Manager 5.3.X安裝（三）（tar方式、rpm方式和yum方式）java

 

 

 

 　　ClouderManager官網的安裝歷史穩定版node

https://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Installation-Guide/cm5ig_install_older_cm5.html

 

 

 

 

 

說在前面的話（看清楚就好！！！）python

　　 我這篇博客，是兩種方式都使用過：（在/etc/yum.repos.d下的）mysql

[hadoop@clouderamanager01 yum.repos.d]$ sudo vi cloudera-manager.repo
[hadoop@clouderamanager02 yum.repos.d]$ sudo vi cloudera-manager.repo
[hadoop@clouderamanager03 yum.repos.d]$ sudo vi cloudera-manager.repo

 

即（博主我推薦用這種！！！）（可是不需）jquery

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 1

 

 

 

 

或者（可是，須要自定義存儲庫）sql

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled = 1
gpgcheck = 1

 

 

 

 

 

 

 

 

 

 

 

 

 

 

　　我這裏是，使用CM 5.3.x利用parcels方式集羣安裝CDH 5.3.x的3節點集羣！（開始開工）shell

 

 

 

 

 

下載如下三個文件就好：
 
http://archive.cloudera.com/cdh5/parcels/5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel http://archive.cloudera.com/cdh5/parcels/5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 http://archive.cloudera.com/cdh5/parcels/5.3.6/manifest.json

 

 

 

 

 

 

 

 

　　如下是clouderamanager01這臺機器上（主節點）數據庫

 

複製代碼 
[hadoop@clouderaManager01 softwares]$ pwd
/opt/softwares [hadoop@clouderaManager01 softwares]$ ll total 4 drwxr-xr-x 2 hadoop hadoop 4096 Apr 8 13:49 cm-5.3.6 [hadoop@clouderaManager01 softwares]$ sudo mkdir cdh-5.3.6 [hadoop@clouderaManager01 softwares]$ ll total 8 drwxr-xr-x 2 root root 4096 Apr 8 20:00 cdh-5.3.6 drwxr-xr-x 2 hadoop hadoop 4096 Apr 8 13:49 cm-5.3.6 [hadoop@clouderaManager01 softwares]$ cd cdh-5.3.6/ [hadoop@clouderaManager01 cdh-5.3.6]$ pwd /opt/softwares/cdh-5.3.6 [hadoop@clouderaManager01 cdh-5.3.6]$ ll total 0 [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ ll total 1473900 -rw-r--r-- 1 root root 1509217191 Apr 7 19:38 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html -rw-r--r-- 1 root root 41 Apr 7 19:24 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 -rw-r--r-- 1 root root 42661 Apr 7 19:24 manifest.json [hadoop@clouderaManager01 cdh-5.3.6]$
複製代碼

 

 

 

 

 

 　　如下是clouderamanager01這臺機器上安裝以後，默認產生的（在這裏，你看看就好）express

複製代碼 
[hadoop@clouderaManager01 opt]$ pwd
/opt [hadoop@clouderaManager01 opt]$ ll total 16 drwxr-xr-x 4 cloudera-scm cloudera-scm 4096 Apr 8 18:31 cloudera drwxr-xr-x 2 root root 4096 Apr 8 18:13 cloudera-manager drwxr-xr-x. 2 root root 4096 Nov 22 2013 rh drwxr-xr-x 4 hadoop hadoop 4096 Apr 8 20:00 softwares [hadoop@clouderaManager01 opt]$ cd cloudera [hadoop@clouderaManager01 cloudera]$ ll total 8 drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Jul 30 2015 csd drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Jul 30 2015 parcel-repo [hadoop@clouderaManager01 cloudera]$ cd parcel-repo/ [hadoop@clouderaManager01 parcel-repo]$ pwd /opt/cloudera/parcel-repo [hadoop@clouderaManager01 parcel-repo]$ ll total 0 [hadoop@clouderaManager01 parcel-repo]$
複製代碼
 

 

 

 

 　　或者，有時候，安裝CM完成後，出現：

如下是clouderamanager01這臺機器上安裝以後，默認產生的（在這裏，你看看就好）

 

[hadoop@clouderamanager01 opt]$ pwd
/opt
[hadoop@clouderamanager01 opt]$ ll
total 8
drwxr-xr-x  4 cloudera-scm cloudera-scm 4096 Apr  8 22:48 cloudera
drwxr-xr-x. 3 hadoop       hadoop       4096 Apr  8 11:20 softwares
[hadoop@clouderamanager01 opt]$ cd cloudera/
[hadoop@clouderamanager01 cloudera]$ ll
total 8
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 parcel-repo
[hadoop@clouderamanager01 cloudera]$

 

 

 

 

 

 

 

 

 　　上傳咱們剛以前下載好的CDH離線包

[hadoop@clouderamanager01 softwares]$ pwd
/opt/softwares
[hadoop@clouderamanager01 softwares]$ ll
total 4
drwxr-xr-x. 2 hadoop hadoop 4096 Apr  8 11:20 cm-5.3.6
[hadoop@clouderamanager01 softwares]$ sudo mkdir cdh-5.3.6
[hadoop@clouderamanager01 softwares]$ ll
total 8
drwxr-xr-x  2 root   root   4096 Apr  8 23:04 cdh-5.3.6
drwxr-xr-x. 2 hadoop hadoop 4096 Apr  8 11:20 cm-5.3.6
[hadoop@clouderamanager01 softwares]$ cd cdh-5.3.6/
[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 0
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$

 　　注意，是，CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel。而不是CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html，也不是CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.parcel！！！（這個離線包很容易在下載的時候，本身出現後綴的變名。）（如果你下載的時候，沒出現變名是更好啦！）

 

 　　

 

 

 

 

 　　須要改CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1的名稱和CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html的名稱

 

[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo mv CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo mv CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$

　　必定要改爲，CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel和CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha。

 

 

 

 

 

 　　

 

[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ more CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
9b0c758c15792be3d7da7597b376668c09a32e2d
[hadoop@clouderamanager01 cdh-5.3.6]$

 

 

 

 

 

 

 

 

　　　　查看manifest.json

http://archive.cloudera.com/cdh5/parcels/5.3.6/manifest.json

 

 

 

 

 

 

　　在clouderamanager02和clouderamanager03機器上，進入/etc/yum.repos.d/

 

[hadoop@clouderamanager02 ~]$ cd /etc/yum.repos.d/
[hadoop@clouderamanager02 yum.repos.d]$ pwd
/etc/yum.repos.d
[hadoop@clouderamanager02 yum.repos.d]$ ll
total 16
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
[hadoop@clouderamanager02 yum.repos.d]$ sudo vi cloudera-manager.repo

 

 

 

 

[cloudera-manager]
name=Cloudera Manager baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/ gpgcheck=0

 

 或者

[cloudera-manager]
name=Cloudera Manager
baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgcheck=1

 　　同理，機器clouderamanager03也要去作。

 

 

 

 

 

 

 

 

 

 

關於/opt/cloudera/parcel-repo和/opt/cloudera/parcel（必須弄懂，別怕）

　　192.168.80.148   clouderamanager01　 （部署ClouderaManager-server和Mirror server）  （部署Agent） 　　　　（分配1G，我這裏只是體驗過程，固然你能夠分配更多或更小)　

　　192.168.80.149   clouderamanager02    （部署Agent）　　　　　　　　　　　　　　　　　　　　　 （分配1G，我這裏只是體驗過程，固然你能夠分配更多或更小)

　　192.168.80.150   clouderamanager03   （部署Agent）

 

　　部署ClouderaManager-server和Mirror server的機器，默認是存儲在/opt/cloudera/parcel-repo。

　　部署Agent的機器，默認是存儲在/opt/cloudera/parcel。

 

 

 　　即，這也是爲何，我在下面這篇博客裏寫到。

Cloudera Manager安裝之Cloudera Manager 5.3.X安裝（三）（tar方式、rpm方式和yum方式）

　　博客裏，說起到的tar方式來安裝。

 

　　

 

 

 

　　

 

 

 

 

 

 

 

 

 

 

 

 

 

 　　進入，CM安裝的機器，自動生成的默認/opt/cloudera/parcel-repo目錄下（在clouderamanager01主節點）

[hadoop@clouderamanager01 opt]$ pwd
/opt
[hadoop@clouderamanager01 opt]$ ll
total 8
drwxr-xr-x  4 cloudera-scm cloudera-scm 4096 Apr  8 22:48 cloudera
drwxr-xr-x. 4 hadoop       hadoop       4096 Apr  8 23:04 softwares
[hadoop@clouderamanager01 opt]$ cd cloudera/
[hadoop@clouderamanager01 cloudera]$ pwd
/opt/cloudera
[hadoop@clouderamanager01 cloudera]$ ll
total 8
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 parcel-repo
[hadoop@clouderamanager01 cloudera]$ cd parcel-repo/
[hadoop@clouderamanager01 parcel-repo]$ pwd
/opt/cloudera/parcel-repo
[hadoop@clouderamanager01 parcel-repo]$ ll
total 0
[hadoop@clouderamanager01 parcel-repo]$

 

 

 

 

 

 　　將咱們以前上傳在/opt/softwares/cdh-5.3.6（其實這個用做爲備份，萬一之後丟失了再能夠從新安裝。省得再下載）的CDH離線安裝包，

移動到這個/opt/cloudera/parcel-repo目錄上去。

 

[hadoop@clouderamanager01 parcel-repo]$ pwd
/opt/cloudera/parcel-repo
[hadoop@clouderamanager01 parcel-repo]$ ll
total 0
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel .
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha .
[hadoop@clouderamanager01 parcel-repo]$ ll
total 1473856
-rw-r--r-- 1 root root 1509217191 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/manifest.json .
[hadoop@clouderamanager01 parcel-repo]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 23:35 manifest.json
[hadoop@clouderamanager01 parcel-repo]$

 

 

 

 

 

 

 

[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server status
cloudera-scm-server (pid  1888) is running...
[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server restart
Stopping cloudera-scm-server:                              [  OK  ]
Starting cloudera-scm-server:                              [  OK  ]
[hadoop@clouderamanager01 parcel-repo]$

 　　等上幾分鐘，

 

 

 

 

 

 

 

 　　若是Clouder Manager的7180端口，沒起來，怎麼辦？

[hadoop@clouderamanager01 parcel-repo]$  sudo netstat -tnlp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address               Foreign Address             State       PID/Program name   
tcp        0      0 0.0.0.0:22                  0.0.0.0:*                   LISTEN      901/sshd            
tcp        0      0 127.0.0.1:25                0.0.0.0:*                   LISTEN      985/master          
tcp        0      0 0.0.0.0:7432                0.0.0.0:*                   LISTEN      1850/postgres       
tcp        0      0 :::80                       :::*                        LISTEN      995/httpd           
tcp        0      0 :::22                       :::*                        LISTEN      901/sshd            
tcp        0      0 ::1:25                      :::*                        LISTEN      985/master          
tcp        0      0 :::7432                     :::*                        LISTEN      1850/postgres       
[hadoop@clouderamanager01 parcel-repo]$ sudo reboot

Broadcast message from hadoop@clouderamanager01
    (/dev/pts/0) at 23:45 ...

The system is going down for reboot NOW!
[hadoop@clouderamanager01 parcel-repo]$ 
Connection closed by foreign host.

Disconnected from remote host(clouderamanager01) at 15:46:15.

Type `help' to learn how to use Xshell prompt.

 

 

　　或者

　　改成本地的，進入/etc/yum.repos.d

　　即

sudo chmod 755  clouder-manager.repo


[hadoop@clouderamanager01 yum.repos.d]$ pwd
/etc/yum.repos.d
[hadoop@clouderamanager01 yum.repos.d]$ ll
total 20
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
-rw-r--r--  1 root root  202 Apr  9 01:59 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$ sudo chmod 755 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$ ll
total 20
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
-rwxr-xr-x  1 root root  202 Apr  9 01:59 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$

 

 

 

 

　　將

[cloudera-manager]
name=Cloudera Manager
baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgcheck = 1

 

 

　　改成

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/   
gpgcheck = 1

 

 

 

　　注意，此時，全部的機器（好比我這裏是clouderamanager0一、clouderamanager02和clouderamanager03）都要更改成

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled =1 
gpgcheck = 1

 

 

 　　因而，將全部機器的/etc/yum.repos.d/clouder-manager.repo改好爲本地的以後，再次刷新就好

 

 

 

 

 

 

clouderamanager[01-03]

 

 

 

　　

　　

　　有時候會是以下， 　　

 　　這是，由於。我以前前面3臺機器都沒有啓動服務，因此會是以下。三個自動會勾選。

 

 

 

 

 

 

 http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/

 

 

 

 在安裝過程當中，出現以下問題

 

 

複製代碼 
[hadoop@clouderaManager01 html]$ pwd
/var/www/html [hadoop@clouderaManager01 html]$ ll total 4 drwxr-xr-x 3 root root 4096 Apr 8 20:37 cm5 [hadoop@clouderaManager01 html]$ sudo mkdir -p cm5/redhat/6/x86_64/cm/5.3.6/repodata [hadoop@clouderaManager01 html]$ ll total 4 drwxr-xr-x 3 root root 4096 Apr 8 20:37 cm5 [hadoop@clouderaManager01 html]$ cd cm5/redhat/6/x86_64/cm/5.3.6/repodata/ [hadoop@clouderaManager01 repodata]$ pwd /var/www/html/cm5/redhat/6/x86_64/cm/5.3.6/repodata [hadoop@clouderaManager01 repodata]$ ll total 0 [hadoop@clouderaManager01 repodata]$
複製代碼

 

 

 

 

 

 

 

 

 

 

[hadoop@clouderamanager01 repodata]$ pwd
/var/www/html/cm5/redhat/6/x86_64/cm/5.3.6/repodata
[hadoop@clouderamanager01 repodata]$ lll
-bash: lll: command not found
[hadoop@clouderamanager01 repodata]$ ll
total 0
[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ ll
total 124
-rw-r--r-- 1 root root 91122 Apr  7 22:36 filelists.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:36 filelists.xml.gz.asc
-rw-r--r-- 1 root root   570 Apr  7 22:36 other.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:36 other.xml.gz.asc
-rw-r--r-- 1 root root  4208 Apr  7 22:37 primary.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:37 primary.xml.gz.asc
-rw-r--r-- 1 root root   951 Apr  7 22:37 repomd.xml
-rw-r--r-- 1 root root   198 Apr  7 22:37 repomd.xml.asc
[hadoop@clouderamanager01 repodata]$

 

 

 

 

 

 

 

 

 

 

 　　若是仍是沒有獲得解決的話，則

[hadoop@clouderamanager01 yum.repos.d]$ sudo vi cloudera-manager.repo

 
 
[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64 name=Cloudera Manager baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled =1 gpgcheck = 1
 

 

　　這裏。全部的節點都要同樣的。若是其下有其餘的，刪除（好比cloudera-manager.repo.~!或其餘的cloudera-manager.repo.repnew等）
 

 
 

 
 

 
 

　　以及重啓下
 

 

 
 
[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server status
cloudera-scm-server (pid  1888) is running... [hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server restart Stopping cloudera-scm-server: [ OK ] Starting cloudera-scm-server: [ OK ] [hadoop@clouderamanager01 parcel-repo]$ 
 

 

 　　等上幾分鐘。
 

 
 

 　　若是仍是沒有解決的話，說明那個文件cloudera-manager-agent-5.3.6-1.cm536.p0.244.el6.x86_64.rpm已經損壞了。從新下載它，再上傳。
 

 　　而後，再重啓
 

 
 
sudo service cloudera-scm-server restart

 

 

 　　就能夠解決問題了。
 

 
 

 
 

 
 

　　若是仍是沒解決的話，那就換成在線的吧！（哎）
 

 
 

 
 
[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 1
 

 

　　而後，接着下面
 

 

 

　　重複，執行上面的過程。這裏省略，.....
 

 
 

直至以下界面.....
 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 　　
 




 

 
 

 
 

 　　若是你的網速慢的話，則會出現，
 

　　好比我還遇到過這樣的一種狀況，也就是說，clouderamanager01先安裝成功，而後再次執行上面的重頭開始，再來clouderamanager02和clouderamanager03安裝成功！
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

安裝Parcel到全部主機上（我這裏是clouderaManager0一、clouderaManager02和clouderaManager03這臺機器上）
　　由於Parcel文件已經提早下載好了，第一個進度條會直接顯示已下載，而後開始分配。這個過程實際上就是將Parcel內的軟件解壓縮安裝到各個主機上的過程。耐心等待，時間會比較長，我安裝3臺主機（即在clouderaManager0一、02和03上，安裝3節點集羣）大概是須要30分鐘時間。（這裏看我的的網速）
 

　　其實啊，這裏分配就是解壓。
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 主機檢查
　　檢查就能夠了，建議不要跳過。靜靜地等一分鐘多點的時間
 

　　檢查結果以下：
 

 

 
 

 
 

 
 
http://clouderamanager01:7180/cmf/express-wizard/wizard#step=hostInspectorStep
 

 

 

　　由於我這裏，以前是在clouderaManager0一、clouderaManager0二、clouderaManager03和clouderaManager04安裝過。
 

而後，後面，再clouderamanager0一、clouderamanager02和clouderamanager03。
 

　　因此，會已經有了記錄的痕跡。（固然，如果你第一次安裝的話，就不會有這個問題出現的哈！）
 

 　 Cloudera Manager安裝之Cloudera Manager安裝前準備(CentOS6.5）（一）
 

　　永久修改，咱們直接修改配置文件，咱們直接修改/etc/sysconfig/network
 

 
 

 
 

 
 
NETWORKING=yes
HOSTNAME=clouderaManager01
 

 

　　對應三臺都要修改。我這裏是本身，當時失誤！主機名弄錯大小寫字母M了。
 

 　　而後
 

 
 
sudo reboot
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 

　　　這個問題怎麼解決呢？
 

　　說白了swap就是交換區，當內存容不下這些數據時，就移動到磁盤那去。因爲咱們是大數據，不但願移動到磁盤。
 

 

 
 
[hadoop@clouderaManager01 ~]$ sudo free -m 
             total       used       free     shared    buffers     cached
Mem:           980        917         63          0          1         32
-/+ buffers/cache:        883         96
Swap:         1999        552       1447
[hadoop@clouderaManager01 ~]$ sudo cat /proc/sys/vm/swappiness
60
[hadoop@clouderaManager01 ~]$ sudo sysctl -w vm.swappiness=10
vm.swappiness = 10
[hadoop@clouderaManager01 ~]$ 
 

 

 　　clouderaManager01和clouderaManager02和clouderaManager03都要執行。
 

 　　
 

 
 

 
 

 
 

 
 

　　這個怎麼來解決呢？是咱們的Linux版本的bug問題。
 

 
 

 
 
[hadoop@clouderaManager01 ~]$ su root
Password: 
[root@clouderaManager01 hadoop]# echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
[root@clouderaManager01 hadoop]# vi /etc/rc.local 
 

 

　　
 

 
 

 

 
 
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local


echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
 

 

　　clouderaManager01和clouderaManager02和clouderaManager03都要執行。
 

 
 

 
 

 
 

 
 

　　帶你認識下安裝成功以後的目錄結構
 

 

 
 
[root@clouderaManager01 cloudera]# pwd
/opt/cloudera
[root@clouderaManager01 cloudera]# ll
total 16
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 root         root         4096 Apr  9 04:14 parcel-cache
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Apr  8 23:52 parcel-repo
drwxr-xr-x 4 root         root         4096 Apr  9 04:33 parcels
[root@clouderaManager01 cloudera]# cd parcels/
[root@clouderaManager01 parcels]# pwd
/opt/cloudera/parcels
[root@clouderaManager01 parcels]# ll
total 4
lrwxrwxrwx  1 root root   26 Apr  9 04:33 CDH -> CDH-5.3.6-1.cdh5.3.6.p0.11
drwxr-xr-x 11 root root 4096 Jul 29  2015 CDH-5.3.6-1.cdh5.3.6.p0.11
[root@clouderaManager01 parcels]# cd CDH
[root@clouderaManager01 CDH]# pwd
/opt/cloudera/parcels/CDH
[root@clouderaManager01 CDH]# ls
bin  etc  include  jars  lib  lib64  libexec  meta  share
[root@clouderaManager01 CDH]# 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 
[root@clouderaManager01 CDH]# pwd
/opt/cloudera/parcels/CDH
[root@clouderaManager01 CDH]# ll
total 80
drwxr-xr-x  2 root root  4096 Jul 29  2015 bin
drwxr-xr-x 26 root root  4096 Jul 29  2015 etc
drwxr-xr-x  4 root root  4096 Jul 29  2015 include
drwxr-xr-x  2 root root 49152 Jul 29  2015 jars
drwxr-xr-x 36 root root  4096 Jul 29  2015 lib
drwxr-xr-x  2 root root  4096 Jul 29  2015 lib64
drwxr-xr-x  3 root root  4096 Jul 29  2015 libexec
drwxr-xr-x  2 root root  4096 Jul 29  2015 meta
drwxr-xr-x  3 root root  4096 Jul 29  2015 share
[root@clouderaManager01 CDH]# cd bin/
[root@clouderaManager01 bin]# ls
avro-tools  hadoop                hcat          kite-dataset  oozie          solrctl         sqoop2-server            sqoop-help               sqoop-merge      zookeeper-client
beeline     hadoop-0.20           hdfs          llama         oozie-setup    spark-executor  sqoop2-tool              sqoop-import             sqoop-metastore  zookeeper-server
catalogd    hadoop-fuse-dfs       hive          llamaadmin    parquet-tools  spark-shell     sqoop-codegen            sqoop-import-all-tables  sqoop-version    zookeeper-server-cleanup
cli_mt      hadoop-fuse-dfs.orig  hiveserver2   load_gen      pig            spark-submit    sqoop-create-hive-table  sqoop-job                statestored      zookeeper-server-initialize
cli_st      hbase                 impalad       mahout        pyspark        sqoop           sqoop-eval               sqoop-list-databases     whirr
flume-ng    hbase-indexer         impala-shell  mapred        sentry         sqoop2          sqoop-export             sqoop-list-tables        yarn
[root@clouderaManager01 bin]# 
 

 

 
 

 
 

 
 

 
 

 
 

 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

安裝完成以後，再安裝所需的服務（其實，這一步，若你的內存和空間足夠，最好選擇全部服務）
 

 　　其實啊，這步是選擇集羣中要安裝的CDH服務，爲了未來新增服務麻煩，咱們這裏選擇全部服務。其中有暫時用不到的服務，咱們能夠在界面中中止服務，這樣能夠節省內存資源
 

　　這裏，添加Cloudera Management Service服務
 

 

 

 
 

 

 

 
 

 
 

 
 

 　　而後，關於安裝其餘的，如Zookeeper、Hive、HBase和Spakr、Hadoop等。這些。我就不贅述了。
 

 
 

　　由於，這是，我在本身的電腦虛擬機裏搭建的。過卡和內存不夠，如下不貼圖和不寫了。
 

 　　
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

安裝完畢後點繼續
 

 　　貼圖，這裏不寫了。
 

 
 

 
 

 
 

 
 

 
 

　　
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

角色分配
　　分配各個節點的角色
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

數據庫設置
　　CDH默認內嵌了一個數據庫，若是你須要MySQL或者Oracle請選擇使用自定義數據庫，
 

　　  我這裏，先點擊測試鏈接，即選擇CDH默認的內嵌數據庫成功後點繼續。
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

審覈更改
　　 這裏所有默認就能夠了，直接繼續。
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

安裝完成，初始化
　　到這裏集羣已經安裝部署完成了，CDH會自動對你選擇的服務進行初始化設置，你也能夠稍後自行開啓。
 

 
 

 
 

 
 

 
 

初始化完成後，將進入主頁面
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

常見錯誤
 

 
 
[hadoop@clouderaManager01 parcel-repo]$ sudo service cloudera-scm-server restart

./cloudera-scm-server: line 109: pstree: command not found Starting cloudera-scm-server: [ OK ]
 

 

　　主要由於沒有安裝pstree包。


解決辦法：
 

 
 
 
  複製代碼 
 
 
 
[hadoop@clouderaManager01 parcel-repo]$ sudo yum install epel-release (安裝yum 源)
[hadoop@clouderaManager01 parcel-repo]$ sudo yum provides pstree (找到提供pstree命令的包)
[hadoop@clouderaManager01 parcel-repo]$ sudo yum install psmisc (安裝對應的包)


而後，
[hadoop@clouderaManager01 parcel-repo]$ sudo service cloudera-scm-server restart
Stopping cloudera-scm-server:                              [  OK  ]
Starting cloudera-scm-server:                              [  OK  ] 
 
 
 
  複製代碼 
 
 

 

 
 


    

 

 
 

 
 

 
 

 
 
 
  複製代碼 
 
 
 
Detecting Cloudera Manager Server...
    Detecting Cloudera Manager Server...
    BEGIN host -t PTR 192.168.1.198 198.1.168.192.in-addr.arpa domain name pointer localhost. END (0) using localhost as scm server hostname BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' localhost 7182 Traceback (most recent call last): File "<string>", line 1, in <module> File "<string>", line 1, in connect socket.error: [Errno 111] Connection refused END (1) could not contact scm server at localhost:7182, giving up waiting for rollback request
 
 
 
  複製代碼 
 
 

 

 
 

 
 

解決辦法：
 

　　在失敗的主機上，終端執行
 

 
 
sudo mv /usr/bin/host /usr/bin/host.bak
 

 

　　而後重試。
 

 
 

 
 

 
 

 
 

　　安裝過程一直卡在"正在獲取安裝鎖"狀態界面
 

　　解決辦法：
在卡住的主機上，刪除/tmp文件夾中的全部scm_prepare_node.開頭的文件，清空yum緩存，而後重啓主機。
 

 
 
sudo cd /tmp 
sudo rm -rf  scm_prepare_node.* sudo yum clean all sudo reboot
 

 

 
 

 
 

 
 

 
 

 
 

安裝完畢後NameNode格式化失敗，報如下錯誤
 

 
 
IncorrectVersionException: Unexpected version of storage directory /data/dfs
 

 

　　解決辦法：
 

　　刪除NameNode節點的/data/dfs文件夾，從新添加主機。
 

 
 

 
 

 
 

 
 

如何更改節點ip
 

　　解決辦法：
　　從新設置每臺主機的hosts文件，完成後進入主機界面，點擊從新運行升級嚮導，再走一遍以前的流程便可。
 

 

 
 

 
 

 
 

 
 

 
 

參考連接
 

http://www.mamicode.com/info-detail-1596233.html
 

http://www.jianshu.com/p/57179e03795f
 

http://www.aboutyun.com/thread-20741-1-1.html
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

擴展
 

　　參考
 

 
 

Cloudera Manager安裝之利用parcels方式（在線或離線）安裝3或4節點集羣（包含最新穩定版本或指定版本的安裝）（添加服務）（Ubuntu14.04）（五）
 

 
 

 　　最好，在這以前，先將
 

注意，在此以前。
 

　　cmbigdata1機器上，則須要執行
 

 
 
 
  複製代碼 
 
 
 
bigdata@cmbigdata1:~$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password

[sudo] password for bigdata: 
Sorry, try again.
[sudo] password for bigdata: 
JAVA_HOME=/usr/local/jdk/jdk1.8.0_60
 
 
Verifying that we can write to /etc/cloudera-scm-server Creating SCM configuration file in /etc/cloudera-scm-server Executing: /usr/java/jdk1.7.0_80/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db. [ main] DbCommandExecutor INFO Successfully connected to database. All done, your SCM database is configured correctly! bigdata@ubuntucmbigdata1:~$ sudo service cloudera-scm-server start cloudera-scm-server is already running bigdata@cmbigdata1:~$ 

 
 
bigdata@cmbigdata1:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$
 
 
 
 
 
 
 
 
 
  複製代碼 
 
 

 

 
 

 
 

　　而後，在cmbigdata二、cmbigdata三、cmbigdata4上
 

 
 
 
  複製代碼 
 
 
 
bigdata@cmbigdata2:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 



bigdata@cmbigdata3:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 





bigdata@cmbigdata4:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 
 

 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 　　由於，個人集羣狀況是以下
 

 

 
 

 
 

 
 

 
 

 
 

 　　
 　　這是，由於。我以前前面4臺機器都沒有啓動服務，因此會是以下。四個自動會勾選。
 

 

 
 

 
 

 
 

 
 

 
 

 　
 

 
 

 
 

　
 

 
 

 
 

 
 

 
 

 
 
 http://cmbigdata1/cm5/redhat/6/x86_64/cm/5.3.6/
 

 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 
http://cmbigdata1:7180/cmf/express-wizard/resume#step=installStep
 

 

 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

　　對於，第一個黃色警告，其實就是時間同步 的問題。
 

 
 
[bigdata@cmbigdata1 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata2 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata3 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata4 ~]$ ntpdate pool.ntp.org
 

 

 
 

 
 

 
 

　　對於，第二個黃色警告的解決辦法！
 

 
 
    Cloudera 建議將 /proc/sys/vm/swappiness 設置爲 0。當前設置爲 60。使用 sysctl 命令在運行時更改該設置並編輯 /etc/sysctl.conf 以在重啓後保存該設置。您能夠繼續進行安裝，但可能會遇到問題，Cloudera Manager 報告您的主機因爲交換運行情況不佳。如下主機受到影響： 
cmbigdata[1-4]
 

 

　　
 

 
 
[bigdata@cmbigdata1 ~]$ su root
Password: 
[root@cmbigdata1 bigdata]# echo 0 > /proc/sys/vm/swappiness
[root@cmbigdata1 bigdata]# 
 

 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 　　而後，接下來，這一步，其實跟我另外寫的一篇用ambari是同樣的。
 

　　
 

Ambari安裝之部署3個節點的HA分佈式集羣
 

 
 

 

 
 

 
 

 
 

 　　最後，個人初步安裝是
 

 

 
 

 
 

 
 

 
 

 
 

 

 
 

 　　由於，在之後，本身是能夠修改的。
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

因此，CDH默認內嵌了一個數據庫，沒法經過。我這裏選擇須要MySQL或者Oracle請選擇使用自定義數據庫，
 

　　好比Hive， oozie 元數據庫配置，使用咱們安裝的mysql來存放元數據，其中數據庫名，用戶名和密碼須要預先建立好的。這裏。請移步
 

 
 

 
 

 
 

 
 

　若是你是一名有經驗大數據工程師，不管是安裝jdk（注意：CentOS6.5有自帶的jdk），仍是安裝mysql。都是先查看系統是否已經安裝Mysql包。
 

 
 
[root@master app]# rpm -qa|grep mysql 
mysql-libs-5.1.71-1.el6.x86_64
[root@master app]# rpm -e --nodeps mysql-libs-5.1.71-1.el6.x86_64
[root@master app]# rpm -qa|grep mysql 
[root@master app]#
 

 

 
 

 
 

 
 

 
 
[root@cmbigdata1 ~]# yum install mysql-server
Is this ok [y/N]: y
 

 

 
 

 
 

 
 

 
 
[root@cmbigdata1 ~]# service mysqld start
 

 

 
 

 
 

 
 
[root@cmbigdata1 ~]# yum install mysql-connector-java
Is this ok [y/N]: y
 

 

 
 

 
 

 
 

 
 

 
 

 
 
[root@cmbigdata ~]# mysql -u root -p
Enter password:           //默認密碼爲空，輸入後回車便可
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.1.73 Source distribution
Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.
mysql> set password for root@localhost=password('rootroot'); 　　密碼設置爲rootroot
默認狀況下Mysql只容許本地登陸，因此只需配置root@localhost就好


 
 
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)
 
 
 
 
mysql> exit;
Bye
[root@cmbigdata1 ~]#
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 

 

 
 

 
 
[root@cmbigdata1 ~]# mysql -uroot -prootroot
 

 

 　　我這裏，是第一次安裝。因此直接進入
 

 
 

 
 

 
 

 

 
 
mysql> create database hive DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> 
 

 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 

 
 
mysql> create database clouder_manager DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on clouder_manager.* TO 'clouder_manager'@'%' IDENTIFIED BY 'clouder_manager';
Query OK, 0 rows affected (0.00 sec)

mysql> 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 

 
 

 
 
mysql> create database amon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> 
 

 

 
 

 
 

 
 

 
 

 
 
mysql> create database smon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on smon.* TO 'smon'@'%' IDENTIFIED BY 'smon_password';
Query OK, 0 rows affected (0.00 sec)
 

 

 
 

 
 

 
 

 
 
mysql> create database rman DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)
 

 

 
 

 
 

 
 

 
 
mysql> create database hmon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on hmon.* TO 'hmon'@'%' IDENTIFIED BY 'hmon_password';
Query OK, 0 rows affected (0.00 sec)
 

 

 
 

 
 

 
 

 
 
mysql> create database nav DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on nav.* TO 'hmon'@'%' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)
 

 

 
 

 
 

 
 

 
 

 
 
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> select user,host,password from mysql.user;
+-----------------+------------+-------------------------------------------+
| user            | host       | password                                  |
+-----------------+------------+-------------------------------------------+
| root            | localhost  | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root            | cmbigdata1 |                                           |
| root            | 127.0.0.1  |                                           |
|                 | localhost  |                                           |
|                 | cmbigdata1 |                                           |
| hive            | %          | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t         | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon            | %          | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon            | %          | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | %          | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | %          | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
+-----------------+------------+-------------------------------------------+
11 rows in set (0.00 sec)

mysql> exit;
Bye
[root@cmbigdata1 ~]# 
 

 

 
 

 
 

 
 

 
 

　　而後，執行，仍是如此
 

 

 
 

 
 

 
 

 
 

　　參考
 

Ubuntu 14.04 MySQL 安裝配置 For Cloudera Manages 5
 

 
 

 
 

 　　解決辦法
 

 
 
mysql> grant all on *.* TO 'hive'@'cmbigdata1' IDENTIFIED BY 'hive';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'amon'@'cmbigdata1' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

 
 
mysql> grant all on *.* TO 'clouder_manager'@'%cmbigdata1' IDENTIFIED BY 'clouder_manager';
Query OK, 0 rows affected (0.00 sec)
 
 
mysql> grant all on *.* TO 'smon'@'cmbigdata1' IDENTIFIED BY 'smon_password';
Query OK, 0 rows affected (0.00 sec)
 
 
mysql> grant all on *.* TO 'rman'@'cmbigdata1' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)
 
 
mysql> grant all on *.* TO 'hmon'@'cmbigdata1' IDENTIFIED BY 'hmon_password';
Query OK, 0 rows affected (0.01 sec)
 
 
mysql> grant all on *.* TO 'nav'@'cmbigdata1' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)
 
 
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)
 
 
mysql> select user,host,password from mysql.user;
+-----------------+-------------+-------------------------------------------+
| user | host | password |
+-----------------+-------------+-------------------------------------------+
| root | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root | cmbigdata1 | |
| root | 127.0.0.1 | |
| | localhost | |
| | cmbigdata1 | |
| hive | % | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon | % | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon | % | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman | % | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon | % | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| hive | cmbigdata1 | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| amon | cmbigdata1 | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| clouder_manager | %cmbigdata1 | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| smon | cmbigdata1 | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman | cmbigdata1 | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon | cmbigdata1 | *DC736DB1383C5AC16BFE895C856F8D30214AF19A |
| nav | cmbigdata1 | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
+-----------------+-------------+-------------------------------------------+
18 rows in set (0.00 sec)
 
 
mysql> 
 
 
 
 
 
 
 

 

 
 

 
 

 
 

　　別忘了oozie
 

 
 
mysql> create database oozie DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.22 sec)

mysql> grant all on *.* TO 'oozie'@'cmbigdata1' IDENTIFIED BY 'oozie_password';
Query OK, 0 rows affected (0.18 sec)

mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password';
Query OK, 0 rows affected (0.04 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.15 sec)

mysql> select user,host,password from mysql.user;
+-----------------+-------------+-------------------------------------------+
| user            | host        | password                                  |
+-----------------+-------------+-------------------------------------------+
| root            | localhost   | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root            | cmbigdata1  |                                           |
| root            | 127.0.0.1   |                                           |
|                 | localhost   |                                           |
|                 | cmbigdata1  |                                           |
| hive            | %           | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t          | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon            | %           | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon            | %           | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | %           | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | %           | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| hive            | cmbigdata1  | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| amon            | cmbigdata1  | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| clouder_manager | %cmbigdata1 | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| smon            | cmbigdata1  | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | cmbigdata1  | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | cmbigdata1  | *DC736DB1383C5AC16BFE895C856F8D30214AF19A |
| nav             | cmbigdata1  | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| oozie           | cmbigdata1  | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 |
| oozie           | %           | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 |
+-----------------+-------------+-------------------------------------------+
20 rows in set (0.15 sec)

mysql> 
 

 

 
 

 
 

 
 

 

 
 

 
 

 
 

　　下面，這裏，是能夠之後再更改的。
 

 
 

 

 
 

 
 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

　　說白了，這裏是啓動的總界面，可是呢，咱們若這裏沒啓動成功，不要緊，能夠在後面，單獨來啓動！（具體以下的詳細步驟）
 

 
 
http://cmbigdata1:7180/cmf/clusters/2/express-add-services/index#step=commandDetailsStep
 

 

 
 

 
 

 
 

 　　遇到這個問題
 


  正在啓動 Key-Value Store Indexer 服務 

 

Failed to execute command Start on service Key-Value Store Indexer

 

 
 

 
 

 
 

 
 

 　　啓動與中止Key-Value Store Indexer
 

 

 
 

 
 

 

 
 

 　　
 

 
 

　　經過，這樣，也是能夠達到目的的。對於這個問題，之後再來解決！
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 啓動與中止Oozie和相關配置
 

 　　對於這裏，安裝出現這個問題，無法解決，後面繼續不了 。其實，否則，（能夠單獨解決）
 

 
  
 
 
 

 


    

 

 
 

 
 

 
 

 

　　經過，這樣，也是能夠達到目的的。
 

 　　
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 　　啓動與中止Hue，並相關配置
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

　　啓動與中止Cloudera Management Service，並相關配置
 

 

 
 

 

 
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 
http://cmbigdata1:7180/cmf/home
 

 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

　　關於安裝kafka，見
 

CDH集成Kafka
 

 
 

 
 

參考
 

http://www.doc88.com/p-0042075356791.html


        

            

        	





    

		

            
相關文章

            

                

                

                    

                

            


            
相關標籤/搜索

            
        


    

        

            

        

        

        
        

        

        

    




	

    





    

    	

    

        每日一句
    

    
    
    	每一个你不满意的现在，都有一个你没有努力的曾经。
    







    

    


    



    

        本站公眾號
    

    

           歡迎關注本站公眾號,獲取更多信息

        
    




    

    




	


	







    

        聯繫我們
        最近搜索
        最新文章
        
        沪ICP备13005482号-10

            MyBatis教程
            SQL 教程
            MySQL教程
            Java 教程
            Thymeleaf 教程
            Hibernate教程
            Spring教程 
            Redis教程