安裝環境三臺centos7 vmw:html
cdh-141 192.168.0.141 [主節點] cdh-142 192.168.0.142 [從節點] cdh-143 192.168.0.143 [從節點]
1）[各節點]使用本地yum repo進行安裝時:
須要在各個節點(192.168.0.141,192.168.0.142,192.168.0.143)上設置本地repo(/etc/yum.repos.d/)node
cd /etc/yum.repos.d/ mkdir backup mv *.repo ./backup echo '[cloudera-manager] name = Cloudera Manager, Version 5.13.0 baseurl = http://192.168.0.141/cm5/ gpgcheck = 0 '> cloudera-manager.repo echo '[myrepo] name=myrepo baseurl=http://192.168.0.141/cm5/ enabled=1 gpgcheck=0'> myrepo.repo
2）[主節點]須要安裝httpd,並在/var/www/html下建立cm5存放cm安裝源
從http://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.13.0/下載源文件到該（/var/wwww/html/cm5）路徑下;python
[root@cdh-141 bin]$ cd /var/www/html/ [root@cdh-141 html]$ ls cdh5 cm5 [root@cdh-141 html]$ cd cm5/ [root@cdh-141 cm5]$ ls mirror repodata RPMS
3）[主節點]須要下載cdh5的安裝源
(
http://archive.cloudera.com/cdh5/parcels/5.13.0/CDH-5.13.0-1.cdh5.13.0.p0.29-el7.parcel
http://archive.cloudera.com/cdh5/parcels/5.13.0/CDH-5.13.0-1.cdh5.13.0.p0.29-el7.parcel.sha1
http://archive.cloudera.com/cdh5/parcels/5.13.0/manifest.json
)到/val/www/html/cdh5/下sql
[root@cdh-141 ~]$ cd /var/www/html/ [root@cdh-141 html]$ ls cdh5 cm5 [root@cdh-141 html]$ cd cdh5/ [root@cdh-141 cdh5]$ ls CDH-5.13.0-1.cdh5.13.0.p0.29-el7.parcel CDH-5.13.0-1.cdh5.13.0.p0.29-el7.parcel.sha manifest.json
輸入地址：http://192.168.0.141:7180，進行安裝過程當中出現錯誤：shell
問題解決：安裝Cloudera manager agent失敗
安裝過程當中出現警告解決方案參考：http://www.cnblogs.com/fujiangong/p/5620050.htmljson
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: python-psycopg2
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: psmisc
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: MySQL-python
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: bind-utils
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: /lib/lsb/init-functions
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: cyrus-sasl-plain
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: portmap
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: cyrus-sasl-gssapi
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: mod_ssl
Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager)
Requires: openssl-develcentos
解決方案：api
yum clean all yum mackecache yum -y install httpd python-psycopg2 psmisc MySQL-python bind-utils init-functions cyrus-sasl-plain portmap cyrus-sasl-gssapi mod_ssl openssl-devel #Error: Package: cloudera-manager-agent-5.15.1-1.cm5151.p0.3.el7.x86_64 (cloudera-manager) #Requires: /lib/lsb/init-functions yum install lsb
問題解決：不良 : 羣集中有 710 個 副本不足的塊 塊。羣集中共有 710 個塊。百分比 副本不足的塊: 100.00%。 臨界閾值：40.00%。
將hdfs複製因子修改成2，默認3，而我這datanode只有兩個，所以不夠三個複製因子。oop
而後在master(CDH-141)中經過命令更改備份數：測試
su hdfs hadoop fs -setrep -R 2 / #這裏的-R 2的數字2就對應咱們的DataNode個數。
修改爲功後，重啓hdfs，出現：不良 : Canary 測試沒法在目錄 /tmp/.cloudera_health_monitoring_canary_files 中建立文件。
通過查看日誌，發現 Name node is in safe mode.
解決方法：
sudo -u hdfs hdfs dfsadmin -safemode leave
問題解決：Permission denied: user=root, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x
運行
[root@cdh-141 bin]# pwd /opt/cloudera/parcels/SPARK2/bin [root@cdh-141 bin]# spark2-shell
出現異常：Permission denied: user=root, access=WRITE, inode="/user":hdfs:supergroup:drwxr-xr-x
解決方案
1.修改hdfs參數 dfs.permissions=false，賦權限給root
2.重啓HDFS組件，讓其生效。
3.重啓成功後，shell從新登陸，root執行也ok
不讓其進行權限驗證，
從新安裝時，能夠如下命令刪除：
若是安裝過程當中出現失敗，須要從新安裝時，能夠如下命令刪除：
/usr/share/cmf/uninstall-cloudera-manager.sh service cloudera-scm-agent stop service cloudera-scm-agent stop umount /var/run/cloudera-scm-agent/process umount /var/run/cloudera-scm-agent/process umount /var/run/cloudera-scm-agent/process rm -rf /usr/share/cmf /var/lib/cloudera* /var/cache/yum/x86_64/6/cloudera* /var/log/cloudera* /var/run/cloudera* /etc/cloudera* rpm -qa | grep cloudera for f in `rpm -qa | grep cloudera ` ; do rpm -e ${f} ; done rm -rf /var/lib/hadoop-* /var/lib/impala /var/lib/solr /var/lib/zookeeper /var/lib/hue /var/lib/oozie /var/lib/pgsql /var/lib/sqoop2 /data/dfs/ /data/impala/ /data/yarn/ /dfs/ /impala/ /yarn/ /var/run/hadoop-*/ /var/run/hdfs-*/ /usr/bin/hadoop* /usr/bin/zookeeper* /usr/bin/hbase* /usr/bin/hive* /usr/bin/hdfs /usr/bin/mapred /usr/bin/yarn /usr/bin/sqoop* /usr/bin/oozie /etc/hadoop* /etc/zookeeper* /etc/hive* /etc/hue /etc/impala /etc/sqoop* /etc/oozie /etc/hbase* /etc/hcatalog rm -rf ` find /var/lib/alternatives/* ! -name "mta" ! -name "print" ! -name "zlibrary-ui" -mtime -3` rm -rf /etc/alternatives/* for u in hdfs mapred cloudera-scm hbase hue zookeeper oozie hive impala flume; do sudo kill $(ps -u $u -o pid=); done rm -rf /opt/cloudera/parcel-cache /opt/cloudera/parcels