【轉】安裝ambari的時候遇到的ambari和hadoop問題集

時間 2019-11-17

標籤安裝 ambari 時候遇到 hadoop 問題欄目 Hadoop 简体版

原文原文鏈接

5.在安裝的時候遇到的問題

5.1使用ambari-server start的時候出現ERROR: Exiting with exit code -1.

5.1.1REASON: Ambari Server java process died with exitcode 255. Check /var/log/ambari-server/ambari-server.out for more information

解決：html

因爲是從新安裝，因此在使用/etc/init.d/postgresql initdb初始化數據庫的時候會出現這個錯誤，因此須要java

先用yum –y remove postgresql*命令把postgresql卸載node

而後把/var/lib/pgsql/data目錄下的文件所有刪除python

而後再配置postgresql數據庫（執行1.6章節內容）mysql

而後再次安裝（3章節內容）linux

5.1.2在日誌中有以下錯誤：ERROR [main] AmbariServer:820 - Failed to run the Ambari Server

com.google.inject.ProvisionException: Guice provision errors:web

1) Error injecting method, java.lang.NullPointerExceptionsql

at org.apache.ambari.server.api.services.AmbariMetaInfo.init(AmbariMetaInfo.java:243)shell

at org.apache.ambari.server.api.services.AmbariMetaInfo.class(AmbariMetaInfo.java:125)數據庫

while locating org.apache.ambari.server.api.services.AmbariMetaInfo

for field at org.apache.ambari.server.controller.AmbariServer.ambariMetaInfo(AmbariServer.java:145)

at org.apache.ambari.server.controller.AmbariServer.class(AmbariServer.java:145)

while locating org.apache.ambari.server.controller.AmbariServer

1 error

at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)

at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)

at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:813)

Caused by: java.lang.NullPointerException

at org.apache.ambari.server.stack.StackModule.processRepositories(StackModule.java:665)

at org.apache.ambari.server.stack.StackModule.resolve(StackModule.java:158)

at org.apache.ambari.server.stack.StackManager.fullyResolveStacks(StackManager.java:201)

at org.apache.ambari.server.stack.StackManager.(StackManager.java:119)

at org.apache.ambari.server.stack.StackManager$$FastClassByGuice$$33e4ffe0.newInstance()

at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)

at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)

at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)

at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)

at com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)

at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)

at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:974)

at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:632)

at com.sun.proxy.$Proxy26.create(Unknown Source)

at org.apache.ambari.server.api.services.AmbariMetaInfo.init(AmbariMetaInfo.java:247)

5.2安裝HDFS和HBASE的時候出現/usr/hdp/current/hadoop-client/conf doesn't exist

5.2.1/etc/Hadoop/conf文件連接存在

是因爲/etc/hadoop/conf和/usr/hdp/current/hadoop-client/conf目錄互相連接，形成死循環，因此要改變一個的連接

cd /etc/hadoop

rm -rf conf

ln -s /etc/hadoop/conf.backup /etc/hadoop/conf

HBASE也會遇到一樣的問題，解決方式同上

cd /etc/hbase

rm -rf conf

ln -s /etc/hbase/conf.backup /etc/hbase/conf

ZooKeeper也會遇到一樣的問題，解決方式同上

cd /etc/zookeeper

rm -rf conf

ln -s /etc/zookeeper/conf.backup /etc/zookeeper/conf

5.2.2/etc/Hadoop/conf文件連接不存在

查看正確的配置，發現缺乏兩個目錄文件config.backup和2.4.0.0-169，把文件夾拷貝到/etc/hadoop目錄下

從新建立/etc/hadoop目錄下的conf連接：

cd /etc/hadoop

rm -rf conf

ln -s /usr/hdp/current/hadoop-client/conf conf

問題解決

5.3在認證機器(Confirm Hosts)的時候出現錯誤Ambari agent machine hostname (localhost) does not match expected ambari server hostname

Ambari配置時在Confirm Hosts的步驟時，中間遇到一個很奇怪的問題：老是報錯誤：

Ambari agent machine hostname (localhost.localdomain) does not match expected ambari server hostname (xxx).

後來修改的/etc/hosts文件中

修改前：

127.0.0.1 localhost dsj-kj1
::1 localhost dsj-kj1

10.13.39.32 dsj-kj1

10.13.39.33 dsj-kj2

10.13.39.34 dsj-kj3

10.13.39.35 dsj-kj4

10.13.39.36 dsj-kj5

修改後：

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

10.13.39.32 dsj-kj1

10.13.39.33 dsj-kj2

10.13.39.34 dsj-kj3

10.13.39.35 dsj-kj4

10.13.39.36 dsj-kj5

感受應該是走的ipv6協議，很奇怪，不過修改後就能夠了。

5.4ambary-server重裝

刪除使用腳本刪除

注意刪除後要安裝兩個系統組件

yum -y install ruby*

yum -y install redhat-lsb*

yum -y install snappy*

安裝參考3

5.5Ambari鏈接mysql設置

在主節點把mysql數據庫鏈接包拷貝在/var/lib/ambary-server/resources目錄下並更名爲mysql-jdbc-driver.jar

cp /usr/share/java/mysql-connector-java-5.1.17.jar /var/lib/ambari-server/resources/mysql-jdbc-driver.jar

再在圖形界面下啓動hive

5.6在註冊機器(Confirm Hosts)的時候出現錯誤Failed to start ping port listener of: [Errno 98] Address already in use

某個端口或者進程一直陪佔用

解決方法：
發現df命令一直執行沒有完成，

[root@testserver1 ~]# netstat -lanp|grep 8670
tcp 0 0 0.0.0.0:8670 0.0.0.0:* LISTEN 2587/df

[root@testserver1 ~]# kill -9 2587
kill後，再重啓ambari-agent問題解決

[root@testserver1 ~]# service ambari-agent restart
Verifying Python version compatibility...
Using python /usr/bin/python2.6
ambari-agent is not running. No PID found at /var/run/ambari-agent/ambari-agent.pid
Verifying Python version compatibility...
Using python /usr/bin/python2.6
Checking for previously running Ambari Agent...
Starting ambari-agent
Verifying ambari-agent process status...
Ambari Agent successfully started
Agent PID at: /var/run/ambari-agent/ambari-agent.pid
Agent out at: /var/log/ambari-agent/ambari-agent.out
Agent log at: /var/log/ambari-agent/ambari-agent.log

5.7在註冊機器(Confirm Hosts)的時候出現錯誤The following hosts have Transparent HugePages (THP) enabled。THP should be disabled to avoid potential Hadoop performance issues

解決方法：
在Linux下執行：

echo never >/sys/kernel/mm/redhat_transparent_hugepage/defrag

echo never >/sys/kernel/mm/redhat_transparent_hugepage/enabled

echo never >/sys/kernel/mm/transparent_hugepage/enabled

echo never >/sys/kernel/mm/transparent_hugepage/defrag

5.8啓動hive的時候出現錯誤unicodedecodeerror ambari in position 117

查看/etc/sysconfig/i18n文件，發現內容以下：

LANG=」zh_CN.UTF8」

原來系統字符集設置成了中文，改爲以下內容，問題解決：

LANG="en_US.UTF-8"

5.9安裝Metrics的時候報以下錯誤，安裝包找不到

1.failure: Updates-ambari-2.2.1.0/ambari/ambari-metrics-monitor-2.2.1.0-161.x86_64.rpm from HDP-UTILS-1.1.0.20: [Errno 256] No more mirrors to try.

在ftp源服務器上執行命令：

cd /var/www/html/ambari/HDP-UTILS-1.1.0.20/repos/centos6

mkdir Updates-ambari-2.2.1.0

cp -r /var/www/html/ambari/Updates-ambari-2.2.1.0/ambari /var/www/html/ambari/HDP-UTILS-1.1.0.20/repos/centos6/Updates-ambari-2.2.1.0

而後從新生成repodata

cd /var/www/html/ambari

rm -rf repodata

createrepo ./

2.failure: HDP-UTILS-1.1.0.20/repos/centos6/Updates-ambari-2.2.1.0/ambari/ambari-metrics-monitor-2.2.1.0-161.x86_64.rpm from HDP-UTILS-1.1.0.20: [Errno 256] No more mirrors to try.

在/etc/yum.repos.d目錄下刪除mnt.repo，並使用yum clean all命令來清空yum的緩存

cd /ec/yum.repos.d

rm -rf mnt.repo

yum clean all

5.11jps 報process information unavailable解決辦法

4791 -- process information unavailable

解決辦法：

進入tmp目錄，

cd /tmp

刪除該目錄下

名稱爲hsperfdata_{ username}的文件夾

而後jps,清淨了。

腳本：

cd /tmp

ls -l | grep hsperf | xargs rm -rf

ls -l | grep hsperf

5.12namenode啓動報錯在日誌文件中ERROR namenode.NameNode (NameNode.java:main(1712)) - Failed to start namenode

日誌中還有java.net.BindException: Port in use: gmaster:50070

Caused by: java.net.BindException: Address already in use

判斷緣由是50070上一次沒有釋放，端口占用

netstat下time_wait狀態的tcp鏈接：
1.這是一種處於鏈接徹底關閉狀態前的狀態；
2.一般要等上4分鐘（windows server）的時間才能徹底關閉；
3.這種狀態下的tcp鏈接佔用句柄與端口等資源，服務器也要爲維護這些鏈接狀態消耗資源；
4.解決這種time_wait的tcp鏈接只有讓服務器可以快速回收和重用那些TIME_WAIT的資源：修改註冊表[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\Tcpip\Parameters]添加dword值TcpTimedWaitDelay=30（30也爲微軟建議值；默認爲2分鐘）和MaxUserPort：65534(可選值5000 - 65534)；
5.具體tcpip鏈接參數配置還可參照這裏：http://technet.microsoft.com/zh-tw/library/cc776295%28v=ws.10%29.aspx
6.linux下：
vi /etc/sysctl.conf
新增以下內容：
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_syncookies=1

net.ipv4.tcp_fin_timeout=30

net.ipv4.tcp_keepalive_time=1800

net.ipv4.tcp_max_syn_backlog=8192

使內核參數生效：
[root@web02 ~]# sysctl -p
readme:
net.ipv4.tcp_syncookies=1 打開TIME-WAIT套接字重用功能，對於存在大量鏈接的Web服務器很是有效。
net.ipv4.tcp_tw_recyle=1
net.ipv4.tcp_tw_reuse=1 減小處於FIN-WAIT-2鏈接狀態的時間，使系統能夠處理更多的鏈接。
net.ipv4.tcp_fin_timeout=30 減小TCP KeepAlive鏈接偵測的時間，使系統能夠處理更多的鏈接。
net.ipv4.tcp_keepalive_time=1800 增長TCP SYN隊列長度，使系統能夠處理更多的併發鏈接。
net.ipv4.tcp_max_syn_backlog=8192

5.13在啓動的時候報錯誤resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh -H -E /usr/hdp/current/hadoop-client/sbin/hadoop-daemon.sh

在日誌中有以下內容：

2016-03-31 13:55:28,090 INFO security.ShellBasedIdMapping (ShellBasedIdMapping.java:updateStaticMapping(322)) - Not doing static UID/GID mapping because '/etc/nfs.map' does not exist.

2016-03-31 13:55:28,096 INFO nfs3.WriteManager (WriteManager.java:(92)) - Stream timeout is 600000ms.

2016-03-31 13:55:28,096 INFO nfs3.WriteManager (WriteManager.java:(100)) - Maximum open streams is 256

2016-03-31 13:55:28,096 INFO nfs3.OpenFileCtxCache (OpenFileCtxCache.java:(54)) - Maximum open streams is 256

2016-03-31 13:55:28,259 INFO nfs3.RpcProgramNfs3 (RpcProgramNfs3.java:(205)) - Configured HDFS superuser is

2016-03-31 13:55:28,261 INFO nfs3.RpcProgramNfs3 (RpcProgramNfs3.java:clearDirectory(231)) - Delete current dump directory /tmp/.hdfs-nfs

2016-03-31 13:55:28,269 WARN fs.FileUtil (FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [/tmp/.hdfs-nfs]: it still exists.

說明hdfs這個用戶對/tmp沒有權限

賦予權限給hdfs用戶：

chown hdfs:hadoop /tmp

再啓動問題解決

5.14在安裝ranger組件的時候出現錯誤鏈接不上mysql數據庫rangeradmin用戶和不能賦權的問題

在數據庫中先刪除全部rangeradmin用戶，注意使用drop user命令：

drop user 'rangeradmin'@'%';

drop user 'rangeradmin'@'localhost';

drop user 'rangeradmin'@'gmaster';

drop user 'rangeradmin'@'gslave1';

drop user 'rangeradmin'@'gslave2';

FLUSH PRIVILEGES;

再建立用戶（注意gmaster是ranger安裝的服務器機器名）

CREATE USER 'rangeradmin'@'%' IDENTIFIED BY 'rangeradmin';

GRANT ALL PRIVILEGES ON *.* TO 'rangeradmin'@'%' with grant option;

CREATE USER 'rangeradmin'@'localhost' IDENTIFIED BY 'rangeradmin';

GRANT ALL PRIVILEGES ON *.* TO 'rangeradmin'@'localhost' with grant option;

CREATE USER 'rangeradmin'@'gmaster' IDENTIFIED BY 'rangeradmin';

GRANT ALL PRIVILEGES ON *.* TO 'rangeradmin'@'gmaster' with grant option;

FLUSH PRIVILEGES;

再查看權限：

SELECT DISTINCT CONCAT('User: ''',user,'''@''',host,''';') AS query FROM mysql.user

select * from mysql.user where user='rangeradmin' \G;

問題解決

5.15在ambari啓動的時候出現錯誤：AmbariServer:820 - Failed to run the Ambari Server

這個問題困擾了我好久，最後經過查看源碼找到了問題所在：

在/var/log/ambari-server/ambary-server.log文件中報有錯誤：

13 Apr 2016 14:16:01,723 INFO [main] StackDirectory:458 - Stack '/var/lib/ambari-server/resources/stacks/HDP/2.1.GlusterFS' doesn't contain an upgrade directory

13 Apr 2016 14:16:01,723 INFO [main] StackDirectory:468 - Stack '/var/lib/ambari-server/resources/stacks/HDP/2.1.GlusterFS' doesn't contain config upgrade pack file

13 Apr 2016 14:16:01,744 INFO [main] StackDirectory:484 - Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.1.GlusterFS/role_command_order.json

13 Apr 2016 14:16:01,840 INFO [main] StackDirectory:484 - Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.4/role_command_order.json

13 Apr 2016 14:16:01,927 ERROR [main] AmbariServer:820 - Failed to run the Ambari Server

com.google.inject.ProvisionException: Guice provision errors:

1) Error injecting method, java.lang.NullPointerException

at org.apache.ambari.server.api.services.AmbariMetaInfo.init(AmbariMetaInfo.java:243)

at org.apache.ambari.server.api.services.AmbariMetaInfo.class(AmbariMetaInfo.java:125)