windows環境下Eclipse開發MapReduce程序遇到的四個問題及解決辦法

按此文章《Hadoop集羣(第7期)_Eclipse開發環境設置》進行MapReduce開發環境搭建的過程當中遇到一些問題,饒了一些彎路,解決辦法記錄在此:html

文檔目的:java

記錄windows環境下Eclipse開發MapReduce程序遇到的四個問題及解決辦法;apache

問題一:程序運行時報JobTracker is in safe modewindows

security.UserGroupInformation: PriviledgedActionException as:hadoop cause:org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.mapred.SafeModeException: JobTracker is in safe mode 
    at org.apache.hadoop.mapred.JobTracker.checkSafeMode(JobTracker.java:5178)

解決辦法:安全

解除安全模式,以下命令:oop

bin/hadoop dfsadmin -safemode leavespa

操做安全模式的參數:.net

enter 進入安全模式code

leave 強制退出安全模式orm

get 返回是否開啓安全模式

wait 等待,一直到安全模式結束

問題二:程序運行時報錯Input path does not exist: file

14/06/05 13:41:06 INFO mapred.JobClient: Cleaning up the staging area hdfs://hadoop:9000/usr/local/hadoop/tmp/mapred/staging/hadoop/.staging/job_201406041924_0002
14/06/05 13:41:06 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:

解決辦法:建立input目錄

問題三:程序運行時報錯unknown host: hadoop

14/06/05 13:46:05 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop cause:java.net.UnknownHostException: unknown host: hadoop
Exception in thread "main" java.net.UnknownHostException: unknown host: hadoop

解決辦法:將C:\Windows\System32\drivers\etc\hosts文件中,增長Hadoop的DNS解析

192.168.80.100        hadoop

問題四:程序運行時報錯JobTracker is in safe mode

14/06/05 14:13:21 ERROR security.UserGroupInformation: PriviledgedActionException as:administrator cause:org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.mapred.SafeModeException: JobTracker is in safe mode

解決辦法:"右擊"桌面上圖標"個人電腦",選擇"管理",將用戶中,找到administrator,改成hadoop,註銷或重啓電腦。

相關文章
相關標籤/搜索