2018-04-11 16:23:26,935 DEBUG [org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful kerberos logins and latency (milliseconds)], valueName=Time) 2018-04-11 16:23:26,937 DEBUG [org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and latency (milliseconds)], valueName=Time) 2018-04-11 16:23:26,938 DEBUG [org.apache.hadoop.metrics2.impl.MetricsSystemImpl] - UgiMetrics, User and group related metrics 2018-04-11 16:23:26,987 DEBUG [org.apache.hadoop.security.authentication.util.KerberosName] - Kerberos krb5 configuration not found, setting default realm to empty 2018-04-11 16:23:26,989 DEBUG [org.apache.hadoop.security.Groups] - Creating new Groups object 2018-04-11 16:23:26,992 DEBUG [org.apache.hadoop.util.NativeCodeLoader] - Trying to load the custom-built native-hadoop library... 2018-04-11 16:23:26,995 DEBUG [org.apache.hadoop.util.NativeCodeLoader] - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path 2018-04-11 16:23:26,995 DEBUG [org.apache.hadoop.util.NativeCodeLoader] - java.library.path=D:\Software\Java\jdk1.8.0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:/Software/Java/jdk1.8.0_66/bin/../jre/bin/server;D:/Software/Java/jdk1.8.0_66/bin/../jre/bin;D:/Software/Java/jdk1.8.0_66/bin/../jre/lib/amd64;D:\Software\Anaconda;D:\Software\Anaconda\Library\mingw-w64\bin;D:\Software\Anaconda\Library\usr\bin;D:\Software\Anaconda\Library\bin;D:\Software\Anaconda\Scripts;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;D:\Software\MySQL Server\bin;D:\Software\CodeBlocks\share\CodeBlocks\MinGW\bin;D:\Software\hadoop2.6.0\hadoop-2.6.0\bin;D:\Software\CTEX\UserData\miktex\bin;D:\Software\CTEX\MiKTeX\miktex\bin;D:\Software\CTEX\CTeX\ctex\bin;D:\Software\CTEX\CTeX\cct\bin;D:\Software\CTEX\CTeX\ty\bin;D:\Software\CTEX\Ghostscript\gs9.05\bin;D:\Software\CTEX\GSview\gsview;D:\Software\CTEX\WinEdt;D:\Software\Java\jdk1.8.0_66\bin;D:\Software\Java\jdk1.8.0_66\jre\bin;C:\Users\Zimo\AppData\Local\Microsoft\WindowsApps;HADOOP_HOME\bin;D:\Software\搜狐影音\5.2.3.15;D:\Software\Java\eclipse;;. 2018-04-11 16:23:26,995 WARN [org.apache.hadoop.util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2018-04-11 16:23:26,997 DEBUG [org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Falling back to shell based 2018-04-11 16:23:27,000 DEBUG [org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping 2018-04-11 16:23:27,166 DEBUG [org.apache.hadoop.security.Groups] - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000 2018-04-11 16:23:27,182 DEBUG [org.apache.hadoop.security.UserGroupInformation] - hadoop login 2018-04-11 16:23:27,184 DEBUG [org.apache.hadoop.security.UserGroupInformation] - hadoop login commit 2018-04-11 16:23:27,201 DEBUG [org.apache.hadoop.security.UserGroupInformation] - using local user:NTUserPrincipal: Zimo 2018-04-11 16:23:27,202 DEBUG [org.apache.hadoop.security.UserGroupInformation] - UGI loginUser:Zimo (auth:SIMPLE) 2018-04-11 16:23:27,395 DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.use.legacy.blockreader.local = false 2018-04-11 16:23:27,395 DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.read.shortcircuit = false 2018-04-11 16:23:27,395 DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.domain.socket.data.traffic = false 2018-04-11 16:23:27,395 DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.domain.socket.path = 2018-04-11 16:23:27,435 DEBUG [org.apache.hadoop.metrics2.impl.MetricsSystemImpl] - StartupProgress, NameNode startup progress 2018-04-11 16:23:27,455 DEBUG [org.apache.hadoop.io.retry.RetryUtils] - multipleLinearRandomRetry = null 2018-04-11 16:23:27,497 DEBUG [org.apache.hadoop.ipc.Server] - rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper, rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@543788f3 2018-04-11 16:23:27,911 DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - Both short-circuit local reads and UNIX domain socket are disabled. 2018-04-11 16:23:27,917 ERROR [org.apache.hadoop.util.Shell] - Failed to locate the winutils binary in the hadoop binary path java.io.IOException: Could not locate executable D:\Software\hadoop2.6.0\hadoop-2.6.0\bin\winutils.exe in the Hadoop binaries. at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:278) at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:300) at org.apache.hadoop.util.Shell.<clinit>(Shell.java:293) at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76) at org.apache.hadoop.conf.Configuration.getTrimmedStrings(Configuration.java:1546) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:519) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:453) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2433) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:88) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2467) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2449) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:367) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:287) at com.hadoop.phoneStatistics.ExcelPhoneStatistics.run(ExcelPhoneStatistics.java:95) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at com.hadoop.phoneStatistics.ExcelPhoneStatistics.main(ExcelPhoneStatistics.java:128) 2018-04-11 16:23:27,975 DEBUG [org.apache.hadoop.ipc.Client] - The ping interval is 60000 ms. 2018-04-11 16:23:27,976 DEBUG [org.apache.hadoop.ipc.Client] - Connecting to master/192.168.86.131:8020
解決方法:java
1.未配置環境變量-->配置環境變量HADOOP_HOME,而後重啓電腦。或者代碼中設置System.setProperty("hadoop.home.dir", "hadoop安裝路徑")。git
2.還有一種可能HADOOP_HOME的bin目錄下根本沒有winutils.exe,下載地址https://github.com/srccodes/hadoop-common-2.2.0-bin而後解壓到該目錄。github
以上就是博主爲你們介紹的這一板塊的主要內容,這都是博主本身的學習過程,但願能給你們帶來必定的指導做用,有用的還望你們點個支持,若是對你沒用也望包涵,有錯誤煩請指出。若有期待可關注博主以第一時間獲取更新哦,謝謝!shell