hadoop about "Container does not exist."

場景描述：

hadoop集羣中正在運行的任務，點擊「application_1438756578740_5947」連接，而後能看到ApplicationMaters信息，有N個Node節點在運行，而後點擊任一個Node的logs連接，會報錯以下：「Container does not exist.」

hadoop jira上貌似是2.3的一個bug，2.4fix了

added comment in ContainerLogsUtils.getContainerLogDirs() as below.
"It is not required to have null check for container ( container == null ) and throw back exception.Because when container is completed, NodeManager remove container information from its NMContext.Configuring log aggregation to false, container log view request is forwarded to NM. NM does not have completed container information,but still NM serve request forreading container logs."

https://issues.apache.org/jira/browse/YARN-1206
PS: 通過測試，當我啓動日誌聚合功能（log aggregation to true）,而後再啓動 hadoop history server（端口是19888）進程，就不會再報「Container does not exist.」

以前也遇到這個問題

Failed redirect for container_1412602970010_0037_01_000002
Failed while trying to construct the redirect url to the log server. Log Server url may not be configured
Container does not exist.
但在yarn-site.xml下增長以下內容：

<property> 
<name>yarn.log.server.url</name> 
<value>http://hnn002.dev.com:19888/jobhistory/logs/</value> 
</property>

by default logs from hdfs://user/history/* are not accessible through JobHistory server.
When I changed the permission on hdfs://user/history/
hadoop fs -chmod -R 777 /user/history/

參考連接：
https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/HBGzj_NG9_s
https://issues.apache.org/jira/browse/YARN-1206

尊重原創，未經容許不得轉載：
http://blog.csdn.net/stark_summer/article/details/47616773

版權聲明：本文爲博主原創文章，未經博主容許不得轉載。