Hadoop YARN: 1/1 local-dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir; 1/1 log-dirs are

1 /1 local - dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir ; 1 /1 log- dirs are bad: /var/log/hadoop-yarn/containers

 

yarn-rm-unhealty

Node Manager logs

1
2
3
yarn.server.nodemanager.DirectoryCollection: Directory /var/lib/hadoop-yarn/cache/yarn/nm-local-dir error, used space above threshold of 90.0%, removing from list of valid directories
2014-11-17 17:45:00,713 WARN org.apache.hadoop.yarn.server.nodemanager.DirectoryCollection: Directory /var/log/hadoop-yarn/containers error, used space above threshold of 90.0%, removing from list of valid directories
2014-11-17 17:45:00,713 INFO org.apache.hadoop.yarn.server.nodemanager.LocalDirsHandlerService: Disk(s) failed: 1 /1 local - dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir ; 1 /1 log- dirs are bad: /var/log/hadoop

 

Resource Manager logs

1
2014-11-17 16:57:07,301 INFO org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeImpl: Node localhost:34650 reported UNHEALTHY with details: 1 /1 local - dirs are bad: /var/lib/hadoop-yarn/cache/yarn/nm-local-dir ; 1 /1 log- dirs are bad: /var/log/hadoop-yarn/containers
 
 
 
 

 

 

遇到上面這樣的問題,個人解決辦法是:node

 

 

在yarn-site.xml 裏面配置apache

yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage
95.0bash

 

重啓yarn便可解決!oop

 

yarn-daemon.sh stop nodemanagerspa

yarn-daemon.sh start nodemanagercode

相關文章
相關標籤/搜索