spark利用yarn提交任務報:YARN application has exited unexpectedly with state UNDEFINED

spark用yarn提交任務會報
ERROR cluster.YarnClientSchedulerBackend: YARN application has exited unexpectedly with state UNDEFINED! Check the YARN application logs for more details.
ERROR cluster.YarnClientSchedulerBackend: Diagnostics message: Shutdown hook called before final status was reported.java

只須要將hadoop集羣的yarn-site.xml配置中加入以下兩行便可解決:node

<property>
    <name>yarn.nodemanager.pmem-check-enabled</name>
    <value>false</value>
</property>
<property>
    <name>yarn.nodemanager.vmem-check-enabled</name>
    <value>false</value>
</property>app

若是你用的java8,則多會報此錯誤。oop

相關文章
相關標籤/搜索