storm on yarn(CDH5) 部署筆記

按照storm on yarn(Apache hadoop)部署好以後，而後修改HADOOP_HOME,hadoopenv.sh中的JAVA_HOME,以及storm-yarn-master中pom.xml的hadoop version

啓動順序依次爲：

hdfs：start-dfs.sh

yarn:start-yarn.sh

zookeeper:zkServer.sh start

storm

nimbus:storm nimbus

UI：storm ui   #localhost:8080

supervisor:storm supervisor    若是有從節點的話

提交storm任務：

　　storm-yarn launch storm.yaml

存儲storm.yaml文件到.storm，這樣使用storm命令提交jobs時，會找到該文件  ---個人這一步出錯，可是在apache hadoop下成功了

　　storm-yarn getStormConfig -appId application_1381089732797_0025 -output ~/.storm/storm.yaml

提交Topology

　　storm jar lib/storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology WordCountTopology -c nimbus.host=<your nimbus host>

監控Topology

　　查看Storm ui，地址是：http://<your nimbus host>:8080

關閉Topology

　　storm kill [Topology_name] 

關閉Storm on yarn集羣

　　storm-yarn shutdown –appId [applicationId]

致謝：http://blog.csdn.net/m_vptr/article/details/9962613

 

錯誤：15/07/19 00:31:46 INFO yarn.StormOnYarn: application report for application_1437236195968_0001 :N/A:-115/07/19 00:31:46 INFO yarn.StormOnYarn: Attaching to N/A:-1 to talk to app master application_1437236195968_0001Exception in thread "main" java.lang.IllegalArgumentException: invalid port: -1待解決