spark提交任務到集羣

參考：http://spark.apache.org/docs/latest/submitting-applications.html

 

 

#Run on a Spark standalone cluster in client deploy mode(運行集羣模式，客戶端發佈模式)

spark-submit \
  --class org.apache.spark.examples.SparkPi \
  --master spark://207.184.161.138:7077 \
  --executor-memory 20G \
  --total-executor-cores 100 \
  /path/to/examples.jar \
  1000

如採用：Run on a Spark standalone cluster in cluster deploy mode with supervise（發佈模式爲集羣，則jar包，每一個worker都要有此jar 包）