Spark java+scala項目打包(jar)

1.法1:maven打包
pom.xml文件java

<plugins>
            <plugin>
                <artifactId>maven-assembly-plugin</artifactId>
                <configuration>
                    <appendAssemblyId>false</appendAssemblyId>
                    <descriptorRefs>
                        <descriptorRef>jar-with-dependencies</descriptorRef>
                    </descriptorRefs>
                    <archive>
                        <manifest>
                            <!-- 此處指定main方法入口的class -->                      <mainClass>ch.kmeans2.SparkStreamingKMeansKafkaExample</mainClass>
                        </manifest>
                    </archive>
                </configuration>
                <executions>
                    <execution>
                        <id>make-assembly</id>
                        <phase>package</phase>
                        <goals>
                            <goal>assembly</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>
            <plugin>
                <groupId>org.scala-tools</groupId>
                <artifactId>maven-scala-plugin</artifactId>
                <version>2.15.2</version>
                <executions>
                    <execution>
                        <id>scala-compile-first</id>
                        <goals>
                            <goal>compile</goal>
                        </goals>
                        <configuration>
                            <includes>
                                <include>**/*.scala</include>
                            </includes>
                        </configuration>
                    </execution>
                    <execution>
                        <id>scala-test-compile</id>
                        <goals>
                            <goal>testCompile</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>
        </plugins>

而後使用mvn clean package命令進行打包,若是提交到集羣運行遇到Exception in thread "main" java.lang.AbstractMethodError,考慮項目中spark的版本和集羣運行版本是否一直
2.法2:idea打包
Project->Module Setting->Artifacts
圖片.png
圖片.png
圖片.png
而後Build Artifact輸出jar包app

相關文章
相關標籤/搜索