flume 1.7 源碼導入eclipse windows

  • 安裝maven,設置MAVEN_HOME等配置
  • 下載flume源碼
  • eclipse-oxygen,設置eclipse 使用外部maven,並配置settings.xml
  • shell mvn clean install -DskipTests -Dmaven.test.skip=true
  • 遇到問題:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ....................................... SUCCESS [  7.379 s]
[INFO] Flume NG SDK ....................................... SUCCESS [  5.782 s]
[INFO] Flume NG Configuration ............................. SUCCESS [  2.031 s]
[INFO] Flume Auth ......................................... SUCCESS [  5.672 s]
[INFO] Flume NG Core ...................................... SUCCESS [  8.823 s]
[INFO] Flume NG Sinks ..................................... SUCCESS [  0.227 s]
[INFO] Flume NG HDFS Sink ................................. SUCCESS [  2.950 s]
[INFO] Flume NG IRC Sink .................................. SUCCESS [  1.329 s]
[INFO] Flume NG Channels .................................. SUCCESS [  0.158 s]
[INFO] Flume NG JDBC channel .............................. SUCCESS [  2.076 s]
[INFO] Flume NG file-based channel ........................ SUCCESS [  4.922 s]
[INFO] Flume NG Spillable Memory channel .................. SUCCESS [  1.562 s]
[INFO] Flume NG Node ...................................... SUCCESS [  2.766 s]
[INFO] Flume NG Embedded Agent ............................ SUCCESS [  1.610 s]
[INFO] Flume NG HBase Sink ................................ SUCCESS [  4.669 s]
[INFO] Flume NG ElasticSearch Sink ........................ SUCCESS [  3.568 s]
[INFO] Flume NG Morphline Solr Sink ....................... FAILURE [ 15.589 s]
[INFO] Flume Shared Utils ................................. SKIPPED
[INFO] Flume Shared Kafka Test Utils ...................... SKIPPED
[INFO] Flume Kafka Sink ................................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ......................... SKIPPED
[INFO] Flume NG Hive Sink ................................. SKIPPED
[INFO] Flume Sources ...................................... SKIPPED
[INFO] Flume Scribe Source ................................ SKIPPED
[INFO] Flume JMS Source ................................... SKIPPED
[INFO] Flume Twitter Source ............................... SKIPPED
[INFO] Flume Kafka Source ................................. SKIPPED
[INFO] Flume Taildir Source ............................... SKIPPED
[INFO] flume-kafka-channel ................................ SKIPPED
[INFO] Flume legacy Sources ............................... SKIPPED
[INFO] Flume legacy Avro source ........................... SKIPPED
[INFO] Flume legacy Thrift Source ......................... SKIPPED
[INFO] Flume NG Clients ................................... SKIPPED
[INFO] Flume NG Log4j Appender ............................ SKIPPED
[INFO] Flume NG Tools ..................................... SKIPPED
[INFO] Flume NG distribution .............................. SKIPPED
[INFO] Flume NG Integration Tests ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:17 min
[INFO] Finished at: 2017-10-31T15:56:38+08:00
[INFO] Final Memory: 154M/528M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flume-ng-morphline-solr-sink: Could no
t resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-morp
hline-solr-sink:jar:1.7.0: Failed to collect dependencies at org.kitesdk:kite-mo
rphlines-all:pom:1.0.0 -> org.kitesdk:kite-morphlines-useragent:jar:1.0.0 -> ua_
parser:ua-parser:jar:1.3.0: Failed to read artifact descriptor for ua_parser:ua-
parser:jar:1.3.0: Could not transfer artifact ua_parser:ua-parser:pom:1.3.0 from
/to maven-twttr (http://maven.twttr.com): maven.twttr.com: Unknown host maven.tw
ttr.com -> [Help 1]
# hosts中加入以下映射
199.16.156.89 maven.twttr.com

若是順利,已將所需jar都下載下來了。java

# 從existing maven project 導入成 eclipse 項目
# 探測到須要m2e插件,安裝便可

導入後遇到以下問題git

舉例:flume-avro-source 項目其中一個錯誤以下:
AvroFlumeOGEvent cannot be resolved to a type
/flume-avro-source/src/main/java/org/apache/flume/source/avroLegacy/AvroLegacySource.java

舉例:
在flume-avro-source項目中,target目錄下是空的。
由於報錯的這些找不到的類是須要經過avro生成的。
在flume-avro-source項目上,右鍵run as -> maven generate-source ,運行以後,target目錄下多了幾個java文件。target\avro 目錄設置爲 source便可。

按順序 將其餘兩個項目作相同操做便可:flume-ng-sdk、flume-ng-core

flume 1.8按照此方法也能夠導入github

相關文章
相關標籤/搜索