druid Transaction failure publishing segments, aborting

一、任務日誌:

WARN  IndexerSQLMetadataStorageCoordinator:97 - Cannot allocate new segment for dataSource[useractive], 
				interval[2018-02-19T00:00:00.000Z/2018-02-26T00:00:00.000Z], maxVersion[2018-02-24T08:59:16.832Z]: 
				conflicting segment[useractive_2018-02-19T00:00:00.000Z_2018-02-20T00:00:00.000Z_2018-02-24T06:30:53.746Z_11].

二、任務日誌:

2018-02-26 17:17:17 3474 [task-runner-0-priority-0] ERROR ThreadPoolTaskRunner:121 - Exception while running task[KafkaIndexTask{id=index_kafka_useractive_480e1352143ca85_fajmniii, type=index_kafka, dataSource=useractive}]
io.druid.java.util.common.ISE: Transaction failure publishing segments, aborting
        at io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:589) ~[?:?]
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.11.0.jar:0.11.0]
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.11.0.jar:0.11.0]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_71]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_71]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_71]
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO  TaskRunnerUtils:69 - Task [index_kafka_useractive_480e1352143ca85_fajmniii] status changed to [FAILED].
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO  ExecutorLifecycle:69 - Task completed with status: {
  "id" : "index_kafka_useractive_480e1352143ca85_fajmniii",
  "status" : "FAILED",
  "duration" : 597848

解析

  • 一、druid_pendingSegments 中對應的時間段存在衝突
  • 二、查看overlord日誌,標識 中存在 Not updating metadata, existing state is not the expected start state ,這是因爲修改topic 致使校驗異常,刪除druid_dataSource 對應的 數據便可

異常會致使,segment hand off 失敗,沒法保留數據 緣由:druid_pendingSegments 中對應的時間段存在衝突 解決方案:清理 druid_pendingSegments 對應的時間段java

相關文章
相關標籤/搜索