Druid ingestion Incremental persist failed

17 views
Skip to first unread message

Vivek P. Netha

unread,
Oct 8, 2021, 5:38:58 PMOct 8
to Druid User

Druid ingestion runs fine when maxNumConcurrentSubTasks is not specified, meaning single-threaded mode. But fails with error below when maxNumConcurrentSubTasks=2. Could someone please advise how to resolve?

Druid version used is 0.20.0
All the components are containerized using Docker and running on local machine.

2021-10-08T00:51:59,272 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Exception while running task[AbstractTask{id=‘single_phase_sub_task_master_order_event_ckonplme_2021-10-08T00:51:28.490Z’, groupId=‘i
ndex_parallel_master_order_event_inchjjih_2021-10-08T00:45:27.591Z’, taskResource=TaskResource{availabilityGroup=‘single_phase_sub_task_master_order_event_ckonplme_2021-10-08T00:51:28.490Z’, requiredCapacity=1}, dataSource=‘master_order_event’, context={
forceTimeChunkLock=true}}]
org.apache.druid.java.util.common.ISE: Failed to shutdown executors during close()
at org.apache.druid.segment.realtime.appenderator.AppenderatorImpl.closeNow(AppenderatorImpl.java:925) ~[druid-server-0.20.0.jar:0.20.0]
at org.apache.druid.indexing.common.task.batch.parallel.SinglePhaseSubTask.generateAndPushSegments(SinglePhaseSubTask.java:396) ~[druid-indexing-service-0.20.0.jar:0.20.0]
at org.apache.druid.indexing.common.task.batch.parallel.SinglePhaseSubTask.runTask(SinglePhaseSubTask.java:193) ~[druid-indexing-service-0.20.0.jar:0.20.0]
at org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:140) ~[druid-indexing-service-0.20.0.jar:0.20.0]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:451) [druid-indexing-service-0.20.0.jar:0.20.0]
at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:423) [druid-indexing-service-0.20.0.jar:0.20.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
2021-10-08T00:51:59,354 ERROR [[single_phase_sub_task_master_order_event_ckonplme_2021-10-08T00:51:28.490Z]-appenderator-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Incremental persist failed: {class=org.apache.druid.segmen
t.realtime.appenderator.AppenderatorImpl, segment=master_order_event_2021-10-01T00:00:00.000Z_2021-10-02T00:00:00.000Z_2021-10-08T00:46:05.379Z_5, dataSource=master_order_event, count=0}
2021-10-08T00:51:59,354 INFO [task-runner-0-priority-0] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
“id” : “single_phase_sub_task_master_order_event_ckonplme_2021-10-08T00:51:28.490Z”,
“status” : “FAILED”,
“duration” : 15282,
“errorMsg” : “org.apache.druid.java.util.common.ISE: Failed to shutdown executors during close()”,
“location” : {
“host” : null,
“port” : -1,
“tlsPort” : -1
}
}

Reply all
Reply to author
Forward
0 new messages