realtime ingestion task fail
exitna
Hi:
I using tranquility for realtime ingestion, but, why the ingestion task failed?
The task log is:
2015-11-08T14:16:56,835 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:16:56,835 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:16:56,841 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Connecting firehose: tranquility:firehose:one-16-0000-0000
2015-11-08T14:16:56,848 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Found chathandler of class[io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider]
2015-11-08T14:16:56,849 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[tranquility:firehose:one-16-0000-0000]
2015-11-08T14:16:56,854 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='tranquility:firehose:one-16-0000-0000', host='localhost', port=8100}]
2015-11-08T14:16:56,926 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[one-16-0000-0000]
2015-11-08T14:16:56,926 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='one-16-0000-0000', host='localhost', port=8100}]
2015-11-08T14:16:56,967 INFO [task-runner-0] io.druid.data.input.FirehoseFactory - Firehose created, will shut down at: 2015-11-08T14:23:00.000Z
2015-11-08T14:17:02,548 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0]: LockAcquireAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:17:02,551 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0] to overlord[http://localhost:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:17:02,720 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0]: LockAcquireAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:17:02,721 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0] to overlord[http://localhost:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:17:02,802 INFO [task-runner-0] io.druid.server.coordination.BatchDataSegmentAnnouncer - Announcing segment[one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z] at path[/druid/segments/localhost:8100/localhost:8100_realtime__default_tier_2015-11-08T14:17:02.798Z_e565e49084904a26a63e355cf34eba860]
2015-11-08T14:18:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:18:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:18:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:18:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:19:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:19:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:19:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:19:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:20:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:20:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:20:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:20:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:21:00,015 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:21:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:21:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:21:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:22:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:22:00,016 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:22:00,017 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:22:00,017 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:23:00,002 INFO [timed-shutoff-firehose-0] io.druid.data.input.FirehoseFactory - Closing delegate firehose.
2015-11-08T14:23:00,002 INFO [timed-shutoff-firehose-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Firehose closing.
2015-11-08T14:23:00,003 INFO [timed-shutoff-firehose-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Unregistering chat handler[tranquility:firehose:one-16-0000-0000]
2015-11-08T14:23:00,003 INFO [timed-shutoff-firehose-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Unannouncing service[DruidNode{serviceName='tranquility:firehose:one-16-0000-0000', host='localhost', port=8100}]
2015-11-08T14:23:00,017 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push.
2015-11-08T14:23:00,018 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [1] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z].
2015-11-08T14:23:00,018 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Skipping persist and merge for entry [1446992160000=Sink{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z, schema=io.druid.segment.indexing.DataSchema@2ee6ed45}] : Start time [2015-11-08T14:16:00.000Z] >= [1970-01-01T00:00:00.000Z] min timestamp required in this run. Segment will be picked up in a future run.
2015-11-08T14:23:00,019 INFO [one-overseer-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge
2015-11-08T14:23:00,252 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Submitting persist runnable for dataSource[one]
2015-11-08T14:23:00,293 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Shutting down...
2015-11-08T14:23:00,296 INFO [one-incremental-persist] io.druid.segment.realtime.plumber.RealtimePlumber - DataSource[one], Interval[2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z], persisting Hydrant[FireHydrant{index=io.druid.segment.incremental.OnheapIncrementalIndex@738e472f, queryable=io.druid.segment.ReferenceCountingSegment@7d49a72e, count=0}]
2015-11-08T14:23:00,306 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Cannot shut down yet! Sinks remaining: one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z
2015-11-08T14:23:00,357 INFO [one-incremental-persist] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2015-11-08T14:23:00,366 INFO [one-incremental-persist] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2015-11-08T14:23:00,400 INFO [one-incremental-persist] io.druid.segment.IndexMerger - Starting persist for interval[2015-11-08T14:16:00.000Z/2015-11-08T14:16:40.254Z], rows[1]
2015-11-08T14:23:00,487 INFO [one-incremental-persist] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0/v8-tmp] completed index.drd in 11 millis.
2015-11-08T14:23:00,545 INFO [one-incremental-persist] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0/v8-tmp] completed dim conversions in 58 millis.
2015-11-08T14:23:00,629 INFO [one-incremental-persist] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0/v8-tmp] completed walk through of 1 rows in 84 millis.
2015-11-08T14:23:00,633 INFO [one-incremental-persist] io.druid.segment.IndexMerger - Starting dimension[vendor_id] with cardinality[1]
2015-11-08T14:23:00,653 INFO [one-incremental-persist] io.druid.segment.IndexMerger - Completed dimension[vendor_id] in 21 millis.
2015-11-08T14:23:00,654 INFO [one-incremental-persist] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0/v8-tmp] completed inverted.drd in 22 millis.
2015-11-08T14:23:00,672 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0/v8-tmp] to v9[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/0]
2015-11-08T14:23:00,676 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_vendor_id.drd]
2015-11-08T14:23:00,684 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[vendor_id] is single value, converting...
2015-11-08T14:23:00,733 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
2015-11-08T14:23:00,736 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
2015-11-08T14:23:00,736 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_pv_LITTLE_ENDIAN.drd]
2015-11-08T14:23:00,746 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
2015-11-08T14:23:00,746 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
2015-11-08T14:23:00,749 INFO [one-incremental-persist] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
2015-11-08T14:23:00,806 INFO [one-incremental-persist] io.druid.segment.ReferenceCountingSegment - Closing one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z
2015-11-08T14:23:00,807 INFO [one-incremental-persist] io.druid.segment.ReferenceCountingSegment - Closing one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z, numReferences: 0
2015-11-08T14:23:00,808 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.realtime.plumber.RealtimePlumber - Adding hydrant[FireHydrant{index=null, queryable=io.druid.segment.ReferenceCountingSegment@12a8fd36, count=0}]
2015-11-08T14:23:00,825 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged/v8-tmp] completed index.drd in 1 millis.
2015-11-08T14:23:00,829 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged/v8-tmp] completed dim conversions in 4 millis.
2015-11-08T14:23:00,865 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[1]
2015-11-08T14:23:00,871 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[2]
2015-11-08T14:23:00,872 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.CompressedPools - Allocating new littleEndByteBuf[3]
2015-11-08T14:23:00,877 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged/v8-tmp] completed walk through of 1 rows in 47 millis.
2015-11-08T14:23:00,877 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - Starting dimension[vendor_id] with cardinality[1]
2015-11-08T14:23:00,894 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - Completed dimension[vendor_id] in 17 millis.
2015-11-08T14:23:00,894 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged/v8-tmp] completed inverted.drd in 17 millis.
2015-11-08T14:23:00,899 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged/v8-tmp] to v9[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged]
2015-11-08T14:23:00,900 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_vendor_id.drd]
2015-11-08T14:23:00,901 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[vendor_id] is single value, converting...
2015-11-08T14:23:00,904 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
2015-11-08T14:23:00,904 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
2015-11-08T14:23:00,905 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_pv_LITTLE_ENDIAN.drd]
2015-11-08T14:23:00,905 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
2015-11-08T14:23:00,905 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
2015-11-08T14:23:00,908 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
2015-11-08T14:23:00,912 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.loading.LocalDataSegmentPusher - Copying segment[one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z] to local filesystem at location[/home/mark/app/druid-0.8.1/data/localStorage/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/2015-11-08T14:17:02.594Z/0]
2015-11-08T14:23:00,930 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.loading.LocalDataSegmentPusher - Compressing files from[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/merged] to [/home/mark/app/druid-0.8.1/data/localStorage/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/2015-11-08T14:17:02.594Z/0/index.zip]
2015-11-08T14:23:00,951 ERROR [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.realtime.plumber.RealtimePlumber - Failed to persist merged index[one]: {class=io.druid.segment.realtime.plumber.RealtimePlumber, exceptionType=class java.io.FileNotFoundException, exceptionMessage=/home/mark/app/druid-0.8.1/data/localStorage/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/2015-11-08T14:17:02.594Z/0/index.zip (没有那个文件或目录), interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
java.io.FileNotFoundException: /home/mark/app/druid-0.8.1/data/localStorage/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z/2015-11-08T14:17:02.594Z/0/index.zip (没有那个文件或目录)
at java.io.FileOutputStream.open0(Native Method) ~[?:1.8.0_66]
at java.io.FileOutputStream.open(FileOutputStream.java:270) ~[?:1.8.0_66]
at java.io.FileOutputStream.<init>(FileOutputStream.java:213) ~[?:1.8.0_66]
at java.io.FileOutputStream.<init>(FileOutputStream.java:162) ~[?:1.8.0_66]
at com.metamx.common.CompressionUtils.zip(CompressionUtils.java:68) ~[java-util-0.27.0.jar:?]
at io.druid.segment.loading.LocalDataSegmentPusher.push(LocalDataSegmentPusher.java:84) ~[druid-server-0.8.1.jar:0.8.1]
at io.druid.segment.realtime.plumber.RealtimePlumber$4.doRun(RealtimePlumber.java:454) [druid-server-0.8.1.jar:0.8.1]
at io.druid.common.guava.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:40) [druid-common-0.8.1.jar:0.8.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_66]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_66]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66]
2015-11-08T14:23:00,980 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.server.coordination.BatchDataSegmentAnnouncer - Unannouncing segment[one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z] at path[/druid/segments/localhost:8100/localhost:8100_realtime__default_tier_2015-11-08T14:17:02.798Z_e565e49084904a26a63e355cf34eba860]
2015-11-08T14:23:00,980 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.curator.announcement.Announcer - unannouncing [/druid/segments/localhost:8100/localhost:8100_realtime__default_tier_2015-11-08T14:17:02.798Z_e565e49084904a26a63e355cf34eba860]
2015-11-08T14:23:01,022 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0]: LockReleaseAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:23:01,027 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_one_2015-11-08T14:16:00.000Z_0_0] to overlord[http://localhost:8090/druid/indexer/v1/action]: LockReleaseAction{interval=2015-11-08T14:16:00.000Z/2015-11-08T14:17:00.000Z}
2015-11-08T14:23:01,028 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8090
2015-11-08T14:23:01,049 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.realtime.plumber.RealtimePlumber - Deleting Index File[/tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work/persist/one/2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z]
2015-11-08T14:23:01,049 INFO [one-2015-11-08T14:16:00.000Z-persist-n-merge] io.druid.segment.realtime.plumber.RealtimePlumber - Removing sinkKey 1446992160000 for segment one_2015-11-08T14:16:00.000Z_2015-11-08T14:17:00.000Z_2015-11-08T14:17:02.594Z
2015-11-08T14:23:01,052 ERROR [task-runner-0] io.druid.indexing.common.task.RealtimeIndexTask - Failed to finish realtime task: {class=io.druid.indexing.common.task.RealtimeIndexTask, exceptionType=class com.metamx.common.ISE, exceptionMessage=Exception occurred during persist and merge.}
com.metamx.common.ISE: Exception occurred during persist and merge.
at io.druid.segment.realtime.plumber.RealtimePlumber.finishJob(RealtimePlumber.java:532) ~[druid-server-0.8.1.jar:0.8.1]
at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:342) [druid-indexing-service-0.8.1.jar:0.8.1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:235) [druid-indexing-service-0.8.1.jar:0.8.1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:214) [druid-indexing-service-0.8.1.jar:0.8.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_66]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_66]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_66]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66]
2015-11-08T14:23:01,054 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Removing task directory: /tmp/persistent/task/index_realtime_one_2015-11-08T14:16:00.000Z_0_0/work
2015-11-08T14:23:01,057 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_realtime_one_2015-11-08T14:16:00.000Z_0_0",
"status" : "SUCCESS",
"duration" : 364685
}
2015-11-08T14:23:01,067 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@6d8796c1].
2015-11-08T14:23:01,067 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@58d3f4be]
2015-11-08T14:23:01,067 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/localhost:8100]
2015-11-08T14:23:01,072 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@51dae791].
2015-11-08T14:23:01,085 INFO [ServerInventoryView-0] io.druid.client.BatchServerInventoryView - Server Disappeared[DruidServerMetadata{name='localhost:8100', host='localhost:8100', maxSize=0, tier='_default_tier', type='realtime', priority='0'}]
2015-11-08T14:23:01,101 INFO [main] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@2f74900b{HTTP/1.1}{0.0.0.0:8100}
2015-11-08T14:23:01,107 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@24eeac69{/,null,UNAVAILABLE}
2015-11-08T14:23:01,124 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@448b808a].
2015-11-08T14:23:01,124 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.client.ServerInventoryView.stop() throws java.io.IOException] on object[io.druid.client.BatchServerInventoryView@7e7f0216].
2015-11-08T14:23:01,124 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@53ec2968].
2015-11-08T14:23:01,125 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@278667fd].
2015-11-08T14:23:01,138 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2015-11-08T14:23:01,146 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2015-11-08T14:23:01,148 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x150e5e0380f0019 closed
2015-11-08T14:23:01,149 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@4cdb8504].
2015-11-08T14:23:01,176 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@6fc29daa].
2015-11-08T14:23:01,177 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@a565cbd].
2015-11-08T14:23:01,177 INFO [main] io.druid.cli.CliPeon - Finished peon task
Gian Merlino
--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/563F5CAB.FBDBF4.29838%40m12-13.163.com.
For more options, visit https://groups.google.com/d/optout.