Azure for deep storage can't produce segment output path.
352 views
Skip to first unread message
Greg Saxton
Oct 17, 2017, 4:58:57 PM10/17/17
to Druid User
Hello!
We have a druid cluster set up and able to write segments locally. We have Azure blob store set up for indexing but Druid can't seem to write segments to azure even though we also have the deep storage configured as well.
Is there anything else we have to configure other than what's detailed here?
http://druid.io/docs/latest/development/extensions-contrib/azure.html
We have a druid cluster set up and able to write segments locally. We have Azure blob store set up for indexing but Druid can't seem to write segments to azure even though we also have the deep storage configured as well.
Is there anything else we have to configure other than what's detailed here?
http://druid.io/docs/latest/development/extensions-contrib/azure.html
What about the druid.indexer.fork.property properties? Do those have any azure specific values they need?
Any insight would be helpful. Thank you.
Below is the full log:
2017-10-17T20:47:51,001 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-10-17T20:47:51,008 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-10-17T20:47:51,052 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-10-17T20:47:51,719 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='hadoop-dependencies/hadoop-client/2.3.0', loadList=[druid-kafka-eight, druid-histogram, druid-datasketches, druid-lookups-cached-global, sqlserver-metadata-storage, druid-azure-extensions, druid-hdfs-storage]}]
2017-10-17T20:47:51,723 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,736 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/kafka-clients-0.8.2.1.jar]
2017-10-17T20:47:51,738 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/metrics-core-2.2.0.jar]
2017-10-17T20:47:51,739 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/druid-kafka-eight-0.10.0.jar]
2017-10-17T20:47:51,739 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/scala-library-2.10.4.jar]
2017-10-17T20:47:51,739 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/snappy-java-1.1.1.6.jar]
2017-10-17T20:47:51,739 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/kafka_2.10-0.8.2.1.jar]
2017-10-17T20:47:51,739 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/zkclient-0.3.jar]
2017-10-17T20:47:51,740 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/jopt-simple-3.2.jar]
2017-10-17T20:47:51,743 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,744 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-histogram/druid-histogram-0.10.0.jar]
2017-10-17T20:47:51,748 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,748 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/druid-datasketches-0.10.0.jar]
2017-10-17T20:47:51,748 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/memory-0.8.4.jar]
2017-10-17T20:47:51,748 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2017-10-17T20:47:51,750 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,750 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.10.0.jar]
2017-10-17T20:47:51,751 INFO [main] io.druid.initialization.Initialization - Loading extension [sqlserver-metadata-storage] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,751 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/sqlserver-metadata-storage/sqlserver-metadata-storage-0.10.1.jar]
2017-10-17T20:47:51,752 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-azure-extensions] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,752 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/azure-storage-6.0.0.jar]
2017-10-17T20:47:51,752 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/druid-azure-extensions-0.10.0.jar]
2017-10-17T20:47:51,753 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/druid-api-0.10.1.jar]
2017-10-17T20:47:51,754 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.cli.CliCommandCreator]
2017-10-17T20:47:51,755 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar]
2017-10-17T20:47:51,755 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-10-17T20:47:51,755 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar]
2017-10-17T20:47:51,755 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-10-17T20:47:51,755 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar]
2017-10-17T20:47:51,759 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar]
2017-10-17T20:47:51,760 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar]
2017-10-17T20:47:51,761 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-10-17T20:47:51,763 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-10-17T20:47:51,763 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-10-17T20:47:51,763 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.0.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-10-17T20:47:51,764 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-10-17T20:47:51,765 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar]
2017-10-17T20:47:51,766 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-10-17T20:47:51,766 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar]
2017-10-17T20:47:51,766 INFO [main] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-10-17T20:47:52,014 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,015 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.firehose.kafka.KafkaEightDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,015 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,017 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,017 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,020 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,021 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,021 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,023 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.server.lookup.namespace.NamespaceExtractionModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,023 INFO [main] io.druid.initialization.Initialization - Loading extension [sqlserver-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,025 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,025 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-azure-extensions] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,026 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.storage.azure.AzureStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,027 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:52,029 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:53,321 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-10-17T20:47:54,267 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.HttpEmitterConfig] from props[druid.emitter.http.] as [io.druid.server.initialization.HttpEmitterConfig@61d34b4]
2017-10-17T20:47:54,352 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@10f19647]
2017-10-17T20:47:54,359 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-10-17T20:47:54,396 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middleManager', host='10.54.52.45', port=8100}]
2017-10-17T20:47:54,576 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-10-17T20:47:54,577 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-10-17T20:47:54,590 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='hadoop-dependencies/hadoop-client/2.3.0', loadList=[druid-kafka-eight, druid-histogram, druid-datasketches, druid-lookups-cached-global, sqlserver-metadata-storage, druid-azure-extensions, druid-hdfs-storage]}]
2017-10-17T20:47:54,595 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@5e519ad3]
2017-10-17T20:47:54,596 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@52d97ab6]
2017-10-17T20:47:54,596 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@30b131b2]
2017-10-17T20:47:54,605 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@121bb45b]
2017-10-17T20:47:54,606 INFO [main] io.druid.cli.CliPeon - Starting up with processors[2], memory[200,802,304].
2017-10-17T20:47:54,607 INFO [main] io.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2017-10-17T20:47:54,607 INFO [main] io.druid.cli.CliPeon - * druid.announcer.maxBytesPerNode: 524288
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.announcer.segmentsPerNode: 50
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.azure.account: druidstream
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.azure.container: druid
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.azure.key: zCMupP/jhPzGA+c41005NvM2Bk4ildopJIAAWn50/UT7nL35/3r3+jaGegx5GuG8+mlzc6LTqKxT4WZHlGXf3Q==
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.azure.maxTries: 3
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.azure.protocol: https
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.expiration: 2147483647
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.initialSize: 500000
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.logEvictionCount: 0
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.maxOperationQueueSize: 1073741824
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.readBufferSize: 10485760
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.sizeInBytes: 10000000
2017-10-17T20:47:54,608 INFO [main] io.druid.cli.CliPeon - * druid.cache.type: local
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.discovery.curator.path: /opt/druid/discovery
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.emitter: http
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.emitter.composing.emitters: ["logging"]
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.emitter.http.recipientBaseUrl: http://127.0.0.1:12345/
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.loggerClass: LoggingEmitter
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.exhibitor.service.pollingMs: 10000
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.exhibitor.service.port: 8080
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.exhibitor.service.restUriPath: /exhibitor/v1/cluster/list
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.extensions.addExtensionsToHadoopContainer: true
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.extensions.directory: extensions
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.extensions.hadoopContainerDruidClasspath: hadoop-dependencies/hadoop-client/2.3.0
2017-10-17T20:47:54,609 INFO [main] io.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: hadoop-dependencies
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-kafka-eight", "druid-histogram", "druid-datasketches", "druid-lookups-cached-global", "sqlserver-metadata-storage", "druid-azure-extensions", "druid-hdfs-storage"]
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.extensions.searchCurrentClassloader: true
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.host: 10.54.52.45
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.processing.buffer.sizeBytes: 256000000
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.processing.numThreads: 1
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.segmentCache.locations: [{"path": "/opt/persistent/zk_druid", "maxSize": 0}]
2017-10-17T20:47:54,610 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.server.http.numThreads: 50
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.storage.storageDirectory: /druid/index/segments
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.fork.property.druid.storage.type: azure
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.container: druid
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.prefix: indexer_logs
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.type: azure
2017-10-17T20:47:54,611 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.javaOpts: -server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.startPort: 8100
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.type: remote
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.server.maxChatRequests: 0
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.storage.recentlyFinishedThreshold: PT24H
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.storage.type: metadata
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseDir: /opt/druid/var/tmp
2017-10-17T20:47:54,612 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: ${druid.indexer.task.baseDir}/persistent/tasks
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultRowFlushBoundary: 75000
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.directoryLockTimeout: PT10M
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.gracefulShutdownTimeout: PT5M
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: /opt/druid/var/druid/hadoop-tmp
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: false
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.javascript.enabled: false
2017-10-17T20:47:54,613 INFO [main] io.druid.cli.CliPeon - * druid.logLevel: debug
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:sqlserver://10.54.49.30;databaseName=DruidMetadata
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.password: <masked>
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.user: app_Druid
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.type: sqlserver
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: wikiticker
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_hadoop_wikiticker_2017-10-17T20:47:49.255Z
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.modules.excludeList: []
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.emissionPeriod: PT1m
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.peon.mode: remote
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.peon.taskActionClient.retry.maxRetryCount: 60
2017-10-17T20:47:54,614 INFO [main] io.druid.cli.CliPeon - * druid.peon.taskActionClient.retry.maxWait: PT1M
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.peon.taskActionClient.retry.minWait: PT5S
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.port: 8100
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 256000000
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.processing.numThreads: 1
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.delegate: none
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.dir: none
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.feed: druid_requests
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.loggerProviders: none
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.queryTimeThresholdMs: 0
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.setContextMDC: false
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.setMDC: false
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.request.logging.type: emitter
2017-10-17T20:47:54,615 INFO [main] io.druid.cli.CliPeon - * druid.segmentCache.locations: [{"path": "/opt/persistent/zk_druid", "maxSize": 0}]
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.server.http.numThreads: 50
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.service: druid/middleManager
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.maskProperties: ["password"]
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.storage.storageDirectory: /druid/index/segments
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.storage.type: azure
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.worker.capacity: 2
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.worker.ip: 10.54.52.45
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.zk.paths.base: /opt/zookeeper1
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.host: 10.54.52.2
2017-10-17T20:47:54,616 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.sessionTimeoutMs: 30000
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * file.encoding: UTF-8
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * file.separator: /
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.class.path: conf-quickstart/druid/_common:conf-quickstart/druid/middleManager:lib/avatica-server-1.9.0.jar:lib/geoip2-0.4.0.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/rhino-1.7R5.jar:lib/druid-sql-0.10.0.jar:lib/jetty-client-9.3.16.v20170120.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/jetty-security-9.3.16.v20170120.jar:lib/druid-api-0.10.0.jar:lib/aggdesigner-algorithm-6.0.jar:lib/jetty-proxy-9.3.16.v20170120.jar:lib/jetty-io-9.3.16.v20170120.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/netty-3.10.4.Final.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/avatica-core-1.9.0.jar:lib/guice-4.1.0.jar:lib/java-util-0.10.0.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/commons-compiler-2.7.6.jar:lib/jboss-logging-3.1.3.GA.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/druid-services-0.10.0.jar:lib/calcite-linq4j-1.11.0.jar:lib/commons-dbcp-1.4.jar:lib/log4j-core-2.5.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/jetty-servlet-9.3.16.v20170120.jar:lib/derby-10.11.1.1.jar:lib/java-util-0.27.4.jar:lib/guice-multibindings-4.1.0.jar:lib/httpclient-4.5.1.jar:lib/compress-lzf-1.0.3.jar:lib/sqljdbc42.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/javax.el-3.0.0.jar:lib/aether-api-0.9.0.M2.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/commons-cli-1.2.jar:lib/icu4j-4.8.1.jar:lib/server-metrics-0.2.8.jar:lib/guava-16.0.1.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/druid-hll-0.10.0.jar:lib/calcite-core-1.11.0.jar:lib/aether-util-0.9.0.M2.jar:lib/mapdb-1.0.8.jar:lib/druid-indexing-service-0.10.0.jar:lib/avatica-1.8.0.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/maven-model-builder-3.1.1.jar:lib/airline-0.7.jar:lib/maven-model-3.1.1.jar:lib/jackson-annotations-2.8.10.jar:lib/jline-0.9.94.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/irc-api-1.0-0014.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/commons-logging-1.1.1.jar:lib/spymemcached-2.11.7.jar:lib/jersey-guice-1.19.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/commons-io-2.4.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/jersey-server-1.19.jar:lib/derbynet-10.11.1.1.jar:lib/commons-lang-2.6.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/jackson-core-2.8.10.jar:lib/antlr4-runtime-4.5.1.jar:lib/log4j-api-2.5.jar:lib/curator-x-discovery-2.11.0.jar:lib/plexus-interpolation-1.19.jar:lib/curator-recipes-2.11.0.jar:lib/janino-2.7.6.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/http-client-1.0.6.jar:lib/jsr305-2.0.1.jar:lib/log4j-jul-2.5.jar:lib/druid-console-0.0.2.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/classmate-1.0.0.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/druid-aws-common-0.10.0.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/commons-codec-1.7.jar:lib/aether-impl-0.9.0.M2.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/jackson-core-asl-1.9.13.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/jackson-databind-2.4.6.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/javax.inject-1.jar:lib/jetty-continuation-9.3.16.v20170120.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/curator-client-2.11.0.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-1.10.21.jar:lib/bcprov-jdk15on-1.52.jar:lib/httpcore-4.4.3.jar:lib/base64-2.3.8.jar:lib/bytebuffer-collections-0.10.0.jar:lib/commons-math3-3.6.1.jar:lib/druid-common-0.10.0.jar:lib/maven-repository-metadata-3.1.1.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/okhttp-1.0.2.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/guice-servlet-4.1.0.jar:lib/joda-time-2.8.2.jar:lib/emitter-0.4.1.jar:lib/jetty-server-9.3.16.v20170120.jar:lib/extendedset-0.10.0.jar:lib/plexus-utils-3.0.15.jar:lib/protobuf-java-3.1.0.jar:lib/jetty-http-9.3.16.v20170120.jar:lib/commons-pool-1.6.jar:lib/jetty-servlets-9.3.16.v20170120.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/disruptor-3.3.0.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/maven-aether-provider-3.1.1.jar:lib/jackson-core-2.4.6.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/slf4j-api-1.6.4.jar:lib/javax.servlet-api-3.1.0.jar:lib/jersey-servlet-1.19.jar:lib/druid-processing-0.10.0.jar:lib/log4j-slf4j-impl-2.5.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/RoaringBitmap-0.5.18.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/log4j-1.2-api-2.5.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/jdbi-2.63.1.jar:lib/jersey-core-1.19.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/fastutil-7.0.13.jar:lib/commons-lang3-3.2.jar:lib/derbyclient-10.11.1.1.jar:lib/maxminddb-0.2.0.jar:lib/jetty-util-9.3.16.v20170120.jar:lib/validation-api-1.1.0.Final.jar:lib/opencsv-2.3.jar:lib/activation-1.1.1.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/druid-indexing-hadoop-0.10.0.jar:lib/zookeeper-3.4.9.jar:lib/jackson-annotations-2.4.6.jar:lib/aopalliance-1.0.jar:lib/druid-server-0.10.0.jar:lib/jets3t-0.9.4.jar:lib/config-magic-0.9.jar:lib/jackson-databind-2.8.10.jar:lib/commons-dbcp2-2.0.1.jar:lib/javax.el-api-3.0.0.jar:lib/maven-settings-builder-3.1.1.jar:lib/commons-pool2-2.2.jar:lib/lz4-1.3.0.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/netty-all-4.1.6.Final.jar:lib/curator-framework-2.11.0.jar:lib/avatica-metrics-1.9.0.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/aether-spi-0.9.0.M2.jar:lib/wagon-provider-api-2.4.jar
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.class.version: 52.0
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.endorsed.dirs: /usr/lib/jvm/java-8-oracle/jre/lib/endorsed
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.ext.dirs: /usr/lib/jvm/java-8-oracle/jre/lib/ext:/usr/java/packages/lib/ext
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.home: /usr/lib/jvm/java-8-oracle/jre
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.io.tmpdir: var/tmp
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-10-17T20:47:54,617 INFO [main] io.druid.cli.CliPeon - * java.runtime.name: Java(TM) SE Runtime Environment
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.runtime.version: 1.8.0_144-b01
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.specification.version: 1.8
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.version: 1.8.0_144
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.vm.info: mixed mode
2017-10-17T20:47:54,618 INFO [main] io.druid.cli.CliPeon - * java.vm.name: Java HotSpot(TM) 64-Bit Server VM
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * java.vm.version: 25.144-b01
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * line.separator:
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: io.druid.common.config.Log4jShutdown
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * os.arch: amd64
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * os.name: Linux
2017-10-17T20:47:54,619 INFO [main] io.druid.cli.CliPeon - * os.version: 4.4.0-97-generic
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * path.separator: :
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.arch.data.model: 64
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.boot.class.path: /usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/classes
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.boot.library.path: /usr/lib/jvm/java-8-oracle/jre/lib/amd64
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.cpu.endian: little
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.cpu.isalist:
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.java.command: io.druid.cli.Main internal peon ${druid.indexer.task.baseDir}/persistent/tasks/index_hadoop_wikiticker_2017-10-17T20:47:49.255Z/task.json ${druid.indexer.task.baseDir}/persistent/tasks/index_hadoop_wikiticker_2017-10-17T20:47:49.255Z/98d4cf6d-2b82-4fae-9c9d-4f43e515bc82/status.json
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2017-10-17T20:47:54,620 INFO [main] io.druid.cli.CliPeon - * sun.os.patch.level: unknown
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.country: US
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.dir: /opt/druid
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.home: /root
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.language: en
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.name: root
2017-10-17T20:47:54,621 INFO [main] io.druid.cli.CliPeon - * user.timezone: UTC
2017-10-17T20:47:54,625 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.storage.hdfs.HdfsKerberosConfig@0]
2017-10-17T20:47:54,634 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@443effcb]
2017-10-17T20:47:54,638 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@69fe0ed4]
2017-10-17T20:47:54,656 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@2a369e14]
2017-10-17T20:47:54,660 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@127a7272]
2017-10-17T20:47:54,665 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@21505815]
2017-10-17T20:47:54,672 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2017-10-17T20:47:54,710 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@70e94ecb]
2017-10-17T20:47:54,912 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@1e1b061]
2017-10-17T20:47:54,918 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.azure.AzureAccountConfig] from props[druid.azure.] as [io.druid.storage.azure.AzureAccountConfig@7426a448]
2017-10-17T20:47:54,953 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@73809e7]
2017-10-17T20:47:54,956 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@35c9a231]
2017-10-17T20:47:54,963 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@3ddeaa5f]
2017-10-17T20:47:54,967 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@47ac613b]
2017-10-17T20:47:54,971 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@f51650d0]
2017-10-17T20:47:54,978 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@1fd9893c]
2017-10-17T20:47:54,980 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@5dc0ff7d]
2017-10-17T20:47:54,983 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@697173d9]
2017-10-17T20:47:54,987 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-10-17T20:47:54,990 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-10-17T20:47:54,990 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-10-17T20:47:54,991 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-10-17T20:47:54,991 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-10-17T20:47:54,991 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-10-17T20:47:54,992 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-10-17T20:47:54,992 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-10-17T20:47:55,300 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@48a663e9]
2017-10-17T20:47:55,306 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@6d08b4e6]
2017-10-17T20:47:55,321 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@32f96bba]
2017-10-17T20:47:55,364 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[256,000,000]
2017-10-17T20:47:55,471 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[256,000,000]
2017-10-17T20:47:55,575 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[256,000,000]
2017-10-17T20:47:55,682 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [io.druid.query.select.SelectQueryConfig@7c663eaf]
2017-10-17T20:47:55,690 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@17e9bc9e]
2017-10-17T20:47:55,706 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@49469ffa]
2017-10-17T20:47:55,721 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@2db1b657]
2017-10-17T20:47:55,730 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=50, maxIdleTime=PT5M}]
2017-10-17T20:47:55,743 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.EmittingRequestLoggerProvider@45ab3bdd]
2017-10-17T20:47:55,750 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2017-10-17T20:47:55,766 INFO [main] org.eclipse.jetty.util.log - Logging initialized @5989ms
2017-10-17T20:47:55,952 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2017-10-17T20:47:55,964 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/opt/zookeeper1/listeners'}]
2017-10-17T20:47:55,980 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@1624775].
2017-10-17T20:47:55,992 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.HttpPostEmitter.start()] on object[com.metamx.emitter.core.HttpPostEmitter@54e43bfe].
2017-10-17T20:47:55,997 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@41d16cc3].
2017-10-17T20:47:55,997 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@662e682a].
2017-10-17T20:47:55,998 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@2e43c38d].
2017-10-17T20:47:56,000 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@3290b1a6].
2017-10-17T20:47:56,001 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@6fcd31c3].
2017-10-17T20:47:56,001 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2017-10-17T20:47:56,001 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=fbddu0479.devxpo.pvt
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_144
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=conf-quickstart/druid/_common:conf-quickstart/druid/middleManager:lib/avatica-server-1.9.0.jar:lib/geoip2-0.4.0.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/rhino-1.7R5.jar:lib/druid-sql-0.10.0.jar:lib/jetty-client-9.3.16.v20170120.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/jetty-security-9.3.16.v20170120.jar:lib/druid-api-0.10.0.jar:lib/aggdesigner-algorithm-6.0.jar:lib/jetty-proxy-9.3.16.v20170120.jar:lib/jetty-io-9.3.16.v20170120.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/netty-3.10.4.Final.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/avatica-core-1.9.0.jar:lib/guice-4.1.0.jar:lib/java-util-0.10.0.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/commons-compiler-2.7.6.jar:lib/jboss-logging-3.1.3.GA.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/druid-services-0.10.0.jar:lib/calcite-linq4j-1.11.0.jar:lib/commons-dbcp-1.4.jar:lib/log4j-core-2.5.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/jetty-servlet-9.3.16.v20170120.jar:lib/derby-10.11.1.1.jar:lib/java-util-0.27.4.jar:lib/guice-multibindings-4.1.0.jar:lib/httpclient-4.5.1.jar:lib/compress-lzf-1.0.3.jar:lib/sqljdbc42.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/javax.el-3.0.0.jar:lib/aether-api-0.9.0.M2.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/commons-cli-1.2.jar:lib/icu4j-4.8.1.jar:lib/server-metrics-0.2.8.jar:lib/guava-16.0.1.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/druid-hll-0.10.0.jar:lib/calcite-core-1.11.0.jar:lib/aether-util-0.9.0.M2.jar:lib/mapdb-1.0.8.jar:lib/druid-indexing-service-0.10.0.jar:lib/avatica-1.8.0.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/maven-model-builder-3.1.1.jar:lib/airline-0.7.jar:lib/maven-model-3.1.1.jar:lib/jackson-annotations-2.8.10.jar:lib/jline-0.9.94.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/irc-api-1.0-0014.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/commons-logging-1.1.1.jar:lib/spymemcached-2.11.7.jar:lib/jersey-guice-1.19.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/commons-io-2.4.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/java-xmlbuilder-1.1.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/jersey-server-1.19.jar:lib/derbynet-10.11.1.1.jar:lib/commons-lang-2.6.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/jackson-core-2.8.10.jar:lib/antlr4-runtime-4.5.1.jar:lib/log4j-api-2.5.jar:lib/curator-x-discovery-2.11.0.jar:lib/plexus-interpolation-1.19.jar:lib/curator-recipes-2.11.0.jar:lib/janino-2.7.6.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/http-client-1.0.6.jar:lib/jsr305-2.0.1.jar:lib/log4j-jul-2.5.jar:lib/druid-console-0.0.2.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/classmate-1.0.0.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/druid-aws-common-0.10.0.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/commons-codec-1.7.jar:lib/aether-impl-0.9.0.M2.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/jackson-core-asl-1.9.13.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/jackson-databind-2.4.6.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/javax.inject-1.jar:lib/jetty-continuation-9.3.16.v20170120.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/curator-client-2.11.0.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-1.10.21.jar:lib/bcprov-jdk15on-1.52.jar:lib/httpcore-4.4.3.jar:lib/base64-2.3.8.jar:lib/bytebuffer-collections-0.10.0.jar:lib/commons-math3-3.6.1.jar:lib/druid-common-0.10.0.jar:lib/maven-repository-metadata-3.1.1.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/okhttp-1.0.2.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/guice-servlet-4.1.0.jar:lib/joda-time-2.8.2.jar:lib/emitter-0.4.1.jar:lib/jetty-server-9.3.16.v20170120.jar:lib/extendedset-0.10.0.jar:lib/plexus-utils-3.0.15.jar:lib/protobuf-java-3.1.0.jar:lib/jetty-http-9.3.16.v20170120.jar:lib/commons-pool-1.6.jar:lib/jetty-servlets-9.3.16.v20170120.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/disruptor-3.3.0.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/maven-aether-provider-3.1.1.jar:lib/jackson-core-2.4.6.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/slf4j-api-1.6.4.jar:lib/javax.servlet-api-3.1.0.jar:lib/jersey-servlet-1.19.jar:lib/druid-processing-0.10.0.jar:lib/log4j-slf4j-impl-2.5.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/RoaringBitmap-0.5.18.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/log4j-1.2-api-2.5.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/jdbi-2.63.1.jar:lib/jersey-core-1.19.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/fastutil-7.0.13.jar:lib/commons-lang3-3.2.jar:lib/derbyclient-10.11.1.1.jar:lib/maxminddb-0.2.0.jar:lib/jetty-util-9.3.16.v20170120.jar:lib/validation-api-1.1.0.Final.jar:lib/opencsv-2.3.jar:lib/activation-1.1.1.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/druid-indexing-hadoop-0.10.0.jar:lib/zookeeper-3.4.9.jar:lib/jackson-annotations-2.4.6.jar:lib/aopalliance-1.0.jar:lib/druid-server-0.10.0.jar:lib/jets3t-0.9.4.jar:lib/config-magic-0.9.jar:lib/jackson-databind-2.8.10.jar:lib/commons-dbcp2-2.0.1.jar:lib/javax.el-api-3.0.0.jar:lib/maven-settings-builder-3.1.1.jar:lib/commons-pool2-2.2.jar:lib/lz4-1.3.0.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/netty-all-4.1.6.Final.jar:lib/curator-framework-2.11.0.jar:lib/avatica-metrics-1.9.0.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/aether-spi-0.9.0.M2.jar:lib/wagon-provider-api-2.4.jar
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-10-17T20:47:56,014 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-10-17T20:47:56,015 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-10-17T20:47:56,015 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.4.0-97-generic
2017-10-17T20:47:56,015 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2017-10-17T20:47:56,015 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2017-10-17T20:47:56,015 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt/druid
2017-10-17T20:47:56,016 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.54.52.2 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@314a31b0
2017-10-17T20:47:56,047 INFO [main-SendThread(10.54.52.2:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.54.52.2/10.54.52.2:2181. Will not attempt to authenticate using SASL (unknown error)
2017-10-17T20:47:56,055 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@750a04ec].
2017-10-17T20:47:56,064 INFO [main-SendThread(10.54.52.2:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 10.54.52.2/10.54.52.2:2181, initiating session
2017-10-17T20:47:56,078 INFO [main-SendThread(10.54.52.2:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.54.52.2/10.54.52.2:2181, sessionid = 0x15f114d7489006a, negotiated timeout = 30000
2017-10-17T20:47:56,084 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2017-10-17T20:47:56,213 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@76d7881e].
2017-10-17T20:47:56,214 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@4aa31ffc].
2017-10-17T20:47:56,224 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5482bcac].
2017-10-17T20:47:56,326 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_wikiticker_2017-10-17T20:47:49.255Z",
"spec" : {
"dataSchema" : {
"dataSource" : "wikiticker",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "json",
"dimensionsSpec" : {
"dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ]
},
"timestampSpec" : {
"format" : "auto",
"column" : "time"
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "added",
"fieldName" : "added",
"expression" : null
}, {
"type" : "longSum",
"name" : "deleted",
"fieldName" : "deleted",
"expression" : null
}, {
"type" : "longSum",
"name" : "delta",
"fieldName" : "delta",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "user_unique",
"fieldName" : "user",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "quickstart/wikiticker-2015-09-12-sampled.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2017-10-17T20:47:49.235Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "f7fe74ed86374692903b51e7ae84de30"
},
"hadoopDependencyCoordinates" : null,
"classpathPrefix" : null,
"context" : null,
"groupId" : "index_hadoop_wikiticker_2017-10-17T20:47:49.255Z",
"dataSource" : "wikiticker",
"resource" : {
"availabilityGroup" : "index_hadoop_wikiticker_2017-10-17T20:47:49.255Z",
"requiredCapacity" : 1
}
}
2017-10-17T20:47:56,328 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[${druid.indexer.task.baseDir}/persistent/tasks/index_hadoop_wikiticker_2017-10-17T20:47:49.255Z/lock].
2017-10-17T20:47:56,329 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[${druid.indexer.task.baseDir}/persistent/tasks/index_hadoop_wikiticker_2017-10-17T20:47:49.255Z/lock] in 1ms.
2017-10-17T20:47:56,334 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_wikiticker_2017-10-17T20:47:49.255Z]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2017-10-17T20:47:56,349 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_wikiticker_2017-10-17T20:47:49.255Z] to overlord[http://10.54.52.44:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2017-10-17T20:47:56,361 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,414 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,417 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,418 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,420 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,421 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,421 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,422 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,422 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,423 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,426 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,427 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,427 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,428 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,429 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,429 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,432 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,432 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,433 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,436 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://10.54.52.44:8090
2017-10-17T20:47:56,525 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_wikiticker_2017-10-17T20:47:49.255Z
2017-10-17T20:47:56,526 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-10-17T20:47:49.255Z] location changed to [TaskLocation{host='10.54.52.45', port=8100}].
2017-10-17T20:47:56,526 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-10-17T20:47:49.255Z] status changed to [RUNNING].
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jackson-core-asl-1.8.8.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-digester-1.8.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/servlet-api-2.5.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-codec-1.4.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-auth-2.3.0.jar]
2017-10-17T20:47:56,530 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/log4j-1.2.17.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/xz-1.0.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-httpclient-3.1.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/stax-api-1.0-2.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-cli-1.2.jar]
2017-10-17T20:47:56,531 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jetty-util-6.1.26.jar]
2017-10-17T20:47:56,532 INFO [main] org.eclipse.jetty.server.Server - jetty-9.3.16.v20170120
2017-10-17T20:47:56,539 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/httpcore-4.2.5.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jackson-mapper-asl-1.8.8.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-collections-3.2.1.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jersey-core-1.9.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-api-2.3.0.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-io-2.4.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/httpclient-4.2.5.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-configuration-1.6.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-lang-2.6.jar]
2017-10-17T20:47:56,540 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/paranamer-2.3.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-core-1.8.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/snappy-java-1.0.4.1.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-net-3.1.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-hdfs-2.3.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/activation-1.1.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-common-2.3.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-1.7.0.jar]
2017-10-17T20:47:56,541 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/slf4j-api-1.7.5.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/guava-11.0.2.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/avro-1.7.4.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jaxb-api-2.2.2.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-common-2.3.0.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-annotations-2.3.0.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-compress-1.4.1.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2017-10-17T20:47:56,542 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-math3-3.1.1.jar]
2017-10-17T20:47:56,543 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/xmlenc-0.52.jar]
2017-10-17T20:47:56,543 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/jsr305-1.3.9.jar]
2017-10-17T20:47:56,543 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/protobuf-java-2.5.0.jar]
2017-10-17T20:47:56,543 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/commons-logging-1.1.3.jar]
2017-10-17T20:47:56,543 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/zookeeper-3.4.5.jar]
2017-10-17T20:47:56,544 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopTask - Hadoop Container Druid Classpath is set to [file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/druid/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/druid/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2017-10-17T20:47:56,918 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2017-10-17T20:47:56,919 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2017-10-17T20:47:56,919 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2017-10-17T20:47:56,919 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class
2017-10-17T20:47:56,922 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
2017-10-17T20:47:57,063 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2017-10-17T20:47:57,066 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-10-17T20:47:57,100 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-10-17 20:47:57,242 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17 20:47:57,254 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17 20:47:57,309 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17 20:47:57,311 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17 20:47:57,332 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17 20:47:57,334 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:292)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2017-10-17T20:47:57,827 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2017-10-17T20:47:57,846 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2017-10-17T20:47:57,865 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2017-10-17T20:47:57,867 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2017-10-17T20:47:57,881 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2017-10-17T20:47:57,884 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2017-10-17T20:47:57,910 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-10-17T20:47:57,921 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-10-17T20:47:57,954 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@3b4ef59f{/,null,AVAILABLE}
2017-10-17T20:47:57,985 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@3e14d390{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-10-17T20:47:57,986 INFO [main] org.eclipse.jetty.server.Server - Started @8209ms
2017-10-17T20:47:57,986 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@5eb87338].
2017-10-17T20:47:57,986 INFO [main] io.druid.query.lookup.LookupReferencesManager - Started lookup factory references manager
2017-10-17T20:47:57,987 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@2b999ee8].
2017-10-17T20:47:58,006 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-10-17T20:47:58,026 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/opt/zookeeper1/listeners/lookups/__default/10.54.52.45:8100]
2017-10-17T20:47:58,031 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@93bf0e0].
2017-10-17T20:47:58,032 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='10.54.52.45:8100', host='10.54.52.45:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/opt/zookeeper1/announcements/10.54.52.45:8100]
2017-10-17T20:47:58,783 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='hadoop-dependencies/hadoop-client/2.3.0', loadList=[druid-kafka-eight, druid-histogram, druid-datasketches, druid-lookups-cached-global, sqlserver-metadata-storage, druid-azure-extensions, druid-hdfs-storage]}]
2017-10-17T20:47:58,784 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.firehose.kafka.KafkaEightDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,786 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,788 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,789 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,791 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.server.lookup.namespace.NamespaceExtractionModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,792 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.metadata.storage.sqlserver.SQLServerMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,793 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.storage.azure.AzureStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,795 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,795 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,808 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/kafka-clients-0.8.2.1.jar]
2017-10-17T20:47:58,811 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/metrics-core-2.2.0.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/druid-kafka-eight-0.10.0.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/scala-library-2.10.4.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/snappy-java-1.1.1.6.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/kafka_2.10-0.8.2.1.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/zkclient-0.3.jar]
2017-10-17T20:47:58,812 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-kafka-eight/jopt-simple-3.2.jar]
2017-10-17T20:47:58,815 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,816 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-histogram/druid-histogram-0.10.0.jar]
2017-10-17T20:47:58,817 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,818 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/druid-datasketches-0.10.0.jar]
2017-10-17T20:47:58,818 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/memory-0.8.4.jar]
2017-10-17T20:47:58,818 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2017-10-17T20:47:58,820 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,820 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.10.0.jar]
2017-10-17T20:47:58,822 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [sqlserver-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,822 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/sqlserver-metadata-storage/sqlserver-metadata-storage-0.10.1.jar]
2017-10-17T20:47:58,824 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-azure-extensions] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,824 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/azure-storage-6.0.0.jar]
2017-10-17T20:47:58,824 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/druid-azure-extensions-0.10.0.jar]
2017-10-17T20:47:58,825 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-azure-extensions/druid-api-0.10.1.jar]
2017-10-17T20:47:58,827 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-10-17T20:47:58,828 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar]
2017-10-17T20:47:58,828 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-10-17T20:47:58,828 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar]
2017-10-17T20:47:58,828 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-10-17T20:47:58,828 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar]
2017-10-17T20:47:58,829 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.0.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar]
2017-10-17T20:47:58,830 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-10-17T20:47:58,831 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar]
2017-10-17T20:47:58,832 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-10-17T20:47:58,832 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar]
2017-10-17T20:47:58,832 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/opt/druid/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-10-17T20:47:59,536 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-10-17T20:48:00,480 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.HttpEmitterConfig] from props[druid.emitter.http.] as [io.druid.server.initialization.HttpEmitterConfig@62a018cb]
2017-10-17T20:48:00,553 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@30642001]
2017-10-17T20:48:00,560 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-10-17T20:48:00,565 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@62c171b4]
2017-10-17T20:48:00,566 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@589bc69e]
2017-10-17T20:48:00,566 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@51c24559]
2017-10-17T20:48:00,571 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [256000000] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-10-17T20:48:00,574 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [1] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-10-17T20:48:00,574 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-10-17T20:48:00,576 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-10-17T20:48:00,576 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-10-17T20:48:00,576 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-10-17T20:48:00,576 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-10-17T20:48:00,577 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-10-17T20:48:00,711 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2017-10-17T20:48:00,884 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-10-17T20:48:00,885 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-10-17T20:48:00,896 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='hadoop-dependencies/hadoop-client/2.3.0', loadList=[druid-kafka-eight, druid-histogram, druid-datasketches, druid-lookups-cached-global, sqlserver-metadata-storage, druid-azure-extensions, druid-hdfs-storage]}]
2017-10-17T20:48:00,897 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2017-10-17T20:48:00,933 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/wikiticker-2015-09-12-sampled.json]
2017-10-17T20:48:00,966 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/wikiticker-2015-09-12-sampled.json]
2017-10-17T20:48:01,046 INFO [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.session-id
2017-10-17T20:48:01,047 INFO [task-runner-0-priority-0] org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId=
2017-10-17T20:48:01,147 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2017-10-17T20:48:01,154 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-10-17T20:48:01,176 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2017-10-17T20:48:01,247 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-10-17T20:48:01,396 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_local1672044949_0001
2017-10-17T20:48:01,429 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/staging/root1672044949/.staging/job_local1672044949_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2017-10-17T20:48:01,429 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/staging/root1672044949/.staging/job_local1672044949_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2017-10-17T20:48:01,548 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local1672044949_0001/job_local1672044949_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
2017-10-17T20:48:01,549 WARN [task-runner-0-priority-0] org.apache.hadoop.conf.Configuration - file:/tmp/hadoop-root/mapred/local/localRunner/root/job_local1672044949_0001/job_local1672044949_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
2017-10-17T20:48:01,556 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://localhost:8080/
2017-10-17T20:48:01,556 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job wikiticker-determine_partitions_hashed-Optional.of([2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z]) submitted, status available at: http://localhost:8080/
2017-10-17T20:48:01,557 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_local1672044949_0001
2017-10-17T20:48:01,570 INFO [Thread-64] org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter set in config null
2017-10-17T20:48:01,583 INFO [Thread-64] org.apache.hadoop.mapred.LocalJobRunner - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2017-10-17T20:48:01,664 INFO [Thread-64] org.apache.hadoop.mapred.LocalJobRunner - Waiting for map tasks
2017-10-17T20:48:01,665 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.LocalJobRunner - Starting task: attempt_local1672044949_0001_m_000000_0
2017-10-17T20:48:01,720 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.Task - Using ResourceCalculatorProcessTree : [ ]
2017-10-17T20:48:01,724 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Processing split: file:/opt/druid/quickstart/wikiticker-2015-09-12-sampled.json:0+17106256
2017-10-17T20:48:01,739 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer
2017-10-17T20:48:01,777 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - (EQUATOR) 0 kvi 26214396(104857584)
2017-10-17T20:48:01,777 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - mapreduce.task.io.sort.mb: 100
2017-10-17T20:48:01,777 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - soft limit at 83886080
2017-10-17T20:48:01,777 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - bufstart = 0; bufvoid = 104857600
2017-10-17T20:48:01,777 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - kvstart = 26214396; length = 6553600
2017-10-17T20:48:01,823 INFO [LocalJobRunner Map Task Executor #0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "wikiticker",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "json",
"dimensionsSpec" : {
"dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ]
},
"timestampSpec" : {
"format" : "auto",
"column" : "time"
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "added",
"fieldName" : "added",
"expression" : null
}, {
"type" : "longSum",
"name" : "deleted",
"fieldName" : "deleted",
"expression" : null
}, {
"type" : "longSum",
"name" : "delta",
"fieldName" : "delta",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "user_unique",
"fieldName" : "user",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "quickstart/wikiticker-2015-09-12-sampled.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "/opt/druid/var/druid/hadoop-tmp",
"version" : "2017-10-17T20:47:49.235Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : { },
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false
},
"uniqueId" : "f7fe74ed86374692903b51e7ae84de30"
}
}
2017-10-17T20:48:01,901 INFO [LocalJobRunner Map Task Executor #0] org.apache.hadoop.mapred.MapTask - Starting flush of map output
2017-10-17T20:48:01,918 INFO [Thread-64] org.apache.hadoop.mapred.LocalJobRunner - map task executor complete.
2017-10-17T20:48:01,919 WARN [Thread-64] org.apache.hadoop.mapred.LocalJobRunner - job_local1672044949_0001
java.lang.Exception: java.lang.NullPointerException: segmentOutputPath
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) ~[hadoop-mapreduce-client-common-2.3.0.jar:?]
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) [hadoop-mapreduce-client-common-2.3.0.jar:?]
Caused by: java.lang.NullPointerException: segmentOutputPath
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) ~[guava-16.0.1.jar:?]
at io.druid.indexer.HadoopDruidIndexerConfig.verify(HadoopDruidIndexerConfig.java:592) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.HadoopDruidIndexerConfig.fromConfiguration(HadoopDruidIndexerConfig.java:212) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.HadoopDruidIndexerMapper.setup(HadoopDruidIndexerMapper.java:48) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper.setup(DetermineHashedPartitionsJob.java:224) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper.run(DetermineHashedPartitionsJob.java:282) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) ~[hadoop-mapreduce-client-core-2.3.0.jar:?]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) ~[hadoop-mapreduce-client-core-2.3.0.jar:?]
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) ~[hadoop-mapreduce-client-common-2.3.0.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_144]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_144]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_144]
2017-10-17T20:48:02,559 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_local1672044949_0001 running in uber mode : false
2017-10-17T20:48:02,561 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-10-17T20:48:02,563 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_local1672044949_0001 failed with state FAILED due to: NA
2017-10-17T20:48:02,571 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Counters: 0
2017-10-17T20:48:02,571 ERROR [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job failed: job_local1672044949_0001
2017-10-17T20:48:02,571 INFO [task-runner-0-priority-0] io.druid.indexer.JobHelper - Deleting path[/opt/druid/var/druid/hadoop-tmp/wikiticker/2017-10-17T204749.235Z_f7fe74ed86374692903b51e7ae84de30]
2017-10-17T20:48:02,592 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_wikiticker_2017-10-17T20:47:49.255Z, type=index_hadoop, dataSource=wikiticker}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:211) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:176) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.10.0.jar:0.10.0]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.10.0.jar:0.10.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_144]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_144]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_144]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_144]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_144]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_144]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208) ~[druid-indexing-service-0.10.0.jar:0.10.0]
... 7 more
Caused by: io.druid.java.util.common.ISE: Job[class io.druid.indexer.DetermineHashedPartitionsJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.10.0.jar:0.10.0]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:306) ~[druid-indexing-service-0.10.0.jar:0.10.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_144]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_144]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_144]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_144]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:208) ~[druid-indexing-service-0.10.0.jar:0.10.0]
... 7 more
2017-10-17T20:48:02,602 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-10-17T20:47:49.255Z] status changed to [FAILED].
2017-10-17T20:48:02,607 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_wikiticker_2017-10-17T20:47:49.255Z",
"status" : "FAILED",
"duration" : 6077
}
2017-10-17T20:48:02,614 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@93bf0e0].
2017-10-17T20:48:02,614 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@f51650d0]
2017-10-17T20:48:02,614 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/opt/zookeeper1/announcements/10.54.52.45:8100]
2017-10-17T20:48:02,638 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@2b999ee8].
2017-10-17T20:48:02,639 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/opt/zookeeper1/listeners/lookups/__default/10.54.52.45:8100]
2017-10-17T20:48:02,643 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/opt/zookeeper1/listeners/lookups/__default/10.54.52.45:8100]
2017-10-17T20:48:02,643 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@5eb87338].
2017-10-17T20:48:02,643 INFO [main] io.druid.query.lookup.LookupReferencesManager - Stopping lookup factory references manager
2017-10-17T20:48:02,647 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@3e14d390{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-10-17T20:48:02,649 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@3b4ef59f{/,null,UNAVAILABLE}
2017-10-17T20:48:02,660 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5482bcac].
2017-10-17T20:48:02,660 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@6b9c42bd].
2017-10-17T20:48:02,661 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@4aa31ffc].
2017-10-17T20:48:02,665 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@76d7881e].
2017-10-17T20:48:02,667 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@750a04ec].
2017-10-17T20:48:02,667 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2017-10-17T20:48:02,669 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2017-10-17T20:48:02,672 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x15f114d7489006a closed
2017-10-17T20:48:02,672 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15f114d7489006a
2017-10-17T20:48:02,673 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@6fcd31c3].
2017-10-17T20:48:02,727 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.stop()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@3290b1a6].
2017-10-17T20:48:02,727 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@2e43c38d].
2017-10-17T20:48:02,727 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@662e682a].
2017-10-17T20:48:02,729 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@41d16cc3].
Jonathan Wei
Oct 17, 2017, 7:13:30 PM10/17/17
to druid...@googlegroups.com
Hi Greg,
The segmentOutputPath is set by the "getPathForHadoop()" method of a DataSegmentPusher implementation, it looks like the Azure extension never worked with hadoop batch ingestion since it returns null for that method:
...
[Message clipped]
Reply all
Reply to author
Forward
0 new messages