Error when running Hadoop indexing Quickstart demo
151 views
Skip to first unread message
Yuewen Wang
Jul 20, 2017, 6:16:25 AM7/20/17
to Druid User
Hi,
We have set up a small druid cluster of 3 nodes combined with a Hadoop cluster 2.7.3 of 3 nodes.
While I am trying the Quickstart demo, I got an error running the hadoop indexing task:{ "type" : "index_hadoop", "spec" : { "ioConfig" : { "type" : "hadoop", "inputSpec" : { "type" : "static", "paths" : "/tmp/druid/wikiticker-2015-09-12-sampled.json" } }, "dataSchema" : { "dataSource" : "wikiticker", "granularitySpec" : { "type" : "uniform", "segmentGranularity" : "day", "queryGranularity" : "none", "intervals" : ["2015-09-12/2015-09-13"] }, "parser" : { "type" : "hadoopyString", "parseSpec" : { "format" : "json", "dimensionsSpec" : { "dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ] }, "timestampSpec" : { "format" : "auto", "column" : "time" } } }, "metricsSpec" : [ { "name" : "count", "type" : "count" }, { "name" : "added", "type" : "longSum", "fieldName" : "added" }, { "name" : "deleted", "type" : "longSum", "fieldName" : "deleted" }, { "name" : "delta", "type" : "longSum", "fieldName" : "delta" }, { "name" : "user_unique", "type" : "hyperUnique", "fieldName" : "user" } ] }, "tuningConfig" : { "type" : "hadoop", "partitionsSpec" : { "type" : "hashed", "targetPartitionSize" : 5000000 }, "jobProperties" : { "mapreduce.job.user.classpath.first": "true" } } }, "hadoopDependencyCoordinates":["org.apache.hadoop:hadoop-client:2.7.3"]}
And below is my log:
2017-07-20T10:01:20,125 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-07-20T10:01:20,127 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-07-20T10:01:20,159 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-07-20T10:01:20,683 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-kafka-eight, druid-hdfs-storage, druid-histogram, druid-datasketches, druid-lookups-cached-global, mysql-metadata-storage, druid-kafka-indexing-service]}]
2017-07-20T10:01:20,686 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,698 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/druid-kafka-eight-0.10.1-rc1.jar]
2017-07-20T10:01:20,698 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka-clients-0.8.2.1.jar]
2017-07-20T10:01:20,698 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/jopt-simple-3.2.jar]
2017-07-20T10:01:20,699 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/snappy-java-1.1.1.6.jar]
2017-07-20T10:01:20,699 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka_2.10-0.8.2.1.jar]
2017-07-20T10:01:20,699 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/zkclient-0.3.jar]
2017-07-20T10:01:20,699 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/metrics-core-2.2.0.jar]
2017-07-20T10:01:20,699 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/scala-library-2.10.4.jar]
2017-07-20T10:01:20,702 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,703 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-07-20T10:01:20,703 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar]
2017-07-20T10:01:20,703 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jersey-client-1.9.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-client-2.7.3.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar]
2017-07-20T10:01:20,704 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpclient-4.5.3.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-codec-1.7.jar]
2017-07-20T10:01:20,705 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1-rc1.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-client-2.11.0.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpcore-4.4.6.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.jar]
2017-07-20T10:01:20,706 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar]
2017-07-20T10:01:20,707 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.jar]
2017-07-20T10:01:20,708 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/gson-2.2.4.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/aws-java-sdk-1.7.4.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.jar]
2017-07-20T10:01:20,709 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/joda-time-2.9.9.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jsp-api-2.1.jar]
2017-07-20T10:01:20,710 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar]
2017-07-20T10:01:20,711 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-07-20T10:01:20,711 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar]
2017-07-20T10:01:20,711 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-07-20T10:01:20,711 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.jar]
2017-07-20T10:01:20,711 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar]
2017-07-20T10:01:20,712 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-common-2.7.3.jar]
2017-07-20T10:01:20,728 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,729 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-histogram/druid-histogram-0.10.1-rc1.jar]
2017-07-20T10:01:20,729 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,730 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/memory-0.8.4.jar]
2017-07-20T10:01:20,730 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/druid-datasketches-0.10.1-rc1.jar]
2017-07-20T10:01:20,730 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2017-07-20T10:01:20,731 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,731 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.10.1-rc1.jar]
2017-07-20T10:01:20,732 INFO [main] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,732 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-metadata-storage-0.10.1-rc1.jar]
2017-07-20T10:01:20,732 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar]
2017-07-20T10:01:20,733 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.cli.CliCommandCreator]
2017-07-20T10:01:20,733 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar]
2017-07-20T10:01:20,734 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1-rc1.jar]
2017-07-20T10:01:20,734 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2017-07-20T10:01:20,734 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar]
2017-07-20T10:01:20,734 INFO [main] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2017-07-20T10:01:20,922 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,924 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.firehose.kafka.KafkaEightDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,924 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,926 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,926 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,928 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,928 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,931 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,932 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,932 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,934 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.server.lookup.namespace.NamespaceExtractionModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,934 INFO [main] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,935 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,936 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:20,937 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:22,298 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-07-20T10:01:24,341 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-07-20T10:01:24,428 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@6aa7b67f]
2017-07-20T10:01:24,443 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-07-20T10:01:24,485 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middleManager', host='druidbroker2', port=8100}]
2017-07-20T10:01:24,722 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-07-20T10:01:24,722 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-07-20T10:01:24,734 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-kafka-eight, druid-hdfs-storage, druid-histogram, druid-datasketches, druid-lookups-cached-global, mysql-metadata-storage, druid-kafka-indexing-service]}]
2017-07-20T10:01:24,738 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@57ddd45b]
2017-07-20T10:01:24,739 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@3596b249]
2017-07-20T10:01:24,740 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@642a16aa]
2017-07-20T10:01:24,748 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@2eda072]
2017-07-20T10:01:24,748 INFO [main] io.druid.cli.CliPeon - Starting up with processors[2], memory[181,403,648], maxMemory[1,908,932,608].
2017-07-20T10:01:24,749 INFO [main] io.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2017-07-20T10:01:24,749 INFO [main] io.druid.cli.CliPeon - * druid.emitter: logging
2017-07-20T10:01:24,749 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2017-07-20T10:01:24,749 INFO [main] io.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-kafka-eight", "druid-hdfs-storage", "druid-histogram", "druid-datasketches", "druid-lookups-cached-global", "mysql-metadata-storage", "druid-kafka-indexing-service"]
2017-07-20T10:01:24,749 INFO [main] io.druid.cli.CliPeon - * druid.host: druidbroker2
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.directory: /tmp/druid/indexing-logs
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.javaOpts: -server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: /tmp/druid/task
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.7.3"]
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: /tmp/druid/indexing
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:mysql://192.168.1.26:13307/druid
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.password: <masked>
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.user: root
2017-07-20T10:01:24,750 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.type: mysql
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: wikiticker
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_hadoop_wikiticker_2017-07-20T10:01:19.196Z
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.port: 8100
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 134217728
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.processing.numThreads: 2
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.server.http.numThreads: 10
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.service: druid/middleManager
2017-07-20T10:01:24,751 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * druid.storage.storageDirectory: /tmp/druid/segments
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * druid.storage.type: hdfs
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * druid.worker.capacity: 3
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.host: 192.168.1.35,192.168.1.36,192.168.1.37
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * file.encoding: UTF-8
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * file.separator: /
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2017-07-20T10:01:24,752 INFO [main] io.druid.cli.CliPeon - * java.class.path: conf/druid/_common:conf/druid/middleManager:lib/compress-lzf-1.0.3.jar:lib/jetty-util-9.3.19.v20170502.jar:lib/druid-sql-0.10.1-rc1.jar:lib/guice-servlet-4.1.0.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/bcprov-jdk15on-1.52.jar:lib/RoaringBitmap-0.5.18.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aopalliance-1.0.jar:lib/maven-model-builder-3.1.1.jar:lib/irc-api-1.0-0014.jar:lib/jetty-servlets-9.3.19.v20170502.jar:lib/aws-java-sdk-ec2-1.10.77.jar:lib/plexus-utils-3.0.15.jar:lib/commons-logging-1.1.1.jar:lib/calcite-linq4j-1.11.0.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/jsr311-api-1.1.1.jar:lib/jline-0.9.94.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-continuation-9.3.19.v20170502.jar:lib/http-client-1.1.0.jar:lib/httpclient-4.5.3.jar:lib/aether-util-0.9.0.M2.jar:lib/airline-0.7.jar:lib/jetty-io-9.3.19.v20170502.jar:lib/asm-5.2.jar:lib/commons-cli-1.2.jar:lib/druid-indexing-service-0.10.1-rc1.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/commons-codec-1.7.jar:lib/druid-api-0.10.1-rc1.jar:lib/log4j-api-2.5.jar:lib/antlr4-runtime-4.5.1.jar:lib/jboss-logging-3.1.3.GA.jar:lib/asm-commons-5.2.jar:lib/jetty-proxy-9.3.19.v20170502.jar:lib/derbynet-10.11.1.1.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/curator-client-2.11.0.jar:lib/java-util-0.28.2.jar:lib/httpcore-4.4.6.jar:lib/jsr305-2.0.1.jar:lib/maven-model-3.1.1.jar:lib/commons-lang3-3.2.jar:lib/disruptor-3.3.6.jar:lib/javax.el-api-3.0.0.jar:lib/jdbi-2.63.1.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-core-1.10.77.jar:lib/netty-3.10.6.Final.jar:lib/jackson-databind-2.4.6.jar:lib/commons-io-2.5.jar:lib/commons-lang-2.6.jar:lib/opencsv-2.3.jar:lib/bytebuffer-collections-0.10.1-rc1.jar:lib/base64-2.3.8.jar:lib/jackson-dataformat-cbor-2.5.3.jar:lib/calcite-core-1.11.0.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/guava-16.0.1.jar:lib/server-metrics-0.2.8.jar:lib/validation-api-1.1.0.Final.jar:lib/commons-math3-3.6.1.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/maven-repository-metadata-3.1.1.jar:lib/druid-common-0.10.1-rc1.jar:lib/druid-processing-0.10.1-rc1.jar:lib/commons-pool-1.6.jar:lib/javax.inject-1.jar:lib/asm-tree-5.2.jar:lib/activation-1.1.1.jar:lib/derby-10.11.1.1.jar:lib/slf4j-api-1.6.4.jar:lib/geoip2-0.4.0.jar:lib/jersey-core-1.19.3.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/jetty-server-9.3.19.v20170502.jar:lib/jetty-http-9.3.19.v20170502.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/maven-settings-builder-3.1.1.jar:lib/jersey-server-1.19.3.jar:lib/curator-framework-2.11.0.jar:lib/jersey-guice-1.19.3.jar:lib/druid-console-0.0.2.jar:lib/aether-api-0.9.0.M2.jar:lib/jackson-core-asl-1.9.13.jar:lib/commons-pool2-2.2.jar:lib/aether-spi-0.9.0.M2.jar:lib/commons-compiler-2.7.6.jar:lib/aether-impl-0.9.0.M2.jar:lib/lz4-1.3.0.jar:lib/jetty-security-9.3.19.v20170502.jar:lib/classmate-1.0.0.jar:lib/maven-settings-3.1.1.jar:lib/protobuf-java-3.1.0.jar:lib/joda-time-2.9.9.jar:lib/plexus-interpolation-1.19.jar:lib/curator-x-discovery-2.11.0.jar:lib/curator-recipes-2.11.0.jar:lib/mapdb-1.0.8.jar:lib/maven-aether-provider-3.1.1.jar:lib/extendedset-0.10.1-rc1.jar:lib/icu4j-54.1.1.jar:lib/okhttp-1.0.2.jar:lib/emitter-0.4.5.jar:lib/jersey-servlet-1.19.3.jar:lib/druid-hll-0.10.1-rc1.jar:lib/druid-indexing-hadoop-0.10.1-rc1.jar:lib/jets3t-0.9.4.jar:lib/wagon-provider-api-2.4.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/config-magic-0.9.jar:lib/zookeeper-3.4.10.jar:lib/log4j-jul-2.5.jar:lib/fastutil-7.2.0.jar:lib/guice-multibindings-4.1.0.jar:lib/guice-4.1.0.jar:lib/log4j-slf4j-impl-2.5.jar:lib/log4j-core-2.5.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/netty-all-4.1.11.Final.jar:lib/commons-dbcp2-2.0.1.jar:lib/druid-aws-common-0.10.1-rc1.jar:lib/janino-2.7.6.jar:lib/commons-dbcp-1.4.jar:lib/avatica-metrics-1.9.0.jar:lib/javax.el-3.0.0.jar:lib/jetty-client-9.3.19.v20170502.jar:lib/json-path-2.1.0.jar:lib/rhino-1.7R5.jar:lib/java-util-0.10.1-rc1.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/avatica-server-1.9.0.jar:lib/avatica-core-1.9.0.jar:lib/javax.servlet-api-3.1.0.jar:lib/druid-services-0.10.1-rc1.jar:lib/spymemcached-2.12.3.jar:lib/java-xmlbuilder-1.1.jar:lib/aggdesigner-algorithm-6.0.jar:lib/jackson-core-2.4.6.jar:lib/jetty-servlet-9.3.19.v20170502.jar:lib/druid-server-0.10.1-rc1.jar:lib/jackson-annotations-2.4.6.jar:lib/log4j-1.2-api-2.5.jar:lib/derbyclient-10.11.1.1.jar
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.class.version: 52.0
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.endorsed.dirs: /usr/java/jdk1.8.0_101/jre/lib/endorsed
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.ext.dirs: /usr/java/jdk1.8.0_101/jre/lib/ext:/usr/java/packages/lib/ext
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.home: /usr/java/jdk1.8.0_101/jre
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.io.tmpdir: /tmp
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.runtime.name: Java(TM) SE Runtime Environment
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.runtime.version: 1.8.0_101-b13
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2017-07-20T10:01:24,753 INFO [main] io.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.specification.version: 1.8
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.version: 1.8.0_101
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vm.info: mixed mode
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vm.name: Java HotSpot(TM) 64-Bit Server VM
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2017-07-20T10:01:24,754 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * java.vm.version: 25.101-b13
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * line.separator:
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: io.druid.common.config.Log4jShutdown
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * os.arch: amd64
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * os.name: Linux
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * os.version: 2.6.32-642.el6.x86_64
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * path.separator: :
2017-07-20T10:01:24,755 INFO [main] io.druid.cli.CliPeon - * sun.arch.data.model: 64
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.boot.class.path: /usr/java/jdk1.8.0_101/jre/lib/resources.jar:/usr/java/jdk1.8.0_101/jre/lib/rt.jar:/usr/java/jdk1.8.0_101/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_101/jre/lib/jsse.jar:/usr/java/jdk1.8.0_101/jre/lib/jce.jar:/usr/java/jdk1.8.0_101/jre/lib/charsets.jar:/usr/java/jdk1.8.0_101/jre/lib/jfr.jar:/usr/java/jdk1.8.0_101/jre/classes
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.boot.library.path: /usr/java/jdk1.8.0_101/jre/lib/amd64
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.cpu.endian: little
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.cpu.isalist:
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.java.command: io.druid.cli.Main internal peon /tmp/druid/task/index_hadoop_wikiticker_2017-07-20T10:01:19.196Z/task.json /tmp/druid/task/index_hadoop_wikiticker_2017-07-20T10:01:19.196Z/a407ed83-6cd7-4375-9328-b3df948e61d9/status.json
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2017-07-20T10:01:24,756 INFO [main] io.druid.cli.CliPeon - * sun.os.patch.level: unknown
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.country: CN
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.country.format: US
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.dir: /root/druid-0.10.1
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.home: /root
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.language: zh
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.language.format: en
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.name: root
2017-07-20T10:01:24,757 INFO [main] io.druid.cli.CliPeon - * user.timezone: UTC
2017-07-20T10:01:24,768 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.storage.hdfs.HdfsKerberosConfig@0]
2017-07-20T10:01:24,785 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@7df28f1]
2017-07-20T10:01:24,793 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@f1266c6]
2017-07-20T10:01:24,886 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@4099209b]
2017-07-20T10:01:24,895 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@5e230fc6]
2017-07-20T10:01:24,902 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [io.druid.curator.ExhibitorConfig@29fe4840]
2017-07-20T10:01:24,909 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2017-07-20T10:01:24,943 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@2accaec2]
2017-07-20T10:01:24,974 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@738d37fc]
2017-07-20T10:01:24,978 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@45117dd]
2017-07-20T10:01:24,985 INFO [main] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2017-07-20T10:01:24,990 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@5ff6dd3c]
2017-07-20T10:01:25,001 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@64b70f41]
2017-07-20T10:01:25,008 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@1ca610a0]
2017-07-20T10:01:25,015 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2017-07-20T10:01:25,030 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@58fd1214]
2017-07-20T10:01:25,034 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@704067c6]
2017-07-20T10:01:25,038 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@412c5e8b]
2017-07-20T10:01:25,043 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [134217728] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-07-20T10:01:25,045 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-07-20T10:01:25,045 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-07-20T10:01:25,047 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-07-20T10:01:25,048 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-07-20T10:01:25,048 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-07-20T10:01:25,048 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-07-20T10:01:25,049 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-07-20T10:01:25,157 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@7d42404e]
2017-07-20T10:01:25,167 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@51d0ec6f]
2017-07-20T10:01:25,178 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [GroupByQueryConfig{defaultStrategy='v2', singleThreaded=false, maxIntermediateRows=50000, maxResults=500000, bufferGrouperMaxSize=2147483647, bufferGrouperMaxLoadFactor=0.0, bufferGrouperInitialBuckets=0, maxMergingDictionarySize=100000000, maxOnDiskStorage=0}]
2017-07-20T10:01:25,210 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[134,217,728]
2017-07-20T10:01:25,237 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[134,217,728]
2017-07-20T10:01:25,266 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[134,217,728]
2017-07-20T10:01:25,291 INFO [main] io.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[134,217,728]
2017-07-20T10:01:25,321 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [io.druid.query.select.SelectQueryConfig@7459a21e]
2017-07-20T10:01:25,325 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@415d88de]
2017-07-20T10:01:25,344 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@f613067]
2017-07-20T10:01:25,365 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@34330f77]
2017-07-20T10:01:25,382 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=10, maxIdleTime=PT5M, defaultQueryTimeout=300000, maxScatterGatherBytes=9223372036854775807}]
2017-07-20T10:01:25,389 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@2dfeb141]
2017-07-20T10:01:25,392 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2017-07-20T10:01:25,413 INFO [main] org.eclipse.jetty.util.log - Logging initialized @6338ms
2017-07-20T10:01:25,605 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2017-07-20T10:01:25,610 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2017-07-20T10:01:25,612 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@329dc214].
2017-07-20T10:01:25,613 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2017-07-20T10:01:25,614 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@6d0290d8].
2017-07-20T10:01:25,615 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@32507479].
2017-07-20T10:01:25,615 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@632383b9].
2017-07-20T10:01:25,619 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@73bb1337].
2017-07-20T10:01:25,620 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@784d9bc].
2017-07-20T10:01:25,621 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2017-07-20T10:01:25,621 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=druidbroker2
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_101
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/java/jdk1.8.0_101/jre
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=conf/druid/_common:conf/druid/middleManager:lib/compress-lzf-1.0.3.jar:lib/jetty-util-9.3.19.v20170502.jar:lib/druid-sql-0.10.1-rc1.jar:lib/guice-servlet-4.1.0.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/bcprov-jdk15on-1.52.jar:lib/RoaringBitmap-0.5.18.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aopalliance-1.0.jar:lib/maven-model-builder-3.1.1.jar:lib/irc-api-1.0-0014.jar:lib/jetty-servlets-9.3.19.v20170502.jar:lib/aws-java-sdk-ec2-1.10.77.jar:lib/plexus-utils-3.0.15.jar:lib/commons-logging-1.1.1.jar:lib/calcite-linq4j-1.11.0.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/jsr311-api-1.1.1.jar:lib/jline-0.9.94.jar:lib/tesla-aether-0.0.5.jar:lib/jetty-continuation-9.3.19.v20170502.jar:lib/http-client-1.1.0.jar:lib/httpclient-4.5.3.jar:lib/aether-util-0.9.0.M2.jar:lib/airline-0.7.jar:lib/jetty-io-9.3.19.v20170502.jar:lib/asm-5.2.jar:lib/commons-cli-1.2.jar:lib/druid-indexing-service-0.10.1-rc1.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/commons-codec-1.7.jar:lib/druid-api-0.10.1-rc1.jar:lib/log4j-api-2.5.jar:lib/antlr4-runtime-4.5.1.jar:lib/jboss-logging-3.1.3.GA.jar:lib/asm-commons-5.2.jar:lib/jetty-proxy-9.3.19.v20170502.jar:lib/derbynet-10.11.1.1.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/curator-client-2.11.0.jar:lib/java-util-0.28.2.jar:lib/httpcore-4.4.6.jar:lib/jsr305-2.0.1.jar:lib/maven-model-3.1.1.jar:lib/commons-lang3-3.2.jar:lib/disruptor-3.3.6.jar:lib/javax.el-api-3.0.0.jar:lib/jdbi-2.63.1.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-core-1.10.77.jar:lib/netty-3.10.6.Final.jar:lib/jackson-databind-2.4.6.jar:lib/commons-io-2.5.jar:lib/commons-lang-2.6.jar:lib/opencsv-2.3.jar:lib/bytebuffer-collections-0.10.1-rc1.jar:lib/base64-2.3.8.jar:lib/jackson-dataformat-cbor-2.5.3.jar:lib/calcite-core-1.11.0.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/guava-16.0.1.jar:lib/server-metrics-0.2.8.jar:lib/validation-api-1.1.0.Final.jar:lib/commons-math3-3.6.1.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/maven-repository-metadata-3.1.1.jar:lib/druid-common-0.10.1-rc1.jar:lib/druid-processing-0.10.1-rc1.jar:lib/commons-pool-1.6.jar:lib/javax.inject-1.jar:lib/asm-tree-5.2.jar:lib/activation-1.1.1.jar:lib/derby-10.11.1.1.jar:lib/slf4j-api-1.6.4.jar:lib/geoip2-0.4.0.jar:lib/jersey-core-1.19.3.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/jetty-server-9.3.19.v20170502.jar:lib/jetty-http-9.3.19.v20170502.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/maven-settings-builder-3.1.1.jar:lib/jersey-server-1.19.3.jar:lib/curator-framework-2.11.0.jar:lib/jersey-guice-1.19.3.jar:lib/druid-console-0.0.2.jar:lib/aether-api-0.9.0.M2.jar:lib/jackson-core-asl-1.9.13.jar:lib/commons-pool2-2.2.jar:lib/aether-spi-0.9.0.M2.jar:lib/commons-compiler-2.7.6.jar:lib/aether-impl-0.9.0.M2.jar:lib/lz4-1.3.0.jar:lib/jetty-security-9.3.19.v20170502.jar:lib/classmate-1.0.0.jar:lib/maven-settings-3.1.1.jar:lib/protobuf-java-3.1.0.jar:lib/joda-time-2.9.9.jar:lib/plexus-interpolation-1.19.jar:lib/curator-x-discovery-2.11.0.jar:lib/curator-recipes-2.11.0.jar:lib/mapdb-1.0.8.jar:lib/maven-aether-provider-3.1.1.jar:lib/extendedset-0.10.1-rc1.jar:lib/icu4j-54.1.1.jar:lib/okhttp-1.0.2.jar:lib/emitter-0.4.5.jar:lib/jersey-servlet-1.19.3.jar:lib/druid-hll-0.10.1-rc1.jar:lib/druid-indexing-hadoop-0.10.1-rc1.jar:lib/jets3t-0.9.4.jar:lib/wagon-provider-api-2.4.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/config-magic-0.9.jar:lib/zookeeper-3.4.10.jar:lib/log4j-jul-2.5.jar:lib/fastutil-7.2.0.jar:lib/guice-multibindings-4.1.0.jar:lib/guice-4.1.0.jar:lib/log4j-slf4j-impl-2.5.jar:lib/log4j-core-2.5.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/netty-all-4.1.11.Final.jar:lib/commons-dbcp2-2.0.1.jar:lib/druid-aws-common-0.10.1-rc1.jar:lib/janino-2.7.6.jar:lib/commons-dbcp-1.4.jar:lib/avatica-metrics-1.9.0.jar:lib/javax.el-3.0.0.jar:lib/jetty-client-9.3.19.v20170502.jar:lib/json-path-2.1.0.jar:lib/rhino-1.7R5.jar:lib/java-util-0.10.1-rc1.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/avatica-server-1.9.0.jar:lib/avatica-core-1.9.0.jar:lib/javax.servlet-api-3.1.0.jar:lib/druid-services-0.10.1-rc1.jar:lib/spymemcached-2.12.3.jar:lib/java-xmlbuilder-1.1.jar:lib/aggdesigner-algorithm-6.0.jar:lib/jackson-core-2.4.6.jar:lib/jetty-servlet-9.3.19.v20170502.jar:lib/druid-server-0.10.1-rc1.jar:lib/jackson-annotations-2.4.6.jar:lib/log4j-1.2-api-2.5.jar:lib/derbyclient-10.11.1.1.jar
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-07-20T10:01:25,632 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2017-07-20T10:01:25,633 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-07-20T10:01:25,633 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-07-20T10:01:25,633 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-07-20T10:01:25,634 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-642.el6.x86_64
2017-07-20T10:01:25,634 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
2017-07-20T10:01:25,634 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
2017-07-20T10:01:25,634 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/root/druid-0.10.1
2017-07-20T10:01:25,635 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=192.168.1.35,192.168.1.36,192.168.1.37 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@7ab2a07e
2017-07-20T10:01:25,651 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@2faa55bb].
2017-07-20T10:01:25,660 INFO [main-SendThread(192.168.1.36:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 192.168.1.36/192.168.1.36:2181. Will not attempt to authenticate using SASL (unknown error)
2017-07-20T10:01:25,672 INFO [main-SendThread(192.168.1.36:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 192.168.1.36/192.168.1.36:2181, initiating session
2017-07-20T10:01:25,690 INFO [main-SendThread(192.168.1.36:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 192.168.1.36/192.168.1.36:2181, sessionid = 0x25d58af9008001f, negotiated timeout = 30000
2017-07-20T10:01:25,694 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2017-07-20T10:01:25,860 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@7971c2a9].
2017-07-20T10:01:25,860 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@2fd39436].
2017-07-20T10:01:25,884 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@b5aa65b].
2017-07-20T10:01:25,981 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_wikiticker_2017-07-20T10:01:19.196Z",
"spec" : {
"dataSchema" : {
"dataSource" : "wikiticker",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "json",
"dimensionsSpec" : {
"dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ]
},
"timestampSpec" : {
"format" : "auto",
"column" : "time"
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "added",
"fieldName" : "added",
"expression" : null
}, {
"type" : "longSum",
"name" : "deleted",
"fieldName" : "deleted",
"expression" : null
}, {
"type" : "longSum",
"name" : "delta",
"fieldName" : "delta",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "user_unique",
"fieldName" : "user",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/druid/wikiticker-2015-09-12-sampled.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2017-07-20T10:01:19.196Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.job.user.classpath.first" : "true"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false,
"allowedHadoopPrefix" : [ "druid.storage.", "druid.javascript." ]
},
"uniqueId" : "5a16c41d9ce449ccb3e5d58569bfbcb6"
},
"hadoopDependencyCoordinates" : [ "org.apache.hadoop:hadoop-client:2.7.3" ],
"classpathPrefix" : null,
"context" : null,
"groupId" : "index_hadoop_wikiticker_2017-07-20T10:01:19.196Z",
"dataSource" : "wikiticker",
"resource" : {
"availabilityGroup" : "index_hadoop_wikiticker_2017-07-20T10:01:19.196Z",
"requiredCapacity" : 1
}
}
2017-07-20T10:01:25,986 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/druid/task/index_hadoop_wikiticker_2017-07-20T10:01:19.196Z/lock].
2017-07-20T10:01:25,987 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/druid/task/index_hadoop_wikiticker_2017-07-20T10:01:19.196Z/lock] in 1ms.
2017-07-20T10:01:25,991 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_wikiticker_2017-07-20T10:01:19.196Z]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2017-07-20T10:01:26,001 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_wikiticker_2017-07-20T10:01:19.196Z] to overlord[http://druidcoordinator:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z}
2017-07-20T10:01:26,012 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,044 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,045 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,045 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,055 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,056 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,056 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,068 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,069 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,070 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,070 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,073 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,073 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,075 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,077 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,080 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,081 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,082 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,083 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,086 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://druidcoordinator:8090
2017-07-20T10:01:26,165 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_wikiticker_2017-07-20T10:01:19.196Z
2017-07-20T10:01:26,167 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-07-20T10:01:19.196Z] location changed to [TaskLocation{host='druidbroker2', port=8100}].
2017-07-20T10:01:26,167 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-07-20T10:01:19.196Z] status changed to [RUNNING].
2017-07-20T10:01:26,171 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-configuration-1.6.jar]
2017-07-20T10:01:26,171 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jackson-jaxrs-1.9.13.jar]
2017-07-20T10:01:26,172 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jersey-client-1.9.jar]
2017-07-20T10:01:26,172 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jsr305-3.0.0.jar]
2017-07-20T10:01:26,172 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/xz-1.0.jar]
2017-07-20T10:01:26,172 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/snappy-java-1.0.4.1.jar]
2017-07-20T10:01:26,172 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-client-2.7.3.jar]
2017-07-20T10:01:26,173 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jaxb-api-2.2.2.jar]
2017-07-20T10:01:26,174 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/httpclient-4.2.5.jar]
2017-07-20T10:01:26,177 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/apacheds-kerberos-codec-2.0.0-M15.jar]
2017-07-20T10:01:26,178 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/curator-framework-2.7.1.jar]
2017-07-20T10:01:26,178 INFO [main] org.eclipse.jetty.server.Server - jetty-9.3.19.v20170502
2017-07-20T10:01:26,178 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/xml-apis-1.3.04.jar]
2017-07-20T10:01:26,178 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/protobuf-java-2.5.0.jar]
2017-07-20T10:01:26,181 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-digester-1.8.jar]
2017-07-20T10:01:26,182 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-mapreduce-client-app-2.7.3.jar]
2017-07-20T10:01:26,182 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-cli-1.2.jar]
2017-07-20T10:01:26,182 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-mapreduce-client-common-2.7.3.jar]
2017-07-20T10:01:26,182 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/log4j-1.2.17.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-codec-1.4.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-yarn-api-2.7.3.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/htrace-core-3.1.0-incubating.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-math3-3.1.1.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-io-2.4.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/paranamer-2.3.jar]
2017-07-20T10:01:26,183 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-yarn-client-2.7.3.jar]
2017-07-20T10:01:26,184 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jackson-xc-1.9.13.jar]
2017-07-20T10:01:26,184 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/slf4j-api-1.7.10.jar]
2017-07-20T10:01:26,185 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-compress-1.4.1.jar]
2017-07-20T10:01:26,185 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/activation-1.1.jar]
2017-07-20T10:01:26,186 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-lang-2.6.jar]
2017-07-20T10:01:26,186 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-mapreduce-client-jobclient-2.7.3.jar]
2017-07-20T10:01:26,186 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/stax-api-1.0-2.jar]
2017-07-20T10:01:26,186 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/api-asn1-api-1.0.0-M20.jar]
2017-07-20T10:01:26,187 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-yarn-common-2.7.3.jar]
2017-07-20T10:01:26,187 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-beanutils-1.7.0.jar]
2017-07-20T10:01:26,187 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/netty-3.6.2.Final.jar]
2017-07-20T10:01:26,187 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-yarn-server-common-2.7.3.jar]
2017-07-20T10:01:26,187 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/gson-2.2.4.jar]
2017-07-20T10:01:26,188 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jackson-core-asl-1.9.13.jar]
2017-07-20T10:01:26,189 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-hdfs-2.7.3.jar]
2017-07-20T10:01:26,202 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-auth-2.7.3.jar]
2017-07-20T10:01:26,202 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/xercesImpl-2.9.1.jar]
2017-07-20T10:01:26,202 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jersey-core-1.9.jar]
2017-07-20T10:01:26,202 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/avro-1.7.4.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/curator-client-2.7.1.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/api-util-1.0.0-M20.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/zookeeper-3.4.6.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-beanutils-core-1.8.0.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jsp-api-2.1.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/apacheds-i18n-2.0.0-M15.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-annotations-2.7.3.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/servlet-api-2.5.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/leveldbjni-all-1.8.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/httpcore-4.2.5.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/xmlenc-0.52.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/guava-11.0.2.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/slf4j-log4j12-1.7.10.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-mapreduce-client-core-2.7.3.jar]
2017-07-20T10:01:26,203 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-collections-3.2.2.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/curator-recipes-2.7.1.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/netty-all-4.0.23.Final.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jackson-mapper-asl-1.9.13.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-mapreduce-client-shuffle-2.7.3.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-logging-1.1.3.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-httpclient-3.1.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/jetty-util-6.1.26.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/commons-net-3.1.jar]
2017-07-20T10:01:26,204 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/hadoop-common-2.7.3.jar]
2017-07-20T10:01:26,205 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopTask - Hadoop Container Druid Classpath is set to [file:/root/druid-0.10.1/conf/druid/_common/:file:/root/druid-0.10.1/conf/druid/middleManager/:file:/root/druid-0.10.1/lib/compress-lzf-1.0.3.jar:file:/root/druid-0.10.1/lib/jetty-util-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/druid-sql-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/guice-servlet-4.1.0.jar:file:/root/druid-0.10.1/lib/jackson-dataformat-smile-2.4.6.jar:file:/root/druid-0.10.1/lib/bcprov-jdk15on-1.52.jar:file:/root/druid-0.10.1/lib/RoaringBitmap-0.5.18.jar:file:/root/druid-0.10.1/lib/aether-connector-okhttp-0.0.9.jar:file:/root/druid-0.10.1/lib/aopalliance-1.0.jar:file:/root/druid-0.10.1/lib/maven-model-builder-3.1.1.jar:file:/root/druid-0.10.1/lib/irc-api-1.0-0014.jar:file:/root/druid-0.10.1/lib/jetty-servlets-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/aws-java-sdk-ec2-1.10.77.jar:file:/root/druid-0.10.1/lib/plexus-utils-3.0.15.jar:file:/root/druid-0.10.1/lib/commons-logging-1.1.1.jar:file:/root/druid-0.10.1/lib/calcite-linq4j-1.11.0.jar:file:/root/druid-0.10.1/lib/jcl-over-slf4j-1.7.12.jar:file:/root/druid-0.10.1/lib/jsr311-api-1.1.1.jar:file:/root/druid-0.10.1/lib/jline-0.9.94.jar:file:/root/druid-0.10.1/lib/tesla-aether-0.0.5.jar:file:/root/druid-0.10.1/lib/jetty-continuation-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/http-client-1.1.0.jar:file:/root/druid-0.10.1/lib/httpclient-4.5.3.jar:file:/root/druid-0.10.1/lib/aether-util-0.9.0.M2.jar:file:/root/druid-0.10.1/lib/airline-0.7.jar:file:/root/druid-0.10.1/lib/jetty-io-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/asm-5.2.jar:file:/root/druid-0.10.1/lib/commons-cli-1.2.jar:file:/root/druid-0.10.1/lib/druid-indexing-service-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/root/druid-0.10.1/lib/commons-codec-1.7.jar:file:/root/druid-0.10.1/lib/druid-api-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/log4j-api-2.5.jar:file:/root/druid-0.10.1/lib/antlr4-runtime-4.5.1.jar:file:/root/druid-0.10.1/lib/jboss-logging-3.1.3.GA.jar:file:/root/druid-0.10.1/lib/asm-commons-5.2.jar:file:/root/druid-0.10.1/lib/jetty-proxy-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/derbynet-10.11.1.1.jar:file:/root/druid-0.10.1/lib/jackson-jaxrs-base-2.4.6.jar:file:/root/druid-0.10.1/lib/curator-client-2.11.0.jar:file:/root/druid-0.10.1/lib/java-util-0.28.2.jar:file:/root/druid-0.10.1/lib/httpcore-4.4.6.jar:file:/root/druid-0.10.1/lib/jsr305-2.0.1.jar:file:/root/druid-0.10.1/lib/maven-model-3.1.1.jar:file:/root/druid-0.10.1/lib/commons-lang3-3.2.jar:file:/root/druid-0.10.1/lib/disruptor-3.3.6.jar:file:/root/druid-0.10.1/lib/javax.el-api-3.0.0.jar:file:/root/druid-0.10.1/lib/jdbi-2.63.1.jar:file:/root/druid-0.10.1/lib/maxminddb-0.2.0.jar:file:/root/druid-0.10.1/lib/aws-java-sdk-core-1.10.77.jar:file:/root/druid-0.10.1/lib/netty-3.10.6.Final.jar:file:/root/druid-0.10.1/lib/jackson-databind-2.4.6.jar:file:/root/druid-0.10.1/lib/commons-io-2.5.jar:file:/root/druid-0.10.1/lib/commons-lang-2.6.jar:file:/root/druid-0.10.1/lib/opencsv-2.3.jar:file:/root/druid-0.10.1/lib/bytebuffer-collections-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/base64-2.3.8.jar:file:/root/druid-0.10.1/lib/jackson-dataformat-cbor-2.5.3.jar:file:/root/druid-0.10.1/lib/calcite-core-1.11.0.jar:file:/root/druid-0.10.1/lib/aether-connector-file-0.9.0.M2.jar:file:/root/druid-0.10.1/lib/guava-16.0.1.jar:file:/root/druid-0.10.1/lib/server-metrics-0.2.8.jar:file:/root/druid-0.10.1/lib/validation-api-1.1.0.Final.jar:file:/root/druid-0.10.1/lib/commons-math3-3.6.1.jar:file:/root/druid-0.10.1/lib/jackson-datatype-joda-2.4.6.jar:file:/root/druid-0.10.1/lib/maven-repository-metadata-3.1.1.jar:file:/root/druid-0.10.1/lib/druid-common-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/druid-processing-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/commons-pool-1.6.jar:file:/root/druid-0.10.1/lib/javax.inject-1.jar:file:/root/druid-0.10.1/lib/asm-tree-5.2.jar:file:/root/druid-0.10.1/lib/activation-1.1.1.jar:file:/root/druid-0.10.1/lib/derby-10.11.1.1.jar:file:/root/druid-0.10.1/lib/slf4j-api-1.6.4.jar:file:/root/druid-0.10.1/lib/geoip2-0.4.0.jar:file:/root/druid-0.10.1/lib/jersey-core-1.19.3.jar:file:/root/druid-0.10.1/lib/jackson-module-jaxb-annotations-2.4.6.jar:file:/root/druid-0.10.1/lib/jetty-server-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/jetty-http-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/jackson-datatype-guava-2.4.6.jar:file:/root/druid-0.10.1/lib/maven-settings-builder-3.1.1.jar:file:/root/druid-0.10.1/lib/jersey-server-1.19.3.jar:file:/root/druid-0.10.1/lib/curator-framework-2.11.0.jar:file:/root/druid-0.10.1/lib/jersey-guice-1.19.3.jar:file:/root/druid-0.10.1/lib/druid-console-0.0.2.jar:file:/root/druid-0.10.1/lib/aether-api-0.9.0.M2.jar:file:/root/druid-0.10.1/lib/jackson-core-asl-1.9.13.jar:file:/root/druid-0.10.1/lib/commons-pool2-2.2.jar:file:/root/druid-0.10.1/lib/aether-spi-0.9.0.M2.jar:file:/root/druid-0.10.1/lib/commons-compiler-2.7.6.jar:file:/root/druid-0.10.1/lib/aether-impl-0.9.0.M2.jar:file:/root/druid-0.10.1/lib/lz4-1.3.0.jar:file:/root/druid-0.10.1/lib/jetty-security-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/classmate-1.0.0.jar:file:/root/druid-0.10.1/lib/maven-settings-3.1.1.jar:file:/root/druid-0.10.1/lib/protobuf-java-3.1.0.jar:file:/root/druid-0.10.1/lib/joda-time-2.9.9.jar:file:/root/druid-0.10.1/lib/plexus-interpolation-1.19.jar:file:/root/druid-0.10.1/lib/curator-x-discovery-2.11.0.jar:file:/root/druid-0.10.1/lib/curator-recipes-2.11.0.jar:file:/root/druid-0.10.1/lib/mapdb-1.0.8.jar:file:/root/druid-0.10.1/lib/maven-aether-provider-3.1.1.jar:file:/root/druid-0.10.1/lib/extendedset-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/icu4j-54.1.1.jar:file:/root/druid-0.10.1/lib/okhttp-1.0.2.jar:file:/root/druid-0.10.1/lib/emitter-0.4.5.jar:file:/root/druid-0.10.1/lib/jersey-servlet-1.19.3.jar:file:/root/druid-0.10.1/lib/druid-hll-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/druid-indexing-hadoop-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/jets3t-0.9.4.jar:file:/root/druid-0.10.1/lib/wagon-provider-api-2.4.jar:file:/root/druid-0.10.1/lib/hibernate-validator-5.1.3.Final.jar:file:/root/druid-0.10.1/lib/config-magic-0.9.jar:file:/root/druid-0.10.1/lib/zookeeper-3.4.10.jar:file:/root/druid-0.10.1/lib/log4j-jul-2.5.jar:file:/root/druid-0.10.1/lib/fastutil-7.2.0.jar:file:/root/druid-0.10.1/lib/guice-multibindings-4.1.0.jar:file:/root/druid-0.10.1/lib/guice-4.1.0.jar:file:/root/druid-0.10.1/lib/log4j-slf4j-impl-2.5.jar:file:/root/druid-0.10.1/lib/log4j-core-2.5.jar:file:/root/druid-0.10.1/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/root/druid-0.10.1/lib/netty-all-4.1.11.Final.jar:file:/root/druid-0.10.1/lib/commons-dbcp2-2.0.1.jar:file:/root/druid-0.10.1/lib/druid-aws-common-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/janino-2.7.6.jar:file:/root/druid-0.10.1/lib/commons-dbcp-1.4.jar:file:/root/druid-0.10.1/lib/avatica-metrics-1.9.0.jar:file:/root/druid-0.10.1/lib/javax.el-3.0.0.jar:file:/root/druid-0.10.1/lib/jetty-client-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/json-path-2.1.0.jar:file:/root/druid-0.10.1/lib/rhino-1.7R5.jar:file:/root/druid-0.10.1/lib/java-util-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/jackson-mapper-asl-1.9.13.jar:file:/root/druid-0.10.1/lib/avatica-server-1.9.0.jar:file:/root/druid-0.10.1/lib/avatica-core-1.9.0.jar:file:/root/druid-0.10.1/lib/javax.servlet-api-3.1.0.jar:file:/root/druid-0.10.1/lib/druid-services-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/spymemcached-2.12.3.jar:file:/root/druid-0.10.1/lib/java-xmlbuilder-1.1.jar:file:/root/druid-0.10.1/lib/aggdesigner-algorithm-6.0.jar:file:/root/druid-0.10.1/lib/jackson-core-2.4.6.jar:file:/root/druid-0.10.1/lib/jetty-servlet-9.3.19.v20170502.jar:file:/root/druid-0.10.1/lib/druid-server-0.10.1-rc1.jar:file:/root/druid-0.10.1/lib/jackson-annotations-2.4.6.jar:file:/root/druid-0.10.1/lib/log4j-1.2-api-2.5.jar:file:/root/druid-0.10.1/lib/derbyclient-10.11.1.1.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/druid-kafka-eight-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka-clients-0.8.2.1.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/jopt-simple-3.2.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/snappy-java-1.1.1.6.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka_2.10-0.8.2.1.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/zkclient-0.3.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/metrics-core-2.2.0.jar:file:/root/druid-0.10.1/extensions/druid-kafka-eight/scala-library-2.10.4.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-configuration-1.6.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jersey-client-1.9.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xz-1.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-client-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-digester-1.8.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpclient-4.5.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-codec-1.7.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-client-2.11.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpcore-4.4.6.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/paranamer-2.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/stax-api-1.0-2.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/guava-16.0.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/gson-2.2.4.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/aws-java-sdk-1.7.4.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/avro-1.7.4.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/joda-time-2.9.9.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jsp-api-2.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/servlet-api-2.5.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xmlenc-0.52.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-net-3.1.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar:file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-common-2.7.3.jar:file:/root/druid-0.10.1/extensions/druid-histogram/druid-histogram-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/druid-datasketches/memory-0.8.4.jar:file:/root/druid-0.10.1/extensions/druid-datasketches/druid-datasketches-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/druid-datasketches/sketches-core-0.8.4.jar:file:/root/druid-0.10.1/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-metadata-storage-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar:file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar:file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1-rc1.jar:file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar:file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar:file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/druid-0.10.1/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/druid-0.10.1/hadoop-dependencies/hadoop-client/2.7.3/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2017-07-20T10:01:26,401 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2017-07-20T10:01:26,402 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2017-07-20T10:01:26,402 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2017-07-20T10:01:26,402 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class
2017-07-20T10:01:26,405 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
2017-07-20T10:01:26,578 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2017-07-20T10:01:26,585 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-07-20T10:01:26,596 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-07-20T10:01:27,018 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,053 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,064 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.SegmentListerResource to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,066 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,076 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,079 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2017-07-20T10:01:27,086 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2017-07-20T10:01:27,111 WARN [main] com.sun.jersey.spi.inject.Errors - The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void io.druid.server.http.SegmentListerResource.getSegments(long,long,long,javax.servlet.http.HttpServletRequest) throws java.io.IOException, MUST return a non-void type.
2017-07-20T10:01:27,144 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@2120bed{/,null,AVAILABLE}
2017-07-20T10:01:27,160 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@38089dae{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-07-20T10:01:27,160 INFO [main] org.eclipse.jetty.server.Server - Started @8088ms
2017-07-20T10:01:27,161 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@5dfd31f4].
2017-07-20T10:01:27,161 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2017-07-20T10:01:27,167 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2017-07-20T10:01:27,167 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@632241f5].
2017-07-20T10:01:27,202 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/druidbroker2:8100]
2017-07-20 10:01:27,267 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20 10:01:27,273 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20 10:01:27,299 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20 10:01:27,305 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20 10:01:27,317 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20 10:01:27,322 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:104)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:293)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:177)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2017-07-20T10:01:27,567 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-07-20T10:01:27,571 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-07-20T10:01:27,635 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-07-20T10:01:28,449 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-kafka-eight, druid-hdfs-storage, druid-histogram, druid-datasketches, druid-lookups-cached-global, mysql-metadata-storage, druid-kafka-indexing-service]}]
2017-07-20T10:01:28,451 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.firehose.kafka.KafkaEightDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,453 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,455 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,457 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,458 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,461 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.server.lookup.namespace.NamespaceExtractionModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,462 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,463 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,463 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-eight] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,474 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/druid-kafka-eight-0.10.1-rc1.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka-clients-0.8.2.1.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/jopt-simple-3.2.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/snappy-java-1.1.1.6.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/kafka_2.10-0.8.2.1.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/zkclient-0.3.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/metrics-core-2.2.0.jar]
2017-07-20T10:01:28,475 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-eight/scala-library-2.10.4.jar]
2017-07-20T10:01:28,477 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,478 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-07-20T10:01:28,478 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar]
2017-07-20T10:01:28,478 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jersey-client-1.9.jar]
2017-07-20T10:01:28,478 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-client-2.7.3.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-logging-1.1.1.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xml-apis-1.3.04.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.7.3.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpclient-4.5.3.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.7.3.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-codec-1.7.jar]
2017-07-20T10:01:28,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-api-2.7.3.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/druid-hdfs-storage-0.10.1-rc1.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-client-2.11.0.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/httpcore-4.4.6.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/htrace-core-3.1.0-incubating.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-client-2.7.3.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-databind-2.4.6.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.7.3.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-07-20T10:01:28,480 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-common-2.7.3.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-3.6.2.Final.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.7.3.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/gson-2.2.4.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/aws-java-sdk-1.7.4.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-framework-2.11.0.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-hdfs-2.7.3.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-auth-2.7.3.jar]
2017-07-20T10:01:28,481 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xercesImpl-2.9.1.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-aws-2.7.3.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/joda-time-2.9.9.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/curator-recipes-2.11.0.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jsp-api-2.1.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-07-20T10:01:28,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.7.3.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/netty-all-4.1.11.Final.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.7.3.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-core-2.4.6.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/jackson-annotations-2.4.6.jar]
2017-07-20T10:01:28,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-hdfs-storage/hadoop-common-2.7.3.jar]
2017-07-20T10:01:28,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-histogram/druid-histogram-0.10.1-rc1.jar]
2017-07-20T10:01:28,490 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,490 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/memory-0.8.4.jar]
2017-07-20T10:01:28,490 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/druid-datasketches-0.10.1-rc1.jar]
2017-07-20T10:01:28,490 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-datasketches/sketches-core-0.8.4.jar]
2017-07-20T10:01:28,492 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,492 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.10.1-rc1.jar]
2017-07-20T10:01:28,493 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,494 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-metadata-storage-0.10.1-rc1.jar]
2017-07-20T10:01:28,494 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar]
2017-07-20T10:01:28,495 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.initialization.DruidModule]
2017-07-20T10:01:28,496 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar]
2017-07-20T10:01:28,496 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.10.1-rc1.jar]
2017-07-20T10:01:28,496 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.0.jar]
2017-07-20T10:01:28,496 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/slf4j-api-1.6.4.jar]
2017-07-20T10:01:28,496 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/root/druid-0.10.1/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2017-07-20T10:01:29,178 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-07-20T10:01:30,594 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-07-20T10:01:30,671 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@85f8759]
2017-07-20T10:01:30,688 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-07-20T10:01:30,694 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@4708f5ff]
2017-07-20T10:01:30,695 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@2b360301]
2017-07-20T10:01:30,695 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@3f98b365]
2017-07-20T10:01:30,703 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [134217728] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-07-20T10:01:30,705 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-07-20T10:01:30,705 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-07-20T10:01:30,707 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-07-20T10:01:30,708 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-07-20T10:01:30,708 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-07-20T10:01:30,708 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [io.druid.query.DruidProcessingConfig#getTmpDir()]
2017-07-20T10:01:30,709 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [io.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-07-20T10:01:30,857 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2017-07-20T10:01:30,861 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@474224f5]
2017-07-20T10:01:30,870 INFO [task-runner-0-priority-0] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2017-07-20T10:01:31,036 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-07-20T10:01:31,036 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-07-20T10:01:31,047 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-kafka-eight, druid-hdfs-storage, druid-histogram, druid-datasketches, druid-lookups-cached-global, mysql-metadata-storage, druid-kafka-indexing-service]}]
2017-07-20T10:01:31,048 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2017-07-20T10:01:31,086 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/druid/wikiticker-2015-09-12-sampled.json]
2017-07-20T10:01:31,902 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/druid/wikiticker-2015-09-12-sampled.json]
2017-07-20T10:01:32,472 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2017-07-20T10:01:32,510 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-07-20T10:01:33,010 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2017-07-20T10:01:33,452 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-07-20T10:01:33,640 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1500540396950_0011
2017-07-20T10:01:33,794 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
2017-07-20T10:01:34,977 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1500540396950_0011
2017-07-20T10:01:35,015 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://d1:8088/proxy/application_1500540396950_0011/
2017-07-20T10:01:35,015 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job wikiticker-determine_partitions_hashed-Optional.of([2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z]) submitted, status available at: http://d1:8088/proxy/application_1500540396950_0011/
2017-07-20T10:01:35,016 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_1500540396950_0011
2017-07-20T10:01:45,131 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1500540396950_0011 running in uber mode : false
2017-07-20T10:01:45,132 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-07-20T10:01:59,078 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 100% reduce 0%
2017-07-20T10:02:11,202 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 100% reduce 100%
2017-07-20T10:02:12,218 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1500540396950_0011 completed successfully
2017-07-20T10:02:12,353 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Counters: 49
File System Counters
FILE: Number of bytes read=1053
FILE: Number of bytes written=403699
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=17106567
HDFS: Number of bytes written=99
HDFS: Number of read operations=7
HDFS: Number of large read operations=0
HDFS: Number of write operations=3
Job Counters
Launched map tasks=1
Launched reduce tasks=1
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=84528
Total time spent by all reduces in occupied slots (ms)=80840
Total time spent by all map tasks (ms)=10566
Total time spent by all reduce tasks (ms)=10105
Total vcore-milliseconds taken by all map tasks=10566
Total vcore-milliseconds taken by all reduce tasks=10105
Total megabyte-milliseconds taken by all map tasks=10819584
Total megabyte-milliseconds taken by all reduce tasks=10347520
Map-Reduce Framework
Map input records=39244
Map output records=1
Map output bytes=1043
Map output materialized bytes=1053
Input split bytes=311
Combine input records=0
Combine output records=0
Reduce input groups=1
Reduce shuffle bytes=1053
Reduce input records=1
Reduce output records=0
Spilled Records=2
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=697
CPU time spent (ms)=36800
Physical memory (bytes) snapshot=662720512
Virtual memory (bytes) snapshot=4306477056
Total committed heap usage (bytes)=352845824
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=94
2017-07-20T10:02:12,355 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job completed, loading up partitions for intervals[Optional.of([2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z])].
2017-07-20T10:02:12,414 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Found approximately [40,337] rows in data.
2017-07-20T10:02:12,415 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Creating [1] shards
2017-07-20T10:02:12,417 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - DetermineHashedPartitionsJob took 41323 millis
2017-07-20T10:02:12,417 INFO [task-runner-0-priority-0] io.druid.indexer.JobHelper - Deleting path[/tmp/druid/indexing/wikiticker/2017-07-20T100119.196Z_5a16c41d9ce449ccb3e5d58569bfbcb6]
2017-07-20T10:02:12,470 INFO [task-runner-0-priority-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_wikiticker_2017-07-20T10:01:19.196Z]: LockListAction{}
2017-07-20T10:02:12,472 INFO [task-runner-0-priority-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_wikiticker_2017-07-20T10:01:19.196Z] to overlord[http://druidcoordinator:8090/druid/indexer/v1/action]: LockListAction{}
2017-07-20T10:02:12,480 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Setting version to: 2017-07-20T10:01:19.200Z
2017-07-20T10:02:12,491 INFO [task-runner-0-priority-0] io.druid.indexer.HadoopDruidIndexerConfig - Running with config:
{
"spec" : {
"dataSchema" : {
"dataSource" : "wikiticker",
"parser" : {
"type" : "hadoopyString",
"parseSpec" : {
"format" : "json",
"dimensionsSpec" : {
"dimensions" : [ "channel", "cityName", "comment", "countryIsoCode", "countryName", "isAnonymous", "isMinor", "isNew", "isRobot", "isUnpatrolled", "metroCode", "namespace", "page", "regionIsoCode", "regionName", "user" ]
},
"timestampSpec" : {
"format" : "auto",
"column" : "time"
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
}, {
"type" : "longSum",
"name" : "added",
"fieldName" : "added",
"expression" : null
}, {
"type" : "longSum",
"name" : "deleted",
"fieldName" : "deleted",
"expression" : null
}, {
"type" : "longSum",
"name" : "delta",
"fieldName" : "delta",
"expression" : null
}, {
"type" : "hyperUnique",
"name" : "user_unique",
"fieldName" : "user",
"isInputHyperUnique" : false
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "/tmp/druid/wikiticker-2015-09-12-sampled.json"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : "hdfs://appccluster1/tmp/druid/segments"
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : "/tmp/druid/indexing",
"version" : "2017-07-20T10:01:19.200Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : {
"1442016000000" : [ {
"actualSpec" : {
"type" : "none"
},
"shardNum" : 0
} ]
},
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.job.user.classpath.first" : "true"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : true,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false,
"useExplicitVersion" : false,
"allowedHadoopPrefix" : [ "druid.storage.", "druid.javascript." ]
},
"uniqueId" : "5a16c41d9ce449ccb3e5d58569bfbcb6"
}
}
2017-07-20T10:02:12,563 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop index generator job...
2017-07-20T10:02:12,589 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/druid/wikiticker-2015-09-12-sampled.json]
2017-07-20T10:02:12,591 INFO [task-runner-0-priority-0] io.druid.indexer.HadoopDruidIndexerJob - No metadataStorageUpdaterJob set in the config. This is cool if you are running a hadoop index task, otherwise nothing will be uploaded to database.
2017-07-20T10:02:12,626 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[/tmp/druid/wikiticker-2015-09-12-sampled.json]
2017-07-20T10:02:12,997 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2017-07-20T10:02:13,008 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobResourceUploader - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-07-20T10:02:13,280 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2017-07-20T10:02:13,433 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-07-20T10:02:13,540 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1500540396950_0012
2017-07-20T10:02:13,548 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
2017-07-20T10:02:14,657 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1500540396950_0012
2017-07-20T10:02:14,660 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://d1:8088/proxy/application_1500540396950_0012/
2017-07-20T10:02:14,660 INFO [task-runner-0-priority-0] io.druid.indexer.IndexGeneratorJob - Job wikiticker-index-generator-Optional.of([2015-09-12T00:00:00.000Z/2015-09-13T00:00:00.000Z]) submitted, status available at http://d1:8088/proxy/application_1500540396950_0012/
2017-07-20T10:02:14,660 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_1500540396950_0012
2017-07-20T10:02:25,654 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.621Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jetty/numOpenConnections","value":0,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,662 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.655Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/max","value":1908932608,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"heap"}]
2017-07-20T10:02:25,667 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.662Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/committed","value":318242816,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"heap"}]
2017-07-20T10:02:25,668 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.668Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/used","value":38997824,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"heap"}]
2017-07-20T10:02:25,669 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.668Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/init","value":62914560,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"heap"}]
2017-07-20T10:02:25,672 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.669Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/max","value":-1,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"nonheap"}]
2017-07-20T10:02:25,675 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.672Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/committed","value":121241600,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"nonheap"}]
2017-07-20T10:02:25,676 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.675Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/used","value":118630288,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"nonheap"}]
2017-07-20T10:02:25,676 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.676Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/mem/init","value":2555904,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"memKind":"nonheap"}]
2017-07-20T10:02:25,677 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.677Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":251658240,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-07-20T10:02:25,683 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.683Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":18481152,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-07-20T10:02:25,684 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.683Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":17840704,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-07-20T10:02:25,684 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.684Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":2555904,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Code Cache"}]
2017-07-20T10:02:25,684 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.684Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":-1,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-07-20T10:02:25,685 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.684Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":91226112,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-07-20T10:02:25,686 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.685Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":89627000,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-07-20T10:02:25,686 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.686Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":0,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Metaspace"}]
2017-07-20T10:02:25,686 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.686Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":1073741824,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-07-20T10:02:25,688 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.686Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":11534336,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-07-20T10:02:25,688 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.688Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":11157296,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-07-20T10:02:25,689 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.689Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":0,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"nonheap","poolName":"Compressed Class Space"}]
2017-07-20T10:02:25,692 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.689Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":681050112,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-07-20T10:02:25,692 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.692Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":221773824,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-07-20T10:02:25,693 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.692Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":6839152,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-07-20T10:02:25,695 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.693Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":15728640,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Eden Space"}]
2017-07-20T10:02:25,696 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.695Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":15204352,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-07-20T10:02:25,697 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.696Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":15204352,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-07-20T10:02:25,698 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.698Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":12846864,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-07-20T10:02:25,699 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.699Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":2621440,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Survivor Space"}]
2017-07-20T10:02:25,701 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.699Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/max","value":1431830528,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-07-20T10:02:25,702 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.701Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/committed","value":81264640,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-07-20T10:02:25,703 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.702Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/used","value":19589808,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-07-20T10:02:25,703 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.703Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/pool/init","value":41943040,"dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"],"poolKind":"heap","poolName":"PS Old Gen"}]
2017-07-20T10:02:25,706 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.706Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/capacity","value":539549489,"bufferpoolName":"direct","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,707 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.706Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/used","value":539549490,"bufferpoolName":"direct","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,709 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.707Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/count","value":55,"bufferpoolName":"direct","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,711 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.710Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/capacity","value":0,"bufferpoolName":"mapped","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,712 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.711Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/used","value":0,"bufferpoolName":"mapped","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,713 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.712Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"jvm/bufferpool/count","value":0,"bufferpoolName":"mapped","dataSource":["wikiticker"],"id":["index_hadoop_wikiticker_2017-07-20T10:01:19.196Z"]}]
2017-07-20T10:02:25,714 INFO [MonitorScheduler-0] com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"metrics","timestamp":"2017-07-20T10:02:25.714Z","service":"druid/middleManager","host":"druidbroker2:8100","version":"0.10.1-rc1","metric":"segment/scan/pending","value":0}]
2017-07-20T10:02:27,874 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1500540396950_0012 running in uber mode : false
2017-07-20T10:02:27,874 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-07-20T10:02:33,121 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 100% reduce 0%
2017-07-20T10:02:33,125 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Task Id : attempt_1500540396950_0012_m_000000_0, Status : FAILED
Exception from container-launch.
Container id: container_e33_1500540396950_0012_01_000002
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
2017-07-20T10:02:34,151 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-07-20T10:02:35,171 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Task Id : attempt_1500540396950_0012_m_000000_1, Status : FAILED
Exception from container-launch.
Container id: container_e33_1500540396950_0012_01_000003
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
2017-07-20T10:02:38,209 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Task Id : attempt_1500540396950_0012_m_000000_2, Status : FAILED
Exception from container-launch.
Container id: container_e33_1500540396950_0012_01_000004
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
2017-07-20T10:02:42,248 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 100% reduce 100%
2017-07-20T10:02:43,276 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1500540396950_0012 failed with state FAILED due to: Task failed task_1500540396950_0012_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
2017-07-20T10:02:43,308 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Counters: 16
Job Counters
Failed map tasks=4
Killed reduce tasks=1
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=39248
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=4906
Total time spent by all reduce tasks (ms)=0
Total vcore-milliseconds taken by all map tasks=4906
Total vcore-milliseconds taken by all reduce tasks=0
Total megabyte-milliseconds taken by all map tasks=5023744
Total megabyte-milliseconds taken by all reduce tasks=0
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
2017-07-20T10:02:43,314 INFO [task-runner-0-priority-0] io.druid.indexer.JobHelper - Deleting path[/tmp/druid/indexing/wikiticker/2017-07-20T100119.200Z_5a16c41d9ce449ccb3e5d58569bfbcb6]
2017-07-20T10:02:43,355 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_wikiticker_2017-07-20T10:01:19.196Z, type=index_hadoop, dataSource=wikiticker}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:218) ~[druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:224) ~[druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_101]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_101]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_101]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_101]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_101]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215) ~[druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
... 7 more
Caused by: io.druid.java.util.common.ISE: Job[class io.druid.indexer.IndexGeneratorJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:392) ~[druid-indexing-hadoop-0.10.1-rc1.jar:0.10.1-rc1]
at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:95) ~[druid-indexing-hadoop-0.10.1-rc1.jar:0.10.1-rc1]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:277) ~[druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_101]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_101]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_101]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_101]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:215) ~[druid-indexing-service-0.10.1-rc1.jar:0.10.1-rc1]
... 7 more
2017-07-20T10:02:43,364 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_wikiticker_2017-07-20T10:01:19.196Z] status changed to [FAILED].
2017-07-20T10:02:43,368 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_wikiticker_2017-07-20T10:01:19.196Z",
"status" : "FAILED",
"duration" : 77199
}
2017-07-20T10:02:43,376 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@632241f5].
2017-07-20T10:02:43,376 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/druidbroker2:8100]
2017-07-20T10:02:43,399 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/druidbroker2:8100]
2017-07-20T10:02:43,399 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@5dfd31f4].
2017-07-20T10:02:43,399 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopping.
2017-07-20T10:02:43,399 INFO [LookupReferencesManager-MainThread] io.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited, Lookup notices are not handled anymore.
2017-07-20T10:02:43,400 INFO [main] io.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopped.
2017-07-20T10:02:43,404 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@38089dae{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2017-07-20T10:02:43,406 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@2120bed{/,null,UNAVAILABLE}
2017-07-20T10:02:43,408 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@b5aa65b].
2017-07-20T10:02:43,408 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@c497a55].
2017-07-20T10:02:43,409 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@2fd39436].
2017-07-20T10:02:43,413 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@7971c2a9].
2017-07-20T10:02:43,414 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@2faa55bb].
2017-07-20T10:02:43,414 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2017-07-20T10:02:43,415 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2017-07-20T10:02:43,420 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x25d58af9008001f
2017-07-20T10:02:43,420 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x25d58af9008001f closed
2017-07-20T10:02:43,420 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@784d9bc].
2017-07-20T10:02:43,457 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.stop()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@73bb1337].
2017-07-20T10:02:43,457 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@632383b9].
2017-07-20T10:02:43,457 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@32507479].
2017-07-20T10:02:43,457 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2017-07-20T10:02:43,457 INFO [main] io.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@6d0290d8].
2017-07-20 10:02:43,518 Thread-3 ERROR Unable to register shutdown hook because JVM is shutting down. java.lang.IllegalStateException: Not started
at io.druid.common.config.Log4jShutdown.addShutdownCallback(Log4jShutdown.java:45)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.addShutdownCallback(Log4jContextFactory.java:273)
at org.apache.logging.log4j.core.LoggerContext.setUpShutdownHook(LoggerContext.java:256)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:216)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:155)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:132)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.hdfs.LeaseRenewer.<clinit>(LeaseRenewer.java:72)
at org.apache.hadoop.hdfs.DFSClient.getLeaseRenewer(DFSClient.java:818)
at org.apache.hadoop.hdfs.DFSClient.close(DFSClient.java:956)
at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1079)
at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2760)
at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2777)
at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
And I got an error log of "Error: Could not find or load main class null" on hadoop job history page.
Does anyone got an idea of such an error?
Thanks!
Yuewen
Yuewen Wang
Jul 20, 2017, 8:55:23 AM7/20/17
to Druid User
The mapper's error message is :
Error: Could not find or load main class null
I believe this should be the key for this disfunction...
在 2017年7月20日星期四 UTC+8下午6:16:25，Yuewen Wang写道：
...
Yuewen Wang
Jul 21, 2017, 5:28:20 AM7/21/17
to Druid User
I have figured out the bug myself.
We don't set both ""mapreduce.map.java.opts"" & mapreduce.map.java.opts"".
And there is a bug existing in the JobHelper class of druid-hadoop-indexing module that will pass a "null" string to the map or reduce jobs.
Then the mapper container launcher shell command will be "java null" which gave me the error message "Error: Could not find or load main class null".
One possible workaround (which I am using) is to set anything to the two map reduce configs like I did in "tunningConfig":
"tuningConfig" : { "type" : "hadoop", "partitionsSpec" : { "type" : "hashed", "targetPartitionSize" : 5000000 }, "jobProperties" : {"mapreduce.job.classloader": "true","mapreduce.map.java.opts": "-Xmx1024m","mapreduce.reduce.java.opts":"-Xmx1024m"} }在 2017年7月20日星期四 UTC+8下午8:55:23，Yuewen Wang写道：
Reply all
Reply to author
Forward
0 new messages