druid batch ingest failed when mapreduce

129 views
Skip to first unread message

joe

unread,
Apr 19, 2017, 11:21:45 PM4/19/17
to Druid User
Hi all

When i ingest data into druid using hadoop index,here comes a error.
any one meet this before ?
Thank you for any feedback.


2017-04-19T08:56:09,943 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-04-19T08:56:09,945 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-04-19T08:56:09,985 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-04-19T08:56:10,569 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-histogram, druid-datasketches, druid-kafka-indexing-service, mysql-metadata-storage, druid-hdfs-storage]}]
2017-04-19T08:56:10,573 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.cli.CliCommandCreator]
2017-04-19T08:56:10,584 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-histogram/druid-histogram-0.9.2.jar]
2017-04-19T08:56:10,586 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.cli.CliCommandCreator]
2017-04-19T08:56:10,587 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/druid-datasketches-0.9.2.jar]
2017-04-19T08:56:10,587 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/sketches-core-0.4.1.jar]
2017-04-19T08:56:10,588 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.cli.CliCommandCreator]
2017-04-19T08:56:10,588 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.9.2.jar]
2017-04-19T08:56:10,589 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/slf4j-api-1.7.6.jar]
2017-04-19T08:56:10,589 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2017-04-19T08:56:10,589 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/kafka-clients-0.9.0.1.jar]
2017-04-19T08:56:10,589 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/snappy-java-1.1.1.7.jar]
2017-04-19T08:56:10,592 INFO [main] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.cli.CliCommandCreator]
2017-04-19T08:56:10,592 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar]
2017-04-19T08:56:10,592 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-metadata-storage-0.9.1.1.jar]
2017-04-19T08:56:10,594 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.cli.CliCommandCreator]
2017-04-19T08:56:10,595 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-04-19T08:56:10,596 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-04-19T08:56:10,597 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-04-19T08:56:10,597 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-04-19T08:56:10,597 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar]
2017-04-19T08:56:10,597 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-04-19T08:56:10,597 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/druid-hdfs-storage-0.9.2.jar]
2017-04-19T08:56:10,598 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar]
2017-04-19T08:56:10,598 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar]
2017-04-19T08:56:10,598 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar]
2017-04-19T08:56:10,598 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-04-19T08:56:10,598 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar]
2017-04-19T08:56:10,599 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-04-19T08:56:10,599 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-04-19T08:56:10,599 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-04-19T08:56:10,600 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar]
2017-04-19T08:56:10,600 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar]
2017-04-19T08:56:10,600 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-04-19T08:56:10,600 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-04-19T08:56:10,600 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar]
2017-04-19T08:56:10,601 INFO [main] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-04-19T08:56:10,822 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,826 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,826 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,829 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,830 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,830 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,832 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,832 INFO [main] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,834 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,834 INFO [main] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:10,837 INFO [main] io.druid.initialization.Initialization - Adding local file system extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:12,883 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-04-19T08:56:12,954 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@704641e3]
2017-04-19T08:56:12,966 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-04-19T08:56:12,996 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='s7spkhdp11.buyabs.corp', port=8100}]
2017-04-19T08:56:13,192 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-04-19T08:56:13,193 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-04-19T08:56:13,212 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-histogram, druid-datasketches, druid-kafka-indexing-service, mysql-metadata-storage, druid-hdfs-storage]}]
2017-04-19T08:56:13,215 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@3a26ec8d]
2017-04-19T08:56:13,216 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@10f7918f]
2017-04-19T08:56:13,216 INFO [main] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@17f3eefb]
2017-04-19T08:56:13,229 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [io.druid.server.log.StartupLoggingConfig@58434b19]
2017-04-19T08:56:13,230 INFO [main] io.druid.cli.CliPeon - Starting up with processors[48], memory[1,495,269,376].
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.emitter: logging
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-histogram", "druid-datasketches", "druid-kafka-indexing-service","mysql-metadata-storage","druid-hdfs-storage"]
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.host: s7spkhdp11.buyabs.corp
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.directory: hdfs://nameservice1/user/druid/indexing-logs
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs
2017-04-19T08:56:13,231 INFO [main] io.druid.cli.CliPeon - * druid.indexer.runner.javaOpts: -server -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.baseTaskDir: var/druid/task
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.indexer.task.hadoopWorkingPath: var/druid/hadoop-tmp
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:mysql://10.1.41.250:3306/druid
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.password: <masked>
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.connector.user: druid
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metadata.storage.type: mysql
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: all_page_view
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_hadoop_all_page_view_2017-04-19T08:56:08.110Z
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.monitoring.monitors: ["com.metamx.metrics.JvmMonitor"]
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.port: 8100
2017-04-19T08:56:13,232 INFO [main] io.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 536870912
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.processing.numThreads: 2
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.server.http.numThreads: 40
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.service: druid/middlemanager
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.storage.storageDirectory: hdfs://nameservice1/user/druid/storage
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.storage.type: hdfs
2017-04-19T08:56:13,233 INFO [main] io.druid.cli.CliPeon - * druid.worker.capacity: 48
2017-04-19T08:56:13,234 INFO [main] io.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2017-04-19T08:56:13,234 INFO [main] io.druid.cli.CliPeon - * druid.zk.service.host: 10.1.41.250:2181
2017-04-19T08:56:13,234 INFO [main] io.druid.cli.CliPeon - * file.encoding: UTF-8
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * file.separator: /
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.class.path: conf/druid/_common:conf/druid/middleManager:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/log4j-core-2.5.jar:lib/extendedset-1.3.10.jar:lib/jetty-continuation-9.2.5.v20141112.jar:lib/jetty-servlet-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/joda-time-2.8.2.jar:lib/commons-dbcp2-2.0.1.jar:lib/RoaringBitmap-0.5.18.jar:lib/javax.el-api-3.0.0.jar:lib/commons-logging-1.1.1.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/antlr4-runtime-4.5.1.jar:lib/druid-common-0.9.2.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/java-xmlbuilder-1.1.jar:lib/javax.servlet-api-3.1.0.jar:lib/plexus-interpolation-1.19.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/derbynet-10.11.1.1.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/maven-settings-builder-3.1.1.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/compress-lzf-1.0.3.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/slf4j-api-1.7.12.jar:lib/log4j-api-2.5.jar:lib/spymemcached-2.11.7.jar:lib/bcprov-jdk15on-1.52.jar:lib/jetty-client-9.2.5.v20141112.jar:lib/guava-16.0.1.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/commons-math3-3.6.1.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/annotations-2.0.3.jar:lib/jackson-core-2.4.6.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/http-client-1.0.4.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/disruptor-3.3.0.jar:lib/aether-impl-0.9.0.M2.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/classmate-1.0.0.jar:lib/jetty-util-9.2.5.v20141112.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/commons-pool2-2.2.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/log4j-jul-2.5.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/jets3t-0.9.4.jar:lib/jetty-http-9.2.5.v20141112.jar:lib/plexus-utils-3.0.15.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/jersey-servlet-1.19.jar:lib/jersey-server-1.19.jar:lib/httpclient-4.5.1.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/commons-io-2.4.jar:lib/guice-multibindings-4.1.0.jar:lib/druid-services-0.9.2.jar:lib/commons-cli-1.2.jar:lib/validation-api-1.1.0.Final.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/base64-2.3.8.jar:lib/okhttp-1.0.2.jar:lib/guice-4.1.0.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/druid-console-0.0.2.jar:lib/lz4-1.3.0.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/curator-client-2.11.0.jar:lib/jdbi-2.63.1.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/druid-processing-0.9.2.jar:lib/maven-repository-metadata-3.1.1.jar:lib/druid-server-0.9.2.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/jsr305-2.0.1.jar:lib/curator-x-discovery-2.11.0.jar:lib/rhino-1.7R5.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/aopalliance-1.0.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/httpcore-4.4.3.jar:lib/config-magic-0.9.jar:lib/jetty-proxy-9.2.5.v20141112.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/emitter-0.3.6.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/java-util-0.27.10.jar:lib/curator-framework-2.11.0.jar:lib/commons-codec-1.7.jar:lib/druid-indexing-service-0.9.2.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/druid-aws-common-0.9.2.jar:lib/javax.inject-1.jar:lib/jackson-databind-2.4.6.jar:lib/jetty-servlets-9.2.5.v20141112.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/wagon-provider-api-2.4.jar:lib/jboss-logging-3.1.3.GA.jar:lib/derby-10.11.1.1.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/airline-0.7.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/jetty-security-9.2.5.v20141112.jar:lib/druid-indexing-hadoop-0.9.2.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/curator-recipes-2.11.0.jar:lib/maven-model-builder-3.1.1.jar:lib/jersey-guice-1.19.jar:lib/mapdb-1.0.8.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/jersey-core-1.19.jar:lib/javax.el-3.0.0.jar:lib/aws-java-sdk-1.10.21.jar:lib/aether-util-0.9.0.M2.jar:lib/protobuf-java-2.5.0.jar:lib/aether-spi-0.9.0.M2.jar:lib/netty-3.10.4.Final.jar:lib/opencsv-2.3.jar:lib/log4j-slf4j-impl-2.5.jar:lib/druid-api-0.9.2.jar:lib/zookeeper-3.4.9.jar:lib/bytebuffer-collections-0.2.5.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/jetty-server-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/maven-aether-provider-3.1.1.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/icu4j-4.8.1.jar:lib/commons-lang-2.6.jar:lib/jackson-core-asl-1.9.13.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/jackson-annotations-2.4.6.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/server-metrics-0.2.8.jar:lib/jetty-io-9.2.5.v20141112.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/geoip2-0.4.0.jar:lib/log4j-1.2-api-2.5.jar:lib/maven-model-3.1.1.jar:lib/guice-servlet-4.1.0.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/jline-0.9.94.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/activation-1.1.1.jar:lib/aether-api-0.9.0.M2.jar:lib/irc-api-1.0-0014.jar
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.class.version: 52.0
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.endorsed.dirs: /usr/local/java/jdk1.8.0_65/jre/lib/endorsed
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.ext.dirs: /usr/local/java/jdk1.8.0_65/jre/lib/ext:/usr/java/packages/lib/ext
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.home: /usr/local/java/jdk1.8.0_65/jre
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.io.tmpdir: var/tmp
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-04-19T08:56:13,235 INFO [main] io.druid.cli.CliPeon - * java.runtime.name: Java(TM) SE Runtime Environment
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.runtime.version: 1.8.0_65-b17
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.specification.version: 1.8
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.version: 1.8.0_65
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.vm.info: mixed mode
2017-04-19T08:56:13,236 INFO [main] io.druid.cli.CliPeon - * java.vm.name: Java HotSpot(TM) 64-Bit Server VM
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * java.vm.version: 25.65-b01
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * line.separator:

2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: io.druid.common.config.Log4jShutdown
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2017-04-19T08:56:13,237 INFO [main] io.druid.cli.CliPeon - * os.arch: amd64
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * os.name: Linux
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * os.version: 2.6.32-431.el6.x86_64
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * path.separator: :
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.arch.data.model: 64
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.boot.class.path: /usr/local/java/jdk1.8.0_65/jre/lib/resources.jar:/usr/local/java/jdk1.8.0_65/jre/lib/rt.jar:/usr/local/java/jdk1.8.0_65/jre/lib/sunrsasign.jar:/usr/local/java/jdk1.8.0_65/jre/lib/jsse.jar:/usr/local/java/jdk1.8.0_65/jre/lib/jce.jar:/usr/local/java/jdk1.8.0_65/jre/lib/charsets.jar:/usr/local/java/jdk1.8.0_65/jre/lib/jfr.jar:/usr/local/java/jdk1.8.0_65/jre/classes
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.boot.library.path: /usr/local/java/jdk1.8.0_65/jre/lib/amd64
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.cpu.endian: little
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.cpu.isalist:
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.java.command: io.druid.cli.Main internal peon var/druid/task/index_hadoop_all_page_view_2017-04-19T08:56:08.110Z/task.json var/druid/task/index_hadoop_all_page_view_2017-04-19T08:56:08.110Z/773aaef8-16da-495a-b0a5-e61d2667df7f/status.json
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2017-04-19T08:56:13,238 INFO [main] io.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * sun.os.patch.level: unknown
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.country: US
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.dir: /home/ABS_CORP/druid/druid-0.9.2
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.home: /home/ABS_CORP/druid
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.language: en
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.name: druid
2017-04-19T08:56:13,239 INFO [main] io.druid.cli.CliPeon - * user.timezone: UTC
2017-04-19T08:56:13,243 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.storage.hdfs.HdfsKerberosConfig@0]
2017-04-19T08:56:13,254 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@2eeb0f9b]
2017-04-19T08:56:13,259 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@31dfc6f5]
2017-04-19T08:56:13,432 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@6a6f6c7e]
2017-04-19T08:56:13,438 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@7f37b6d9]
2017-04-19T08:56:13,444 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2017-04-19T08:56:13,476 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@1abebef3]
2017-04-19T08:56:13,813 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@7d979d34]
2017-04-19T08:56:13,815 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.hdfs.HdfsDataSegmentPusherConfig@42cc183e]
2017-04-19T08:56:13,816 INFO [main] io.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2017-04-19T08:56:13,824 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@9efcd90]
2017-04-19T08:56:13,827 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@14fded9d]
2017-04-19T08:56:13,834 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d]
2017-04-19T08:56:13,845 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@2dbfcf7]
2017-04-19T08:56:13,848 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@12b5736c]
2017-04-19T08:56:13,855 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@228bda54]
2017-04-19T08:56:13,860 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [536870912] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-04-19T08:56:13,865 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-04-19T08:56:13,867 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-04-19T08:56:13,868 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-04-19T08:56:13,868 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-04-19T08:56:13,868 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-04-19T08:56:13,869 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-04-19T08:56:14,055 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@550e9be6]
2017-04-19T08:56:14,060 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@233db8e9]
2017-04-19T08:56:14,069 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@769bd849]
2017-04-19T08:56:14,111 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@168b4cb0]
2017-04-19T08:56:14,128 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@7ab1127c]
2017-04-19T08:56:14,143 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@3596b249]
2017-04-19T08:56:14,174 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}]
2017-04-19T08:56:14,178 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@78d9f51b]
2017-04-19T08:56:14,183 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{enabled=false}]
2017-04-19T08:56:14,200 INFO [main] org.eclipse.jetty.util.log - Logging initialized @6016ms
2017-04-19T08:56:14,354 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir=''}]
2017-04-19T08:56:14,358 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2017-04-19T08:56:14,360 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@6435fa1c].
2017-04-19T08:56:14,361 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2017-04-19T08:56:14,361 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@1450131a].
2017-04-19T08:56:14,361 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@5f7eee96].
2017-04-19T08:56:14,362 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@3a36cd5].
2017-04-19T08:56:14,368 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@47272cd3].
2017-04-19T08:56:14,369 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@707ca986].
2017-04-19T08:56:14,369 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2017-04-19T08:56:14,369 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2017-04-19T08:56:14,382 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT
2017-04-19T08:56:14,382 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=s7spkhdp11.buyabs.corp
2017-04-19T08:56:14,382 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_65
2017-04-19T08:56:14,382 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2017-04-19T08:56:14,382 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/local/java/jdk1.8.0_65/jre
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=conf/druid/_common:conf/druid/middleManager:lib/aws-java-sdk-kinesis-1.10.21.jar:lib/log4j-core-2.5.jar:lib/extendedset-1.3.10.jar:lib/jetty-continuation-9.2.5.v20141112.jar:lib/jetty-servlet-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudhsm-1.10.21.jar:lib/joda-time-2.8.2.jar:lib/commons-dbcp2-2.0.1.jar:lib/RoaringBitmap-0.5.18.jar:lib/javax.el-api-3.0.0.jar:lib/commons-logging-1.1.1.jar:lib/aws-java-sdk-cloudformation-1.10.21.jar:lib/antlr4-runtime-4.5.1.jar:lib/druid-common-0.9.2.jar:lib/aws-java-sdk-autoscaling-1.10.21.jar:lib/aws-java-sdk-glacier-1.10.21.jar:lib/java-xmlbuilder-1.1.jar:lib/javax.servlet-api-3.1.0.jar:lib/plexus-interpolation-1.19.jar:lib/aws-java-sdk-simpledb-1.10.21.jar:lib/derbynet-10.11.1.1.jar:lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:lib/aws-java-sdk-workspaces-1.10.21.jar:lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:lib/hibernate-validator-5.1.3.Final.jar:lib/maven-settings-builder-3.1.1.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aws-java-sdk-ec2-1.10.21.jar:lib/compress-lzf-1.0.3.jar:lib/aws-java-sdk-simpleworkflow-1.10.21.jar:lib/aws-java-sdk-ecs-1.10.21.jar:lib/slf4j-api-1.7.12.jar:lib/log4j-api-2.5.jar:lib/spymemcached-2.11.7.jar:lib/bcprov-jdk15on-1.52.jar:lib/jetty-client-9.2.5.v20141112.jar:lib/guava-16.0.1.jar:lib/aws-java-sdk-codedeploy-1.10.21.jar:lib/commons-math3-3.6.1.jar:lib/aws-java-sdk-iam-1.10.21.jar:lib/annotations-2.0.3.jar:lib/jackson-core-2.4.6.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/http-client-1.0.4.jar:lib/aws-java-sdk-directconnect-1.10.21.jar:lib/commons-pool-1.6.jar:lib/aws-java-sdk-datapipeline-1.10.21.jar:lib/json-path-2.1.0.jar:lib/aws-java-sdk-logs-1.10.21.jar:lib/disruptor-3.3.0.jar:lib/aether-impl-0.9.0.M2.jar:lib/aws-java-sdk-elastictranscoder-1.10.21.jar:lib/aws-java-sdk-ses-1.10.21.jar:lib/classmate-1.0.0.jar:lib/jetty-util-9.2.5.v20141112.jar:lib/aws-java-sdk-opsworks-1.10.21.jar:lib/jackson-datatype-joda-2.4.6.jar:lib/commons-pool2-2.2.jar:lib/jcl-over-slf4j-1.7.12.jar:lib/aws-java-sdk-elasticache-1.10.21.jar:lib/log4j-jul-2.5.jar:lib/aws-java-sdk-sns-1.10.21.jar:lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:lib/jets3t-0.9.4.jar:lib/jetty-http-9.2.5.v20141112.jar:lib/plexus-utils-3.0.15.jar:lib/maxminddb-0.2.0.jar:lib/aws-java-sdk-directory-1.10.21.jar:lib/jersey-servlet-1.19.jar:lib/jersey-server-1.19.jar:lib/httpclient-4.5.1.jar:lib/jackson-datatype-guava-2.4.6.jar:lib/commons-io-2.4.jar:lib/guice-multibindings-4.1.0.jar:lib/druid-services-0.9.2.jar:lib/commons-cli-1.2.jar:lib/validation-api-1.1.0.Final.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/base64-2.3.8.jar:lib/okhttp-1.0.2.jar:lib/guice-4.1.0.jar:lib/aws-java-sdk-emr-1.10.21.jar:lib/aws-java-sdk-codecommit-1.10.21.jar:lib/druid-console-0.0.2.jar:lib/lz4-1.3.0.jar:lib/aws-java-sdk-importexport-1.10.21.jar:lib/jsr311-api-1.1.1.jar:lib/curator-client-2.11.0.jar:lib/jdbi-2.63.1.jar:lib/aws-java-sdk-route53-1.10.21.jar:lib/druid-processing-0.9.2.jar:lib/maven-repository-metadata-3.1.1.jar:lib/druid-server-0.9.2.jar:lib/jackson-jaxrs-smile-provider-2.4.6.jar:lib/jsr305-2.0.1.jar:lib/curator-x-discovery-2.11.0.jar:lib/rhino-1.7R5.jar:lib/aws-java-sdk-sqs-1.10.21.jar:lib/aws-java-sdk-cloudfront-1.10.21.jar:lib/aopalliance-1.0.jar:lib/derbyclient-10.11.1.1.jar:lib/aws-java-sdk-cloudtrail-1.10.21.jar:lib/httpcore-4.4.3.jar:lib/config-magic-0.9.jar:lib/jetty-proxy-9.2.5.v20141112.jar:lib/aws-java-sdk-core-1.10.21.jar:lib/emitter-0.3.6.jar:lib/aws-java-sdk-cognitoidentity-1.10.21.jar:lib/java-util-0.27.10.jar:lib/curator-framework-2.11.0.jar:lib/commons-codec-1.7.jar:lib/druid-indexing-service-0.9.2.jar:lib/aws-java-sdk-devicefarm-1.10.21.jar:lib/aws-java-sdk-cloudwatch-1.10.21.jar:lib/aws-java-sdk-ssm-1.10.21.jar:lib/jackson-jaxrs-base-2.4.6.jar:lib/aws-java-sdk-s3-1.10.21.jar:lib/druid-aws-common-0.9.2.jar:lib/javax.inject-1.jar:lib/jackson-databind-2.4.6.jar:lib/jetty-servlets-9.2.5.v20141112.jar:lib/jackson-module-jaxb-annotations-2.4.6.jar:lib/aws-java-sdk-config-1.10.21.jar:lib/wagon-provider-api-2.4.jar:lib/jboss-logging-3.1.3.GA.jar:lib/derby-10.11.1.1.jar:lib/jackson-dataformat-smile-2.4.6.jar:lib/airline-0.7.jar:lib/aws-java-sdk-machinelearning-1.10.21.jar:lib/jetty-security-9.2.5.v20141112.jar:lib/druid-indexing-hadoop-0.9.2.jar:lib/jackson-mapper-asl-1.9.13.jar:lib/curator-recipes-2.11.0.jar:lib/maven-model-builder-3.1.1.jar:lib/jersey-guice-1.19.jar:lib/mapdb-1.0.8.jar:lib/aws-java-sdk-swf-libraries-1.10.21.jar:lib/aws-java-sdk-efs-1.10.21.jar:lib/jersey-core-1.19.jar:lib/javax.el-3.0.0.jar:lib/aws-java-sdk-1.10.21.jar:lib/aether-util-0.9.0.M2.jar:lib/protobuf-java-2.5.0.jar:lib/aether-spi-0.9.0.M2.jar:lib/netty-3.10.4.Final.jar:lib/opencsv-2.3.jar:lib/log4j-slf4j-impl-2.5.jar:lib/druid-api-0.9.2.jar:lib/zookeeper-3.4.9.jar:lib/bytebuffer-collections-0.2.5.jar:lib/jackson-jaxrs-json-provider-2.4.6.jar:lib/jetty-server-9.2.5.v20141112.jar:lib/aws-java-sdk-cloudsearch-1.10.21.jar:lib/maven-aether-provider-3.1.1.jar:lib/aws-java-sdk-support-1.10.21.jar:lib/icu4j-4.8.1.jar:lib/commons-lang-2.6.jar:lib/jackson-core-asl-1.9.13.jar:lib/aws-java-sdk-cognitosync-1.10.21.jar:lib/jackson-annotations-2.4.6.jar:lib/aws-java-sdk-lambda-1.10.21.jar:lib/server-metrics-0.2.8.jar:lib/jetty-io-9.2.5.v20141112.jar:lib/aws-java-sdk-codepipeline-1.10.21.jar:lib/aws-java-sdk-rds-1.10.21.jar:lib/tesla-aether-0.0.5.jar:lib/aws-java-sdk-dynamodb-1.10.21.jar:lib/maven-settings-3.1.1.jar:lib/aws-java-sdk-sts-1.10.21.jar:lib/geoip2-0.4.0.jar:lib/log4j-1.2-api-2.5.jar:lib/maven-model-3.1.1.jar:lib/guice-servlet-4.1.0.jar:lib/aws-java-sdk-storagegateway-1.10.21.jar:lib/aws-java-sdk-kms-1.10.21.jar:lib/jline-0.9.94.jar:lib/aws-java-sdk-redshift-1.10.21.jar:lib/activation-1.1.1.jar:lib/aether-api-0.9.0.M2.jar:lib/irc-api-1.0-0014.jar
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=var/tmp
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-431.el6.x86_64
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=druid
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/ABS_CORP/druid
2017-04-19T08:56:14,383 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/ABS_CORP/druid/druid-0.9.2
2017-04-19T08:56:14,384 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.1.41.250:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@3e377967
2017-04-19T08:56:14,402 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@76ff68c5].
2017-04-19T08:56:14,410 INFO [main-SendThread(10.1.41.250:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.1.41.250/10.1.41.250:2181. Will not attempt to authenticate using SASL (unknown error)
2017-04-19T08:56:14,425 INFO [main-SendThread(10.1.41.250:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to 10.1.41.250/10.1.41.250:2181, initiating session
2017-04-19T08:56:14,436 INFO [main-SendThread(10.1.41.250:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.1.41.250/10.1.41.250:2181, sessionid = 0x15b59decdfc00e4, negotiated timeout = 30000
2017-04-19T08:56:14,445 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2017-04-19T08:56:14,567 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@5af5d76f].
2017-04-19T08:56:14,568 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@1eb9a3ef].
2017-04-19T08:56:14,574 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@157d3a45].
2017-04-19T08:56:14,638 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_hadoop",
"id" : "index_hadoop_all_page_view_2017-04-19T08:56:08.110Z",
"spec" : {
"dataSchema" : {
"dataSource" : "all_page_view",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "csv",
"columns" : [ "@timestamp", "Country", "Website", "Page Type", "Page Output", "Page Path", "Chrome Pagename", "Chrome Channel", "Chrome Prop11", "Chrome eVar15", "cookie_id", "session_id" ],
"dimensionsSpec" : {
"dimensions" : [ "Country", "Website", "Page Type", "Page Output", "Page Path", "Chrome Pagename", "Chrome Channel", "Chrome Prop11", "Chrome eVar15" ]
},
"timestampSpec" : {
"format" : "auto",
"column" : "@timestamp"
}
}
},
"metricsSpec" : [ {
"type" : "hyperUnique",
"name" : "Unique Visitors",
"fieldName" : "cookie_id"
}, {
"type" : "hyperUnique",
"name" : "Visits",
"fieldName" : "session_id"
}, {
"type" : "count",
"name" : "Page Views"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "DAY",
"queryGranularity" : {
"type" : "none"
},
"rollup" : true,
"intervals" : [ "2017-01-01T00:00:00.000Z/2017-04-14T00:00:00.000Z" ]
}
},
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "quickstart/druid_allpage_byday_hadoop.csv"
},
"metadataUpdateSpec" : null,
"segmentOutputPath" : null
},
"tuningConfig" : {
"type" : "hadoop",
"workingPath" : null,
"version" : "2017-04-19T08:56:08.110Z",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000,
"maxPartitionSize" : 7500000,
"assumeGrouped" : false,
"numShards" : -1,
"partitionDimensions" : [ ]
},
"shardSpecs" : { },
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"maxRowsInMemory" : 75000,
"leaveIntermediate" : false,
"cleanupOnFailure" : true,
"overwriteFiles" : false,
"ignoreInvalidRows" : false,
"jobProperties" : {
"mapreduce.job.user.classpath.first" : "true"
},
"combineText" : false,
"useCombiner" : false,
"buildV9Directly" : false,
"numBackgroundPersistThreads" : 0,
"forceExtendableShardSpecs" : false
},
"uniqueId" : "3c343a44ed884cd78c48588339e37bf2"
},
"hadoopDependencyCoordinates" : null,
"classpathPrefix" : null,
"context" : null,
"groupId" : "index_hadoop_all_page_view_2017-04-19T08:56:08.110Z",
"dataSource" : "all_page_view",
"resource" : {
"availabilityGroup" : "index_hadoop_all_page_view_2017-04-19T08:56:08.110Z",
"requiredCapacity" : 1
}
}
2017-04-19T08:56:14,644 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[var/druid/task/index_hadoop_all_page_view_2017-04-19T08:56:08.110Z/lock].
2017-04-19T08:56:14,645 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[var/druid/task/index_hadoop_all_page_view_2017-04-19T08:56:08.110Z/lock] in 1ms.
2017-04-19T08:56:14,651 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_hadoop_all_page_view_2017-04-19T08:56:08.110Z]: LockTryAcquireAction{interval=2017-01-01T00:00:00.000Z/2017-04-14T00:00:00.000Z}
2017-04-19T08:56:14,661 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_hadoop_all_page_view_2017-04-19T08:56:08.110Z] to overlord[http://s7spkhdp10.buyabs.corp:8090/druid/indexer/v1/action]: LockTryAcquireAction{interval=2017-01-01T00:00:00.000Z/2017-04-14T00:00:00.000Z}
2017-04-19T08:56:14,675 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,718 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,719 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,720 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,720 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,720 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,720 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,721 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,721 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,724 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,724 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,730 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,730 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,732 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,732 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,732 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,733 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,733 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,734 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,735 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://s7spkhdp10.buyabs.corp:8090
2017-04-19T08:56:14,850 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_hadoop_all_page_view_2017-04-19T08:56:08.110Z
2017-04-19T08:56:14,852 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_all_page_view_2017-04-19T08:56:08.110Z] location changed to [TaskLocation{host='s7spkhdp11.buyabs.corp', port=8100}].
2017-04-19T08:56:14,854 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_all_page_view_2017-04-19T08:56:08.110Z] status changed to [RUNNING].
2017-04-19T08:56:14,860 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/snappy-java-1.0.4.1.jar]
2017-04-19T08:56:14,861 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/servlet-api-2.5.jar]
2017-04-19T08:56:14,861 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/guava-11.0.2.jar]
2017-04-19T08:56:14,861 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar]
2017-04-19T08:56:14,862 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jackson-core-asl-1.8.8.jar]
2017-04-19T08:56:14,862 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-codec-1.4.jar]
2017-04-19T08:56:14,862 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-auth-2.3.0.jar]
2017-04-19T08:56:14,862 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jackson-mapper-asl-1.8.8.jar]
2017-04-19T08:56:14,863 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jetty-util-6.1.26.jar]
2017-04-19T08:56:14,863 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/httpcore-4.2.5.jar]
2017-04-19T08:56:14,863 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-net-3.1.jar]
2017-04-19T08:56:14,863 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar]
2017-04-19T08:56:14,864 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jersey-core-1.9.jar]
2017-04-19T08:56:14,864 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/xmlenc-0.52.jar]
2017-04-19T08:56:14,864 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jsr305-1.3.9.jar]
2017-04-19T08:56:14,864 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-compress-1.4.1.jar]
2017-04-19T08:56:14,865 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-math3-3.1.1.jar]
2017-04-19T08:56:14,865 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-io-2.4.jar]
2017-04-19T08:56:14,865 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-cli-1.2.jar]
2017-04-19T08:56:14,865 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar]
2017-04-19T08:56:14,866 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-04-19T08:56:14,866 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-hdfs-2.3.0.jar]
2017-04-19T08:56:14,866 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-common-2.3.0.jar]
2017-04-19T08:56:14,866 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-collections-3.2.1.jar]
2017-04-19T08:56:14,867 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/xz-1.0.jar]
2017-04-19T08:56:14,867 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-annotations-2.3.0.jar]
2017-04-19T08:56:14,867 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-client-2.3.0.jar]
2017-04-19T08:56:14,867 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/jaxb-api-2.2.2.jar]
2017-04-19T08:56:14,867 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112
2017-04-19T08:56:14,867 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/avro-1.7.4.jar]
2017-04-19T08:56:14,868 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/paranamer-2.3.jar]
2017-04-19T08:56:14,869 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-common-2.3.0.jar]
2017-04-19T08:56:14,869 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-api-2.3.0.jar]
2017-04-19T08:56:14,869 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-core-1.8.0.jar]
2017-04-19T08:56:14,870 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-configuration-1.6.jar]
2017-04-19T08:56:14,870 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-yarn-server-common-2.3.0.jar]
2017-04-19T08:56:14,870 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/zookeeper-3.4.5.jar]
2017-04-19T08:56:14,870 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/slf4j-api-1.7.5.jar]
2017-04-19T08:56:14,871 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-04-19T08:56:14,871 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/protobuf-java-2.5.0.jar]
2017-04-19T08:56:14,871 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-digester-1.8.jar]
2017-04-19T08:56:14,871 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-logging-1.1.3.jar]
2017-04-19T08:56:14,871 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar]
2017-04-19T08:56:14,872 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-beanutils-1.7.0.jar]
2017-04-19T08:56:14,872 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/hadoop-client-2.3.0.jar]
2017-04-19T08:56:14,872 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-lang-2.6.jar]
2017-04-19T08:56:14,872 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/httpclient-4.2.5.jar]
2017-04-19T08:56:14,872 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/stax-api-1.0-2.jar]
2017-04-19T08:56:14,873 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/activation-1.1.jar]
2017-04-19T08:56:14,873 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/log4j-1.2.17.jar]
2017-04-19T08:56:14,873 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/commons-httpclient-3.1.jar]
2017-04-19T08:56:14,874 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopTask - Hadoop Container Druid Classpath is set to [file:/home/ABS_CORP/druid/druid-0.9.2/conf/druid/_common/:file:/home/ABS_CORP/druid/druid-0.9.2/conf/druid/middleManager/:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-kinesis-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-core-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/extendedset-1.3.10.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-continuation-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-servlet-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudhsm-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/joda-time-2.8.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-dbcp2-2.0.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/RoaringBitmap-0.5.18.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/javax.el-api-3.0.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-logging-1.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudformation-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/antlr4-runtime-4.5.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-common-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-autoscaling-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-glacier-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/java-xmlbuilder-1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/javax.servlet-api-3.1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/plexus-interpolation-1.19.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-simpledb-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/derbynet-10.11.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-workspaces-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/hibernate-validator-5.1.3.Final.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-settings-builder-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-connector-okhttp-0.0.9.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-ec2-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/compress-lzf-1.0.3.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-ecs-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/slf4j-api-1.7.12.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-api-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/spymemcached-2.11.7.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/bcprov-jdk15on-1.52.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-client-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/guava-16.0.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-codedeploy-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-math3-3.6.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-iam-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/annotations-2.0.3.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-core-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/google-http-client-jackson2-1.15.0-rc.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/http-client-1.0.4.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-directconnect-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-pool-1.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-datapipeline-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/json-path-2.1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-logs-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/disruptor-3.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-impl-0.9.0.M2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-ses-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/classmate-1.0.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-util-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-opsworks-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-datatype-joda-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-pool2-2.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jcl-over-slf4j-1.7.12.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-elasticache-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-jul-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-sns-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jets3t-0.9.4.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-http-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/plexus-utils-3.0.15.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maxminddb-0.2.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-directory-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jersey-servlet-1.19.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jersey-server-1.19.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/httpclient-4.5.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-datatype-guava-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-io-2.4.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/guice-multibindings-4.1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-services-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-cli-1.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/validation-api-1.1.0.Final.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-connector-file-0.9.0.M2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/base64-2.3.8.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/okhttp-1.0.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/guice-4.1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-emr-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-codecommit-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-console-0.0.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/lz4-1.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-importexport-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jsr311-api-1.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/curator-client-2.11.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jdbi-2.63.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-route53-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-processing-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-repository-metadata-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-server-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jsr305-2.0.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/curator-x-discovery-2.11.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/rhino-1.7R5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-sqs-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudfront-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aopalliance-1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/derbyclient-10.11.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudtrail-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/httpcore-4.4.3.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/config-magic-0.9.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-proxy-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-core-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/emitter-0.3.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/java-util-0.27.10.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/curator-framework-2.11.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-codec-1.7.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-indexing-service-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-devicefarm-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudwatch-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-ssm-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-jaxrs-base-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-s3-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-aws-common-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/javax.inject-1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-databind-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-servlets-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-module-jaxb-annotations-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-config-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/wagon-provider-api-2.4.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jboss-logging-3.1.3.GA.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/derby-10.11.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-dataformat-smile-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/airline-0.7.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-machinelearning-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-security-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-indexing-hadoop-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-mapper-asl-1.9.13.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/curator-recipes-2.11.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-model-builder-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jersey-guice-1.19.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/mapdb-1.0.8.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-swf-libraries-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-efs-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jersey-core-1.19.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/javax.el-3.0.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-util-0.9.0.M2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/protobuf-java-2.5.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-spi-0.9.0.M2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/netty-3.10.4.Final.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/opencsv-2.3.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-slf4j-impl-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/druid-api-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/zookeeper-3.4.9.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/bytebuffer-collections-0.2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-server-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cloudsearch-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-aether-provider-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-support-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/icu4j-4.8.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/commons-lang-2.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-core-asl-1.9.13.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-cognitosync-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jackson-annotations-2.4.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-lambda-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/server-metrics-0.2.8.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jetty-io-9.2.5.v20141112.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-codepipeline-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-rds-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/tesla-aether-0.0.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-dynamodb-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-settings-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-sts-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/geoip2-0.4.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-1.2-api-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/maven-model-3.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/guice-servlet-4.1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-storagegateway-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-kms-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/jline-0.9.94.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aws-java-sdk-redshift-1.10.21.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/activation-1.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/aether-api-0.9.0.M2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/irc-api-1.0-0014.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-histogram/druid-histogram-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/druid-datasketches-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/sketches-core-0.4.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/slf4j-api-1.7.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/kafka-clients-0.9.0.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/snappy-java-1.1.1.7.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-metadata-storage-0.9.1.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/servlet-api-2.5.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/guava-16.0.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-net-3.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xmlenc-0.52.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/druid-hdfs-storage-0.9.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xz-1.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/avro-1.7.4.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/paranamer-2.3.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-configuration-1.6.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-digester-1.8.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar:file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/ABS_CORP/druid/druid-0.9.2/lib/log4j-slf4j-impl-2.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/ABS_CORP/druid/druid-0.9.2/hadoop-dependencies/hadoop-client/2.3.0/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2017-04-19T08:56:15,138 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2017-04-19T08:56:15,139 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2017-04-19T08:56:15,140 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2017-04-19T08:56:15,140 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering io.druid.server.StatusResource as a root resource class
2017-04-19T08:56:15,145 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM'
2017-04-19T08:56:15,326 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2017-04-19T08:56:15,331 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-04-19T08:56:15,349 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2017-04-19 08:56:15,435 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19 08:56:15,441 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70)
at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19 08:56:15,461 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19 08:56:15,464 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:81)
at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:44)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:490)
at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:460)
at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:256)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:561)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19 08:56:15,471 task-runner-0-priority-0 WARN JNDI lookup class is not available because this JRE does not support JNDI. JNDI string lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JndiLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:94)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19 08:56:15,473 task-runner-0-priority-0 WARN JMX runtime input lookup class is not available because this JRE does not support JMX. JMX lookups will not be available, continuing configuration. java.lang.ClassCastException: Cannot cast org.apache.logging.log4j.core.lookup.JmxRuntimeInputArgumentsLookup to org.apache.logging.log4j.core.lookup.StrLookup
at java.lang.Class.cast(Class.java:3369)
at org.apache.logging.log4j.util.LoaderUtil.newCheckedInstanceOf(LoaderUtil.java:167)
at org.apache.logging.log4j.core.util.Loader.newCheckedInstanceOf(Loader.java:301)
at org.apache.logging.log4j.core.lookup.Interpolator.<init>(Interpolator.java:105)
at org.apache.logging.log4j.core.config.AbstractConfiguration.<init>(AbstractConfiguration.java:111)
at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:48)
at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:444)
at org.apache.logging.log4j.core.layout.PatternLayout.createDefaultLayout(PatternLayout.java:327)
at org.apache.logging.log4j.core.appender.ConsoleAppender$Builder.<init>(ConsoleAppender.java:157)
at org.apache.logging.log4j.core.appender.ConsoleAppender.newBuilder(ConsoleAppender.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.createBuilder(PluginBuilder.java:154)
at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:119)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:888)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:828)
at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:820)
at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:449)
at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:197)
at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:209)
at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:492)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:562)
at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:578)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:214)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.log4j.jul.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:34)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.log4j.jul.LogManager.getLogger(LogManager.java:89)
at java.util.logging.LogManager.demandLogger(LogManager.java:551)
at java.util.logging.Logger.demandLogger(Logger.java:455)
at java.util.logging.Logger.getLogger(Logger.java:502)
at com.google.inject.internal.util.Stopwatch.<clinit>(Stopwatch.java:27)
at com.google.inject.internal.InternalInjectorCreator.<init>(InternalInjectorCreator.java:61)
at com.google.inject.Guice.createInjector(Guice.java:96)
at com.google.inject.Guice.createInjector(Guice.java:73)
at io.druid.guice.GuiceInjectors.makeStartupInjector(GuiceInjectors.java:59)
at io.druid.indexer.HadoopDruidIndexerConfig.<clinit>(HadoopDruidIndexerConfig.java:100)
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:277)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201)
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

2017-04-19T08:56:15,711 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-04-19T08:56:15,714 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-04-19T08:56:15,757 INFO [task-runner-0-priority-0] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2017-04-19T08:56:15,992 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2017-04-19T08:56:16,005 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2017-04-19T08:56:16,014 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2017-04-19T08:56:16,018 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2017-04-19T08:56:16,022 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2017-04-19T08:56:16,026 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2017-04-19T08:56:16,067 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@1c84d80a{/,null,AVAILABLE}
2017-04-19T08:56:16,084 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@20256a0b{HTTP/1.1}{0.0.0.0:8100}
2017-04-19T08:56:16,085 INFO [main] org.eclipse.jetty.server.Server - Started @7907ms
2017-04-19T08:56:16,088 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.query.lookup.LookupReferencesManager.start()] on object[io.druid.query.lookup.LookupReferencesManager@624b3544].
2017-04-19T08:56:16,088 INFO [main] io.druid.query.lookup.LookupReferencesManager - Started lookup factory references manager
2017-04-19T08:56:16,088 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@454bcbbf].
2017-04-19T08:56:16,115 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/s7spkhdp11.buyabs.corp:8100]
2017-04-19T08:56:16,115 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@2ce524d2].
2017-04-19T08:56:16,116 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='s7spkhdp11.buyabs.corp:8100', host='s7spkhdp11.buyabs.corp:8100', maxSize=0, tier='_default_tier', type='indexer-executor', priority='0'}] at [/druid/announcements/s7spkhdp11.buyabs.corp:8100]
2017-04-19T08:56:16,450 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-histogram, druid-datasketches, druid-kafka-indexing-service, mysql-metadata-storage, druid-hdfs-storage]}]
2017-04-19T08:56:16,453 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,456 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.SketchModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,456 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,457 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.indexing.kafka.KafkaIndexTaskModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,458 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,460 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Adding classpath extension module [io.druid.storage.hdfs.HdfsStorageDruidModule] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,460 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-histogram] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,472 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-histogram/druid-histogram-0.9.2.jar]
2017-04-19T08:56:16,474 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,474 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/druid-datasketches-0.9.2.jar]
2017-04-19T08:56:16,474 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-datasketches/sketches-core-0.4.1.jar]
2017-04-19T08:56:16,476 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,476 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.9.2.jar]
2017-04-19T08:56:16,476 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/slf4j-api-1.7.6.jar]
2017-04-19T08:56:16,476 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/lz4-1.3.0.jar]
2017-04-19T08:56:16,476 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/kafka-clients-0.9.0.1.jar]
2017-04-19T08:56:16,477 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-kafka-indexing-service/snappy-java-1.1.1.7.jar]
2017-04-19T08:56:16,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [mysql-metadata-storage] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-connector-java-5.1.38.jar]
2017-04-19T08:56:16,479 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/mysql-metadata-storage/mysql-metadata-storage-0.9.1.1.jar]
2017-04-19T08:56:16,482 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [io.druid.initialization.DruidModule]
2017-04-19T08:56:16,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/snappy-java-1.0.4.1.jar]
2017-04-19T08:56:16,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/servlet-api-2.5.jar]
2017-04-19T08:56:16,483 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-core-2.3.0.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-auth-2.3.0.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/guava-16.0.1.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-math3-3.6.1.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-net-3.1.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xmlenc-0.52.jar]
2017-04-19T08:56:16,485 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-compress-1.4.1.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.3.0.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.3.0.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/druid-hdfs-storage-0.9.2.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-hdfs-2.3.0.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-common-2.3.0.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-collections-3.2.1.jar]
2017-04-19T08:56:16,486 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/xz-1.0.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-client-2.3.0.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/avro-1.7.4.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/paranamer-2.3.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-common-2.3.0.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-api-2.3.0.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-configuration-1.6.jar]
2017-04-19T08:56:16,487 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.3.0.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.3.0.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-digester-1.8.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.3.0.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/hadoop-client-2.3.0.jar]
2017-04-19T08:56:16,488 INFO [task-runner-0-priority-0] io.druid.initialization.Initialization - added URL[file:/home/ABS_CORP/druid/druid-0.9.2/extensions/druid-hdfs-storage/stax-api-1.0-2.jar]
2017-04-19T08:56:18,582 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2017-04-19T08:56:18,648 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@14c4ca0b]
2017-04-19T08:56:18,669 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class com.metamx.metrics.JvmMonitor]}]
2017-04-19T08:56:18,674 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[com.metamx.metrics.JvmMonitor@234d6a2a]
2017-04-19T08:56:18,674 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.query.ExecutorServiceMonitor@161e87b0]
2017-04-19T08:56:18,675 INFO [task-runner-0-priority-0] io.druid.server.metrics.MetricsModule - Adding monitor[io.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@1bfb21d6]
2017-04-19T08:56:18,679 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [536870912] for [druid.processing.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]
2017-04-19T08:56:18,681 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [io.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2017-04-19T08:56:18,682 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [io.druid.query.DruidProcessingConfig#getNumMergeBuffers()]
2017-04-19T08:56:18,683 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning value [2] for [druid.processing.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]
2017-04-19T08:56:18,683 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2017-04-19T08:56:18,683 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [io.druid.query.DruidProcessingConfig#isFifo()]
2017-04-19T08:56:18,683 INFO [task-runner-0-priority-0] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2017-04-19T08:56:18,879 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexer.HadoopKerberosConfig] from props[druid.hadoop.security.kerberos.] as [io.druid.indexer.HadoopKerberosConfig@0]
2017-04-19T08:56:19,207 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2017-04-19T08:56:19,208 INFO [task-runner-0-priority-0] io.druid.guice.PropertiesModule - Loading properties from runtime.properties
2017-04-19T08:56:19,231 INFO [task-runner-0-priority-0] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='extensions', hadoopDependenciesDir='hadoop-dependencies', hadoopContainerDruidClasspath='null', loadList=[druid-histogram, druid-datasketches, druid-kafka-indexing-service, mysql-metadata-storage, druid-hdfs-storage]}]
2017-04-19T08:56:19,232 INFO [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Starting a hadoop determine configuration job...
2017-04-19T08:56:19,281 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/druid_allpage_byday_hadoop.csv]
2017-04-19T08:56:20,271 INFO [task-runner-0-priority-0] io.druid.indexer.path.StaticPathSpec - Adding paths[quickstart/druid_allpage_byday_hadoop.csv]
2017-04-19T08:56:20,505 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at e11bkdhdp02.mercury.corp/172.16.156.12:8032
2017-04-19T08:56:20,943 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2017-04-19T08:56:20,959 WARN [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2017-04-19T08:56:21,480 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2017-04-19T08:56:21,566 WARN [task-runner-0-priority-0] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-04-19T08:56:21,949 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - number of splits:1
2017-04-19T08:56:22,140 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.JobSubmitter - Submitting tokens for job: job_1491345386885_18611
2017-04-19T08:56:22,421 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.YARNRunner - Job jar is not present. Not adding any jar to the list of resources.
2017-04-19T08:56:23,233 INFO [task-runner-0-priority-0] org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1491345386885_18611
2017-04-19T08:56:23,308 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - The url to track the job: http://e11bkdhdp02.mercury.corp:8088/proxy/application_1491345386885_18611/
2017-04-19T08:56:23,309 INFO [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job all_page_view-determine_partitions_hashed-Optional.of([2017-01-01T00:00:00.000Z/2017-04-14T00:00:00.000Z]) submitted, status available at: http://e11bkdhdp02.mercury.corp:8088/proxy/application_1491345386885_18611/
2017-04-19T08:56:23,310 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Running job: job_1491345386885_18611
2017-04-19T08:56:50,435 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1491345386885_18611 running in uber mode : false
2017-04-19T08:56:50,438 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2017-04-19T08:56:50,459 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Job job_1491345386885_18611 failed with state FAILED due to: Application application_1491345386885_18611 failed 2 times due to AM Container for appattempt_1491345386885_18611_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://e11bkdhdp02.mercury.corp:8088/proxy/application_1491345386885_18611/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1491345386885_18611_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)
at org.apache.hadoop.util.Shell.run(Shell.java:504)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
2017-04-19T08:56:50,531 INFO [task-runner-0-priority-0] org.apache.hadoop.mapreduce.Job - Counters: 0
2017-04-19T08:56:50,533 ERROR [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job failed: job_1491345386885_18611
2017-04-19T08:56:50,534 INFO [task-runner-0-priority-0] io.druid.indexer.JobHelper - Deleting path[var/druid/hadoop-tmp/all_page_view/2017-04-19T085608.110Z_3c343a44ed884cd78c48588339e37bf2]
2017-04-19T08:56:50,607 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[HadoopIndexTask{id=index_hadoop_all_page_view_2017-04-19T08:56:08.110Z, type=index_hadoop, dataSource=all_page_view}]
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:204) ~[druid-indexing-service-0.9.2.jar:0.9.2]
at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:175) ~[druid-indexing-service-0.9.2.jar:0.9.2]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.9.2.jar:0.9.2]
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.9.2.jar:0.9.2]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_65]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_65]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_65]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_65]
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_65]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_65]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_65]
at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201) ~[druid-indexing-service-0.9.2.jar:0.9.2]
... 7 more
Caused by: com.metamx.common.ISE: Job[class io.druid.indexer.DetermineHashedPartitionsJob] failed!
at io.druid.indexer.JobHelper.runJobs(JobHelper.java:369) ~[druid-indexing-hadoop-0.9.2.jar:0.9.2]
at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:91) ~[druid-indexing-hadoop-0.9.2.jar:0.9.2]
at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessing.runTask(HadoopIndexTask.java:291) ~[druid-indexing-service-0.9.2.jar:0.9.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_65]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_65]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_65]
at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65]
at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:201) ~[druid-indexing-service-0.9.2.jar:0.9.2]
... 7 more
2017-04-19T08:56:50,622 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_all_page_view_2017-04-19T08:56:08.110Z] status changed to [FAILED].
2017-04-19T08:56:50,629 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_hadoop_all_page_view_2017-04-19T08:56:08.110Z",
"status" : "FAILED",
"duration" : 35772
}
2017-04-19T08:56:50,648 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@2ce524d2].
2017-04-19T08:56:50,648 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@22e2266d]
2017-04-19T08:56:50,648 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/s7spkhdp11.buyabs.corp:8100]
2017-04-19T08:56:50,674 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[io.druid.query.lookup.LookupResourceListenerAnnouncer@454bcbbf].
2017-04-19T08:56:50,674 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/s7spkhdp11.buyabs.corp:8100]
2017-04-19T08:56:50,676 INFO [main] io.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/s7spkhdp11.buyabs.corp:8100]
2017-04-19T08:56:50,676 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.query.lookup.LookupReferencesManager.stop()] on object[io.druid.query.lookup.LookupReferencesManager@624b3544].
2017-04-19T08:56:50,677 INFO [main] io.druid.query.lookup.LookupReferencesManager - Stopping lookup factory references manager
2017-04-19T08:56:50,682 INFO [main] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@20256a0b{HTTP/1.1}{0.0.0.0:8100}
2017-04-19T08:56:50,685 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@1c84d80a{/,null,UNAVAILABLE}
2017-04-19T08:56:50,690 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@157d3a45].
2017-04-19T08:56:50,691 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@7eaa2bc6].
2017-04-19T08:56:50,695 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@1eb9a3ef].
2017-04-19T08:56:50,701 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@5af5d76f].
2017-04-19T08:56:50,701 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@76ff68c5].
2017-04-19T08:56:50,701 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2017-04-19T08:56:50,703 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2017-04-19T08:56:50,706 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x15b59decdfc00e4 closed
2017-04-19T08:56:50,707 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@707ca986].
2017-04-19T08:56:50,707 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x15b59decdfc00e4
2017-04-19T08:56:50,838 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.storage.hdfs.HdfsStorageAuthentication.stop()] on object[io.druid.storage.hdfs.HdfsStorageAuthentication@47272cd3].
2017-04-19T08:56:50,839 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@3a36cd5].
2017-04-19T08:56:50,839 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@5f7eee96].
2017-04-19T08:56:50,839 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2017-04-19T08:56:50,839 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@1450131a].
2017-04-19 08:56:50,907 Thread-2 ERROR Unable to register shutdown hook because JVM is shutting down. java.lang.IllegalStateException: Not started
at io.druid.common.config.Log4jShutdown.addShutdownCallback(Log4jShutdown.java:45)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.addShutdownCallback(Log4jContextFactory.java:273)
at org.apache.logging.log4j.core.LoggerContext.setUpShutdownHook(LoggerContext.java:256)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:216)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:284)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:155)
at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:132)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:685)
at org.apache.hadoop.hdfs.LeaseRenewer.<clinit>(LeaseRenewer.java:72)
at org.apache.hadoop.hdfs.DFSClient.getLeaseRenewer(DFSClient.java:699)
at org.apache.hadoop.hdfs.DFSClient.close(DFSClient.java:859)
at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:853)
at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2407)
at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2424)
at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)



and here is my spec

{
"type" : "index_hadoop",
"spec" : {
"ioConfig" : {
"type" : "hadoop",
"inputSpec" : {
"type" : "static",
"paths" : "quickstart/druid_allpage_byday_hadoop.csv"
}
},
"dataSchema" : {
"dataSource" : "all_page_view",
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "day",
"queryGranularity" : "none",
"intervals" : ["2017-01-01/2017-04-14"]
},
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "csv",
"columns" : [
"@timestamp",
"Country",
"Website",
"Page Type",
"Page Output",
"Page Path",
"Chrome Pagename",
"Chrome Channel",
"Chrome Prop11",
"Chrome eVar15",
"cookie_id",
"session_id"
],
"dimensionsSpec" : {
"dimensions" : [
"Country",
"Website",
"Page Type",
"Page Output",
"Page Path",
"Chrome Pagename",
"Chrome Channel",
"Chrome Prop11",
"Chrome eVar15"
]
},
"timestampSpec" : {
"format" : "auto",
"column" : "@timestamp"
}
}
},
"metricsSpec" : [
{
"name" : "Unique Visitors",
"type" : "hyperUnique",
"fieldName" : "cookie_id"
},
{
"name" : "Visits",
"type" : "hyperUnique",
"fieldName" : "session_id"
},
{
"name" : "Page Views",
"type" : "count"
}
]
},
"tuningConfig" : {
"type" : "hadoop",
"partitionsSpec" : {
"type" : "hashed",
"targetPartitionSize" : 5000000
},
"jobProperties" : {
"mapreduce.job.user.classpath.first": "true"
}
}
}
}



joe

unread,
Apr 20, 2017, 4:31:02 AM4/20/17
to Druid User
I got this when tracking the log of hadoop

java.lang.NoSuchMethodError: org.apache.hadoop.yarn.webapp.util.WebAppUtils.getProxyHostsAndPortsForAmFilter(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List;

but still in puzzle.

Jihoon Son

unread,
Apr 22, 2017, 3:52:57 AM4/22/17
to Druid User
Seems a hadoop version problem. WebAppUtils.getProxyHostsAndPortsForAmFilter() is added from 2.4.0, but druid uses hadoop 2.3.0 by default. Would you specify your hadoop version in your ingestion spec? Please refer to http://druid.io/docs/0.10.0/ingestion/batch-ingestion.html for more details.

Jihoon

2017년 4월 20일 (목) 오후 5:31, joe <hey.bi...@gmail.com>님이 작성:
I got this when tracking the log of hadoop

java.lang.NoSuchMethodError: org.apache.hadoop.yarn.webapp.util.WebAppUtils.getProxyHostsAndPortsForAmFilter(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List;

but still in puzzle.

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/d598e002-b049-428c-a528-1a81429facc1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages