2016-02-17T05:57:55,293 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2016-02-17T05:57:55,297 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties Feb 17, 2016 5:57:55 AM org.hibernate.validator.internal.util.Version INFO: HV000001: Hibernate Validator 5.1.3.Final 2016-02-17T05:57:55,992 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight, io.druid.extensions:mysql-metadata-storage, io.druid.extensions:druid-hdfs-storage, io.druid.extensions:druid-s3-extensions], defaultVersion='0.8.3', localRepository='./extensions-repo', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}] 2016-02-17T05:57:56,191 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator] 2016-02-17T05:57:57,751 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-examples/0.8.3/druid-examples-0.8.3.jar] 2016-02-17T05:57:57,751 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar] 2016-02-17T05:57:57,751 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar] 2016-02-17T05:57:57,751 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar] 2016-02-17T05:57:57,752 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar] 2016-02-17T05:57:57,752 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar] 2016-02-17T05:57:57,752 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar] 2016-02-17T05:57:57,752 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T05:57:57,754 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator] 2016-02-17T05:57:57,884 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-kafka-eight/0.8.3/druid-kafka-eight-0.8.3.jar] 2016-02-17T05:57:57,884 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar] 2016-02-17T05:57:57,884 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/log4j/log4j/1.2.16/log4j-1.2.16.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/jline/jline/0.9.94/jline-0.9.94.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar] 2016-02-17T05:57:57,885 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/101tec/zkclient/0.3/zkclient-0.3.jar] 2016-02-17T05:57:57,889 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.cli.CliCommandCreator] 2016-02-17T05:57:58,521 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/mysql-metadata-storage/0.8.3/mysql-metadata-storage-0.8.3.jar] 2016-02-17T05:57:58,522 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/mysql/mysql-connector-java/5.1.34/mysql-connector-java-5.1.34.jar] 2016-02-17T05:57:58,522 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/jdbi/jdbi/2.63.1/jdbi-2.63.1.jar] 2016-02-17T05:57:58,524 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.cli.CliCommandCreator] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-hdfs-storage/0.8.3/druid-hdfs-storage-0.8.3.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/java/dev/jets3t/jets3t/0.9.4/jets3t-0.9.4.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/activation/activation/1.1.1/activation-1.1.1.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar] 2016-02-17T05:57:58,984 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/jamesmurty/utils/java-xmlbuilder/1.1/java-xmlbuilder-1.1.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/iharder/base64/2.3.8/base64-2.3.8.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-cli/commons-cli/1.2/commons-cli-1.2.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/xmlenc/xmlenc/0.52/xmlenc-0.52.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar] 2016-02-17T05:57:58,985 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-net/commons-net/3.1/commons-net-3.1.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/log4j/log4j/1.2.17/log4j-1.2.17.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-lang/commons-lang/2.6/commons-lang-2.6.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/avro/avro/1.7.4/avro-1.7.4.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar] 2016-02-17T05:57:58,986 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/tukaani/xz/1.0/xz-1.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar] 2016-02-17T05:57:58,987 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/sun/jersey/jersey-core/1.19/jersey-core-1.19.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar] 2016-02-17T05:57:58,988 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar] 2016-02-17T05:57:58,989 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar] 2016-02-17T05:57:58,989 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/emitter/0.3.6/emitter-0.3.6.jar] 2016-02-17T05:57:58,989 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/http-client/1.0.4/http-client-1.0.4.jar] 2016-02-17T05:57:58,989 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.10.4.Final/netty-3.10.4.Final.jar] 2016-02-17T05:57:58,989 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar] 2016-02-17T05:57:59,002 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-s3-extensions] for class[io.druid.cli.CliCommandCreator] 2016-02-17T05:57:59,227 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-s3-extensions/0.8.3/druid-s3-extensions-0.8.3.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/java/dev/jets3t/jets3t/0.9.4/jets3t-0.9.4.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-codec/commons-codec/1.7/commons-codec-1.7.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/activation/activation/1.1.1/activation-1.1.1.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/jamesmurty/utils/java-xmlbuilder/1.1/java-xmlbuilder-1.1.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/iharder/base64/2.3.8/base64-2.3.8.jar] 2016-02-17T05:57:59,228 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-1.2-api/2.4.1/log4j-1.2-api-2.4.1.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-api/2.4.1/log4j-api-2.4.1.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-core/2.4.1/log4j-core-2.4.1.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/emitter/0.3.6/emitter-0.3.6.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/http-client/1.0.4/http-client-1.0.4.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.10.4.Final/netty-3.10.4.Final.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/google/guava/guava/16.0.1/guava-16.0.1.jar] 2016-02-17T05:57:59,229 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar] 2016-02-17T05:57:59,545 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,548 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,548 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,551 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,551 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,553 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,553 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,556 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,556 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-s3-extensions] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,736 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.storage.s3.S3StorageDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:57:59,737 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.s3.S3FirehoseDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T05:58:00,345 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-02-17T05:58:01,091 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@64ce2f12] 2016-02-17T05:58:01,103 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}] 2016-02-17T05:58:01,124 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8101}] 2016-02-17T05:58:01,151 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}] 2016-02-17T05:58:01,175 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@4b5f52a7] 2016-02-17T05:58:01,182 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@60520a66] 2016-02-17T05:58:01,249 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@1c91005e] 2016-02-17T05:58:01,254 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@118815a] 2016-02-17T05:58:01,260 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29 2016-02-17T05:58:01,324 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@5968edfc] 2016-02-17T05:58:01,480 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@21c7fd13] 2016-02-17T05:58:01,483 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.aws.AWSCredentialsConfig] from props[druid.s3.] as [io.druid.common.aws.AWSCredentialsConfig@6d87a9d6] 2016-02-17T05:58:01,549 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentPusherConfig@41e0c4c4] 2016-02-17T05:58:01,550 INFO [main] io.druid.storage.s3.S3DataSegmentPusher - Configured S3 as deep storage 2016-02-17T05:58:01,555 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentArchiverConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentArchiverConfig@7c3c52ef] 2016-02-17T05:58:01,574 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@30c72d50] 2016-02-17T05:58:01,579 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@10476fd9] 2016-02-17T05:58:01,594 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d] 2016-02-17T05:58:01,604 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@7bc81b5e] 2016-02-17T05:58:01,607 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@6915222f] 2016-02-17T05:58:01,612 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@42e82104] 2016-02-17T05:58:01,616 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.size, ${base_path}.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2016-02-17T05:58:01,620 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()] 2016-02-17T05:58:01,621 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2016-02-17T05:58:01,621 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()] 2016-02-17T05:58:01,721 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@3c2a99aa] 2016-02-17T05:58:01,726 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@67b46475] 2016-02-17T05:58:01,729 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@4ba70c56] 2016-02-17T05:58:01,735 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@5dc17ceb] 2016-02-17T05:58:01,746 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@4ffa92a3] 2016-02-17T05:58:01,754 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@423cf574] 2016-02-17T05:58:01,758 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@2de45c4f] 2016-02-17T05:58:01,767 INFO [main] org.eclipse.jetty.util.log - Logging initialized @7321ms 2016-02-17T05:58:01,849 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@60c0f5]. 2016-02-17T05:58:01,849 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@501c1504]. 2016-02-17T05:58:01,850 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@63a7e2b2]. 2016-02-17T05:58:01,851 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@475e2446]. 2016-02-17T05:58:01,851 INFO [main] io.druid.curator.CuratorModule - Starting Curator 2016-02-17T05:58:01,851 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=ip-10-95-213-30.ec2.internal 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_95 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/usr/local/druid/config/_common:/usr/local/druid/config/overlord:/usr/local/druid/lib/joda-time-2.8.2.jar:/usr/local/druid/lib/jets3t-0.9.4.jar:/usr/local/druid/lib/antlr4-runtime-4.0.jar:/usr/local/druid/lib/druid-processing-0.8.3.jar:/usr/local/druid/lib/curator-client-2.9.1.jar:/usr/local/druid/lib/httpclient-4.5.1.jar:/usr/local/druid/lib/maven-settings-3.1.1.jar:/usr/local/druid/lib/plexus-utils-3.0.15.jar:/usr/local/druid/lib/javax.el-3.0.0.jar:/usr/local/druid/lib/jetty-util-9.2.5.v20141112.jar:/usr/local/druid/lib/jackson-dataformat-smile-2.4.6.jar:/usr/local/druid/lib/log4j-jul-2.4.1.jar:/usr/local/druid/lib/aws-java-sdk-directory-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-kinesis-1.10.21.jar:/usr/local/druid/lib/commons-dbcp2-2.0.1.jar:/usr/local/druid/lib/http-client-1.0.4.jar:/usr/local/druid/lib/derbynet-10.11.1.1.jar:/usr/local/druid/lib/jcl-over-slf4j-1.7.12.jar:/usr/local/druid/lib/maxminddb-0.2.0.jar:/usr/local/druid/lib/aether-impl-0.9.0.M2.jar:/usr/local/druid/lib/aws-java-sdk-config-1.10.21.jar:/usr/local/druid/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/druid/lib/google-http-client-1.15.0-rc.jar:/usr/local/druid/lib/aws-java-sdk-codepipeline-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-lambda-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-machinelearning-1.10.21.jar:/usr/local/druid/lib/jackson-core-asl-1.9.13.jar:/usr/local/druid/lib/aws-java-sdk-ec2-1.10.21.jar:/usr/local/druid/lib/druid-aws-common-0.8.3.jar:/usr/local/druid/lib/aws-java-sdk-cloudwatch-1.10.21.jar:/usr/local/druid/lib/jersey-server-1.19.jar:/usr/local/druid/lib/aws-java-sdk-directconnect-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-autoscaling-1.10.21.jar:/usr/local/druid/lib/emitter-0.3.6.jar:/usr/local/druid/lib/jackson-datatype-joda-2.4.6.jar:/usr/local/druid/lib/aether-spi-0.9.0.M2.jar:/usr/local/druid/lib/log4j-core-2.4.1.jar:/usr/local/druid/lib/jackson-jaxrs-smile-provider-2.4.6.jar:/usr/local/druid/lib/druid-indexing-service-0.8.3.jar:/usr/local/druid/lib/aws-java-sdk-elasticache-1.10.21.jar:/usr/local/druid/lib/commons-cli-1.2.jar:/usr/local/druid/lib/slf4j-api-1.6.4.jar:/usr/local/druid/lib/commons-io-2.0.1.jar:/usr/local/druid/lib/aws-java-sdk-cognitosync-1.10.21.jar:/usr/local/druid/lib/RoaringBitmap-0.5.16.jar:/usr/local/druid/lib/aws-java-sdk-codecommit-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-cloudsearch-1.10.21.jar:/usr/local/druid/lib/validation-api-1.1.0.Final.jar:/usr/local/druid/lib/classmate-1.0.0.jar:/usr/local/druid/lib/mapdb-1.0.8.jar:/usr/local/druid/lib/commons-lang-2.6.jar:/usr/local/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:/usr/local/druid/lib/commons-codec-1.7.jar:/usr/local/druid/lib/aws-java-sdk-dynamodb-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-workspaces-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-s3-1.10.21.jar:/usr/local/druid/lib/bytebuffer-collections-0.2.4.jar:/usr/local/druid/lib/guice-servlet-4.0-beta.jar:/usr/local/druid/lib/aws-java-sdk-glacier-1.10.21.jar:/usr/local/druid/lib/javax.el-api-3.0.0.jar:/usr/local/druid/lib/aws-java-sdk-opsworks-1.10.21.jar:/usr/local/druid/lib/aether-api-0.9.0.M2.jar:/usr/local/druid/lib/jetty-security-9.2.5.v20141112.jar:/usr/local/druid/lib/protobuf-java-2.5.0.jar:/usr/local/druid/lib/jboss-logging-3.1.3.GA.jar:/usr/local/druid/lib/icu4j-4.8.1.jar:/usr/local/druid/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:/usr/local/druid/lib/maven-model-3.1.1.jar:/usr/local/druid/lib/bcprov-jdk15on-1.52.jar:/usr/local/druid/lib/jetty-continuation-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-efs-1.10.21.jar:/usr/local/druid/lib/lz4-1.3.0.jar:/usr/local/druid/lib/aws-java-sdk-devicefarm-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-simpledb-1.10.21.jar:/usr/local/druid/lib/javax.servlet-api-3.1.0.jar:/usr/local/druid/lib/org.abego.treelayout.core-1.0.1.jar:/usr/local/druid/lib/druid-services-0.8.3.jar:/usr/local/druid/lib/aopalliance-1.0.jar:/usr/local/druid/lib/aws-java-sdk-sts-1.10.21.jar:/usr/local/druid/lib/jersey-guice-1.19.jar:/usr/local/druid/lib/curator-framework-2.9.1.jar:/usr/local/druid/lib/aws-java-sdk-datapipeline-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-redshift-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-1.10.21.jar:/usr/local/druid/lib/okhttp-1.0.2.jar:/usr/local/druid/lib/rhino-1.7R5.jar:/usr/local/druid/lib/aether-connector-file-0.9.0.M2.jar:/usr/local/druid/lib/javax.inject-1.jar:/usr/local/druid/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:/usr/local/druid/lib/xpp3-1.1.4c.jar:/usr/local/druid/lib/jackson-jaxrs-base-2.4.6.jar:/usr/local/druid/lib/geoip2-0.4.0.jar:/usr/local/druid/lib/curator-x-discovery-2.9.1.jar:/usr/local/druid/lib/aws-java-sdk-cloudfront-1.10.21.jar:/usr/local/druid/lib/jetty-server-9.2.5.v20141112.jar:/usr/local/druid/lib/jackson-core-2.4.6.jar:/usr/local/druid/lib/commons-pool2-2.2.jar:/usr/local/druid/lib/curator-recipes-2.9.1.jar:/usr/local/druid/lib/guice-4.0-beta.jar:/usr/local/druid/lib/extendedset-1.3.9.jar:/usr/local/druid/lib/opencsv-2.3.jar:/usr/local/druid/lib/maven-model-builder-3.1.1.jar:/usr/local/druid/lib/log4j-slf4j-impl-2.4.1.jar:/usr/local/druid/lib/druid-api-0.3.13.jar:/usr/local/druid/lib/jetty-client-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:/usr/local/druid/lib/jackson-module-jaxb-annotations-2.4.6.jar:/usr/local/druid/lib/derbyclient-10.11.1.1.jar:/usr/local/druid/lib/java-util-0.27.4.jar:/usr/local/druid/lib/config-magic-0.9.jar:/usr/local/druid/lib/derby-10.11.1.1.jar:/usr/local/druid/lib/irc-api-1.0-0014.jar:/usr/local/druid/lib/jdbi-2.63.1.jar:/usr/local/druid/lib/maven-settings-builder-3.1.1.jar:/usr/local/druid/lib/plexus-interpolation-1.19.jar:/usr/local/druid/lib/guava-16.0.1.jar:/usr/local/druid/lib/jackson-annotations-2.4.6.jar:/usr/local/druid/lib/netty-3.10.4.Final.jar:/usr/local/druid/lib/druid-server-0.8.3.jar:/usr/local/druid/lib/commons-logging-1.1.1.jar:/usr/local/druid/lib/jetty-servlets-9.2.5.v20141112.jar:/usr/local/druid/lib/wagon-provider-api-2.4.jar:/usr/local/druid/lib/aws-java-sdk-importexport-1.10.21.jar:/usr/local/druid/lib/jline-0.9.94.jar:/usr/local/druid/lib/aws-java-sdk-rds-1.10.21.jar:/usr/local/druid/lib/jetty-io-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-ses-1.10.21.jar:/usr/local/druid/lib/jetty-proxy-9.2.5.v20141112.jar:/usr/local/druid/lib/jersey-core-1.19.jar:/usr/local/druid/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:/usr/local/druid/lib/hibernate-validator-5.1.3.Final.jar:/usr/local/druid/lib/aws-java-sdk-iam-1.10.21.jar:/usr/local/druid/lib/jackson-datatype-guava-2.4.6.jar:/usr/local/druid/lib/jackson-databind-2.4.6.jar:/usr/local/druid/lib/aws-java-sdk-cloudhsm-1.10.21.jar:/usr/local/druid/lib/annotations-2.0.3.jar:/usr/local/druid/lib/spymemcached-2.11.7.jar:/usr/local/druid/lib/disruptor-3.3.0.jar:/usr/local/druid/lib/jersey-servlet-1.19.jar:/usr/local/druid/lib/httpcore-4.4.3.jar:/usr/local/druid/lib/aws-java-sdk-kms-1.10.21.jar:/usr/local/druid/lib/activation-1.1.1.jar:/usr/local/druid/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-route53-1.10.21.jar:/usr/local/druid/lib/maven-aether-provider-3.1.1.jar:/usr/local/druid/lib/guice-multibindings-4.0-beta.jar:/usr/local/druid/lib/aws-java-sdk-storagegateway-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:/usr/local/druid/lib/base64-2.3.8.jar:/usr/local/druid/lib/aws-java-sdk-cloudformation-1.10.21.jar:/usr/local/druid/lib/log4j-api-2.4.1.jar:/usr/local/druid/lib/aws-java-sdk-ecs-1.10.21.jar:/usr/local/druid/lib/maven-repository-metadata-3.1.1.jar:/usr/local/druid/lib/aws-java-sdk-sns-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-codedeploy-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-core-1.10.21.jar:/usr/local/druid/lib/zookeeper-3.4.6.jar:/usr/local/druid/lib/tesla-aether-0.0.5.jar:/usr/local/druid/lib/aether-connector-okhttp-0.0.9.jar:/usr/local/druid/lib/jetty-http-9.2.5.v20141112.jar:/usr/local/druid/lib/airline-0.7.jar:/usr/local/druid/lib/aws-java-sdk-logs-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-support-1.10.21.jar:/usr/local/druid/lib/jsr305-2.0.1.jar:/usr/local/druid/lib/aws-java-sdk-swf-libraries-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-emr-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-ssm-1.10.21.jar:/usr/local/druid/lib/compress-lzf-1.0.3.jar:/usr/local/druid/lib/java-xmlbuilder-1.1.jar:/usr/local/druid/lib/druid-indexing-hadoop-0.8.3.jar:/usr/local/druid/lib/druid-common-0.8.3.jar:/usr/local/druid/lib/jetty-servlet-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-cloudtrail-1.10.21.jar:/usr/local/druid/lib/commons-pool-1.6.jar:/usr/local/druid/lib/jackson-jaxrs-json-provider-2.4.6.jar:/usr/local/druid/lib/jsr311-api-1.1.1.jar:/usr/local/druid/lib/log4j-1.2-api-2.4.1.jar:/usr/local/druid/lib/druid-console-0.0.2.jar:/usr/local/druid/lib/server-metrics-0.2.8.jar:/usr/local/druid/lib/aether-util-0.9.0.M2.jar:/usr/local/druid/lib/aws-java-sdk-sqs-1.10.21.jar 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler= 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 2016-02-17T05:58:01,861 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.1.13-19.31.amzn1.x86_64 2016-02-17T05:58:01,862 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=ec2-user 2016-02-17T05:58:01,862 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/ec2-user 2016-02-17T05:58:01,862 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/usr/local/druid 2016-02-17T05:58:01,863 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ec2-52-87-245-6.compute-1.amazonaws.com sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@1e8b4880 2016-02-17T05:58:01,882 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@13dbec76]. 2016-02-17T05:58:01,889 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181. Will not attempt to authenticate using SASL (unknown error) 2016-02-17T05:58:01,895 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181, initiating session 2016-02-17T05:58:01,904 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181, sessionid = 0x152e83210490095, negotiated timeout = 30000 2016-02-17T05:58:01,908 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED 2016-02-17T05:58:02,003 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@20bd86c2]. 2016-02-17T05:58:02,004 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@7ada3b58]. 2016-02-17T05:58:02,014 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112 Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering io.druid.server.StatusResource as a root resource class Feb 17, 2016 5:58:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton" Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider Feb 17, 2016 5:58:02 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined" 2016-02-17T05:58:02,677 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@5f5599c7{/,null,AVAILABLE} 2016-02-17T05:58:02,686 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@6b2c3388{HTTP/1.1}{0.0.0.0:8101} 2016-02-17T05:58:02,686 INFO [main] org.eclipse.jetty.server.Server - Started @8244ms 2016-02-17T05:58:02,687 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@17fa725a]. 2016-02-17T05:58:02,687 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='ec2-54-226-18-108.compute-1.amazonaws.com:8101', host='ec2-54-226-18-108.compute-1.amazonaws.com:8101', maxSize=0, tier='_default_tier', type='realtime', priority='0'}] at [/druid/announcements/ec2-54-226-18-108.compute-1.amazonaws.com:8101] 2016-02-17T05:58:02,740 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@6ec36c8b]. 2016-02-17T05:58:02,931 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2016-02-17T05:58:02,932 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties 2016-02-17T05:58:02,939 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.size, ${base_path}.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2016-02-17T05:58:02,939 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()] 2016-02-17T05:58:02,940 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2016-02-17T05:58:02,940 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()] 2016-02-17T05:58:02,947 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [ConciseBitmapSerdeFactory{}] 2016-02-17T05:58:02,989 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: { "type" : "index_realtime", "id" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0", "resource" : { "availabilityGroup" : "000C7221A34CA9DD8444662FFFB2EFD0-17-0000", "requiredCapacity" : 1 }, "spec" : { "dataSchema" : { "dataSource" : "000C7221A34CA9DD8444662FFFB2EFD0", "parser" : { "type" : "map", "parseSpec" : { "format" : "json", "timestampSpec" : { "column" : "timeStampRecord", "format" : "auto", "missingValue" : null }, "dimensionsSpec" : { "dimensions" : [ "some-dimensions"], "spatialDimensions" : [ ] } } }, "metricsSpec" : [ { "type" : "count", "name" : "count" } ], "granularitySpec" : { "type" : "uniform", "segmentGranularity" : "DAY", "queryGranularity" : { "type" : "none" }, "intervals" : null } }, "ioConfig" : { "type" : "realtime", "firehose" : { "type" : "clipped", "delegate" : { "type" : "timed", "delegate" : { "type" : "receiver", "serviceName" : "firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000", "bufferSize" : 100000 }, "shutoffTime" : "2016-02-18T05:05:00.000Z" }, "interval" : "2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z" }, "firehoseV2" : null }, "tuningConfig" : { "type" : "realtime", "maxRowsInMemory" : 100000, "intermediatePersistPeriod" : "PT5H", "windowPeriod" : "PT5H", "basePersistDirectory" : "/tmp/1455688245320-0", "versioningPolicy" : { "type" : "intervalStart" }, "rejectionPolicy" : { "type" : "none" }, "maxPendingPersists" : 0, "shardSpec" : { "type" : "linear", "partitionNum" : 0 }, "indexSpec" : { "bitmap" : { "type" : "concise" }, "dimensionCompression" : null, "metricCompression" : null }, "persistInHeap" : false, "ingestOffheap" : false, "aggregationBufferRatio" : 0.5, "bufferSize" : 134217728 } }, "context" : null, "groupId" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0", "dataSource" : "000C7221A34CA9DD8444662FFFB2EFD0" } 2016-02-17T05:58:02,990 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/persistent/task/index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0/lock]. 2016-02-17T05:58:02,991 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/persistent/task/index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0/lock] in 1ms. 2016-02-17T05:58:02,995 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0 2016-02-17T05:58:03,005 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Creating plumber using rejectionPolicy[io.druid.segment.realtime.plumber.NoopRejectionPolicyFactory$1@27ec9ac9] 2016-02-17T05:58:03,008 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Expect to run at [2016-02-18T05:00:00.000Z] 2016-02-17T05:58:03,010 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push. 2016-02-17T05:58:03,010 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z]. 2016-02-17T05:58:03,010 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge 2016-02-17T05:58:03,044 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Connecting firehose: firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000 2016-02-17T05:58:03,046 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Found chathandler of class[io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider] 2016-02-17T05:58:03,046 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T05:58:03,049 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8101}] 2016-02-17T05:58:03,078 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T05:58:03,078 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8101}] 2016-02-17T05:58:03,090 WARN [task-runner-0] org.apache.curator.utils.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. 2016-02-17T05:58:03,094 INFO [task-runner-0] io.druid.server.metrics.EventReceiverFirehoseRegister - Registering EventReceiverFirehoseMetric for service [firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T05:58:03,095 INFO [task-runner-0] io.druid.data.input.FirehoseFactory - Firehose created, will shut down at: 2016-02-18T05:05:00.000Z 2016-02-17T05:58:04,014 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T05:58:04,024 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0] to overlord[http://ec2-54-226-18-108.compute-1.amazonaws.com:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T05:58:04,036 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,070 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,071 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,071 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,071 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,072 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,072 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,072 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,073 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,073 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,073 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,075 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,076 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,076 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,076 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,077 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,077 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,077 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,078 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,078 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T05:58:04,143 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T05:58:04,145 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0] to overlord[http://ec2-54-226-18-108.compute-1.amazonaws.com:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T05:58:04,167 INFO [task-runner-0] io.druid.server.coordination.BatchDataSegmentAnnouncer - Announcing segment[000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_2016-02-18T00:00:00.000Z_2016-02-17T05:58:04.101Z] at new path[/druid/segments/ec2-54-226-18-108.compute-1.amazonaws.com:8101/ec2-54-226-18-108.compute-1.amazonaws.com:8101_realtime__default_tier_2016-02-17T05:58:04.165Z_ac155ab132ee407dac552b4de81d93260] 2016-02-17T05:59:54,297 INFO [parent-monitor-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Triggering JVM shutdown. 2016-02-17T05:59:54,298 INFO [Thread-44] io.druid.cli.CliPeon - Running shutdown hook 2016-02-17T05:59:54,302 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@17fa725a]. 2016-02-17T05:59:54,302 INFO [Thread-44] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@22e2266d] 2016-02-17T05:59:54,303 INFO [Thread-44] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/ec2-54-226-18-108.compute-1.amazonaws.com:8101] 2016-02-17T05:59:54,328 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@6ec36c8b]. 2016-02-17T05:59:54,349 INFO [Thread-44] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@6b2c3388{HTTP/1.1}{0.0.0.0:8101} 2016-02-17T05:59:54,352 INFO [Thread-44] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@5f5599c7{/,null,UNAVAILABLE} 2016-02-17T05:59:54,366 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@55c24543]. 2016-02-17T05:59:54,367 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@7ada3b58]. 2016-02-17T05:59:54,372 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@20bd86c2]. 2016-02-17T05:59:54,372 INFO [Thread-44] io.druid.curator.announcement.Announcer - unannouncing [/druid/segments/ec2-54-226-18-108.compute-1.amazonaws.com:8101/ec2-54-226-18-108.compute-1.amazonaws.com:8101_realtime__default_tier_2016-02-17T05:58:04.165Z_ac155ab132ee407dac552b4de81d93260] 2016-02-17T05:59:54,376 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@13dbec76]. 2016-02-17T05:59:54,382 INFO [Thread-44] io.druid.curator.CuratorModule - Stopping Curator 2016-02-17T05:59:54,375 ERROR [task-runner-0] io.druid.indexing.common.task.RealtimeIndexTask - Exception aborted realtime processing[000C7221A34CA9DD8444662FFFB2EFD0]: {class=io.druid.indexing.common.task.RealtimeIndexTask, exceptionType=class java.lang.RuntimeException, exceptionMessage=java.lang.InterruptedException} java.lang.RuntimeException: java.lang.InterruptedException at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:209) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.TimedShutoffFirehoseFactory$TimedShutoffFirehose.hasMore(TimedShutoffFirehoseFactory.java:99) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.PredicateFirehose.hasMore(PredicateFirehose.java:50) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:314) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:285) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:265) [druid-indexing-service-0.8.3.jar:0.8.3] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_95] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95] Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) ~[?:1.7.0_95] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095) ~[?:1.7.0_95] at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389) ~[?:1.7.0_95] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:201) ~[druid-server-0.8.3.jar:0.8.3] ... 9 more 2016-02-17T05:59:54,387 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[RealtimeIndexTask{id=index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0, type=index_realtime, dataSource=000C7221A34CA9DD8444662FFFB2EFD0}] java.lang.RuntimeException: java.lang.InterruptedException at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:209) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.TimedShutoffFirehoseFactory$TimedShutoffFirehose.hasMore(TimedShutoffFirehoseFactory.java:99) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.PredicateFirehose.hasMore(PredicateFirehose.java:50) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:314) ~[druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:285) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:265) [druid-indexing-service-0.8.3.jar:0.8.3] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_95] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95] Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) ~[?:1.7.0_95] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095) ~[?:1.7.0_95] at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389) ~[?:1.7.0_95] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:201) ~[druid-server-0.8.3.jar:0.8.3] ... 9 more 2016-02-17T05:59:54,389 INFO [Thread-44] org.apache.zookeeper.ZooKeeper - Session: 0x152e83210490095 closed 2016-02-17T05:59:54,389 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down 2016-02-17T05:59:54,390 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@475e2446]. 2016-02-17T05:59:54,393 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: { "id" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0", "status" : "FAILED", "duration" : 111393 } 2016-02-17T05:59:54,400 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@63a7e2b2]. 2016-02-17T05:59:54,401 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@501c1504]. 2016-02-17T05:59:54,401 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@60c0f5]. 2016-02-17T23:18:43,775 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2016-02-17T23:18:43,779 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties Feb 17, 2016 11:18:43 PM org.hibernate.validator.internal.util.Version INFO: HV000001: Hibernate Validator 5.1.3.Final 2016-02-17T23:18:44,432 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[io.druid.extensions:druid-examples, io.druid.extensions:druid-kafka-eight, io.druid.extensions:mysql-metadata-storage, io.druid.extensions:druid-hdfs-storage, io.druid.extensions:druid-s3-extensions], defaultVersion='0.8.3', localRepository='./extensions-repo', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}] 2016-02-17T23:18:44,610 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.cli.CliCommandCreator] 2016-02-17T23:18:46,134 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-examples/0.8.3/druid-examples-0.8.3.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-core/3.0.3/twitter4j-core-3.0.3.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-async/3.0.3/twitter4j-async-3.0.3.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/twitter4j/twitter4j-stream/3.0.3/twitter4j-stream-3.0.3.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-validator/commons-validator/1.4.0/commons-validator-1.4.0.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils/1.8.3/commons-beanutils-1.8.3.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar] 2016-02-17T23:18:46,135 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T23:18:46,137 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.cli.CliCommandCreator] 2016-02-17T23:18:46,260 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-kafka-eight/0.8.3/druid-kafka-eight-0.8.3.jar] 2016-02-17T23:18:46,260 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/log4j/log4j/1.2.16/log4j-1.2.16.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/jline/jline/0.9.94/jline-0.9.94.jar] 2016-02-17T23:18:46,261 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar] 2016-02-17T23:18:46,262 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar] 2016-02-17T23:18:46,262 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/101tec/zkclient/0.3/zkclient-0.3.jar] 2016-02-17T23:18:46,265 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.cli.CliCommandCreator] 2016-02-17T23:18:46,861 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/mysql-metadata-storage/0.8.3/mysql-metadata-storage-0.8.3.jar] 2016-02-17T23:18:46,861 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/mysql/mysql-connector-java/5.1.34/mysql-connector-java-5.1.34.jar] 2016-02-17T23:18:46,861 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/jdbi/jdbi/2.63.1/jdbi-2.63.1.jar] 2016-02-17T23:18:46,864 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.cli.CliCommandCreator] 2016-02-17T23:18:47,352 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-hdfs-storage/0.8.3/druid-hdfs-storage-0.8.3.jar] 2016-02-17T23:18:47,352 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/java/dev/jets3t/jets3t/0.9.4/jets3t-0.9.4.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/activation/activation/1.1.1/activation-1.1.1.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/jamesmurty/utils/java-xmlbuilder/1.1/java-xmlbuilder-1.1.jar] 2016-02-17T23:18:47,353 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/iharder/base64/2.3.8/base64-2.3.8.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-client/2.3.0/hadoop-client-2.3.0.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-common/2.3.0/hadoop-common-2.3.0.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-cli/commons-cli/1.2/commons-cli-1.2.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/xmlenc/xmlenc/0.52/xmlenc-0.52.jar] 2016-02-17T23:18:47,354 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-net/commons-net/3.1/commons-net-3.1.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/log4j/log4j/1.2.17/log4j-1.2.17.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-lang/commons-lang/2.6/commons-lang-2.6.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-digester/commons-digester/1.8/commons-digester-1.8.jar] 2016-02-17T23:18:47,355 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/avro/avro/1.7.4/avro-1.7.4.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar] 2016-02-17T23:18:47,356 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-auth/2.3.0/hadoop-auth-2.3.0.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/tukaani/xz/1.0/xz-1.0.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-hdfs/2.3.0/hadoop-hdfs-2.3.0.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-app/2.3.0/hadoop-mapreduce-client-app-2.3.0.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-common/2.3.0/hadoop-mapreduce-client-common-2.3.0.jar] 2016-02-17T23:18:47,357 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-client/2.3.0/hadoop-yarn-client-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-server-common/2.3.0/hadoop-yarn-server-common-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.3.0/hadoop-mapreduce-client-shuffle-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-api/2.3.0/hadoop-yarn-api-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-core/2.3.0/hadoop-mapreduce-client-core-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-yarn-common/2.3.0/hadoop-yarn-common-2.3.0.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar] 2016-02-17T23:18:47,358 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/sun/jersey/jersey-core/1.19/jersey-core-1.19.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.3.0/hadoop-mapreduce-client-jobclient-2.3.0.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/hadoop/hadoop-annotations/2.3.0/hadoop-annotations-2.3.0.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/emitter/0.3.6/emitter-0.3.6.jar] 2016-02-17T23:18:47,359 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/http-client/1.0.4/http-client-1.0.4.jar] 2016-02-17T23:18:47,360 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.10.4.Final/netty-3.10.4.Final.jar] 2016-02-17T23:18:47,360 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar] 2016-02-17T23:18:47,378 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-s3-extensions] for class[io.druid.cli.CliCommandCreator] 2016-02-17T23:18:47,691 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/druid/extensions/druid-s3-extensions/0.8.3/druid-s3-extensions-0.8.3.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/java/dev/jets3t/jets3t/0.9.4/jets3t-0.9.4.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-codec/commons-codec/1.7/commons-codec-1.7.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/javax/activation/activation/1.1.1/activation-1.1.1.jar] 2016-02-17T23:18:47,692 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/bouncycastle/bcprov-jdk15on/1.52/bcprov-jdk15on-1.52.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/jamesmurty/utils/java-xmlbuilder/1.1/java-xmlbuilder-1.1.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/net/iharder/base64/2.3.8/base64-2.3.8.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-1.2-api/2.4.1/log4j-1.2-api-2.4.1.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-api/2.4.1/log4j-api-2.4.1.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/logging/log4j/log4j-core/2.4.1/log4j-core-2.4.1.jar] 2016-02-17T23:18:47,693 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpclient/4.5.1/httpclient-4.5.1.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/org/apache/httpcomponents/httpcore/4.4.3/httpcore-4.4.3.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/emitter/0.3.6/emitter-0.3.6.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/metamx/http-client/1.0.4/http-client-1.0.4.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/io/netty/netty/3.10.4.Final/netty-3.10.4.Final.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/com/google/guava/guava/16.0.1/guava-16.0.1.jar] 2016-02-17T23:18:47,694 INFO [main] io.druid.initialization.Initialization - Added URL[file:/usr/local/druid/./extensions-repo/commons-io/commons-io/2.0.1/commons-io-2.0.1.jar] 2016-02-17T23:18:47,942 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-examples] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,943 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.examples.ExamplesDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,943 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-kafka-eight] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,945 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.kafka.KafkaEightDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,945 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:mysql-metadata-storage] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,946 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.metadata.storage.mysql.MySQLMetadataStorageModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,946 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-hdfs-storage] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,948 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.storage.hdfs.HdfsStorageDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:47,948 INFO [main] io.druid.initialization.Initialization - Loading extension[io.druid.extensions:druid-s3-extensions] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:48,063 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.storage.s3.S3StorageDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:48,064 INFO [main] io.druid.initialization.Initialization - Adding remote extension module[io.druid.firehose.s3.S3FirehoseDruidModule] for class[io.druid.initialization.DruidModule] 2016-02-17T23:18:48,753 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-02-17T23:18:49,592 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@1ec896d2] 2016-02-17T23:18:49,608 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}] 2016-02-17T23:18:49,640 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8100}] 2016-02-17T23:18:49,678 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, maxIdleTime=PT5M}] 2016-02-17T23:18:49,710 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@347d7f3f] 2016-02-17T23:18:49,717 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.http.DruidHttpClientConfig@6ed989cb] 2016-02-17T23:18:49,825 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@54a36ff] 2016-02-17T23:18:49,830 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.curator.CuratorConfig] from props[druid.zk.service.] as [io.druid.curator.CuratorConfig@616b99f1] 2016-02-17T23:18:49,836 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29 2016-02-17T23:18:49,861 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@2939f411] 2016-02-17T23:18:49,999 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@288d8c4a] 2016-02-17T23:18:50,003 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.common.aws.AWSCredentialsConfig] from props[druid.s3.] as [io.druid.common.aws.AWSCredentialsConfig@589b4a74] 2016-02-17T23:18:50,062 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentPusherConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentPusherConfig@29deb717] 2016-02-17T23:18:50,063 INFO [main] io.druid.storage.s3.S3DataSegmentPusher - Configured S3 as deep storage 2016-02-17T23:18:50,067 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.storage.s3.S3DataSegmentArchiverConfig] from props[druid.storage.] as [io.druid.storage.s3.S3DataSegmentArchiverConfig@16835fbf] 2016-02-17T23:18:50,084 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@988c127] 2016-02-17T23:18:50,088 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@13d64c88] 2016-02-17T23:18:50,102 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [io.druid.server.initialization.ZkPathsConfig@22e2266d] 2016-02-17T23:18:50,108 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.BatchDataSegmentAnnouncerProvider@3441ba3a] 2016-02-17T23:18:50,110 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [io.druid.client.coordinator.CoordinatorSelectorConfig@21189124] 2016-02-17T23:18:50,114 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [io.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@2e5d69b4] 2016-02-17T23:18:50,117 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.size, ${base_path}.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2016-02-17T23:18:50,120 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()] 2016-02-17T23:18:50,120 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2016-02-17T23:18:50,120 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()] 2016-02-17T23:18:50,211 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@d99bef1] 2016-02-17T23:18:50,216 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [io.druid.query.metadata.SegmentMetadataQueryConfig@741d711c] 2016-02-17T23:18:50,220 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@1474c0a2] 2016-02-17T23:18:50,226 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [io.druid.query.topn.TopNQueryConfig@13b5d596] 2016-02-17T23:18:50,232 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.cache.CacheProvider] from props[druid.cache.] as [io.druid.client.cache.LocalCacheProvider@4c31a7a] 2016-02-17T23:18:50,239 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [io.druid.client.cache.CacheConfig@2ed92da1] 2016-02-17T23:18:50,243 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@482aa91a] 2016-02-17T23:18:50,251 INFO [main] org.eclipse.jetty.util.log - Logging initialized @7342ms 2016-02-17T23:18:50,332 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@673ebb53]. 2016-02-17T23:18:50,332 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@477c7b19]. 2016-02-17T23:18:50,332 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@3d75caf9]. 2016-02-17T23:18:50,333 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.NettyHttpClient.start()] on object[com.metamx.http.client.NettyHttpClient@35fe7ec2]. 2016-02-17T23:18:50,334 INFO [main] io.druid.curator.CuratorModule - Starting Curator 2016-02-17T23:18:50,334 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=ip-10-95-213-30.ec2.internal 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_95 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/usr/local/druid/config/_common:/usr/local/druid/config/overlord:/usr/local/druid/lib/joda-time-2.8.2.jar:/usr/local/druid/lib/jets3t-0.9.4.jar:/usr/local/druid/lib/antlr4-runtime-4.0.jar:/usr/local/druid/lib/druid-processing-0.8.3.jar:/usr/local/druid/lib/curator-client-2.9.1.jar:/usr/local/druid/lib/httpclient-4.5.1.jar:/usr/local/druid/lib/maven-settings-3.1.1.jar:/usr/local/druid/lib/plexus-utils-3.0.15.jar:/usr/local/druid/lib/javax.el-3.0.0.jar:/usr/local/druid/lib/jetty-util-9.2.5.v20141112.jar:/usr/local/druid/lib/jackson-dataformat-smile-2.4.6.jar:/usr/local/druid/lib/log4j-jul-2.4.1.jar:/usr/local/druid/lib/aws-java-sdk-directory-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-kinesis-1.10.21.jar:/usr/local/druid/lib/commons-dbcp2-2.0.1.jar:/usr/local/druid/lib/http-client-1.0.4.jar:/usr/local/druid/lib/derbynet-10.11.1.1.jar:/usr/local/druid/lib/jcl-over-slf4j-1.7.12.jar:/usr/local/druid/lib/maxminddb-0.2.0.jar:/usr/local/druid/lib/aether-impl-0.9.0.M2.jar:/usr/local/druid/lib/aws-java-sdk-config-1.10.21.jar:/usr/local/druid/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/druid/lib/google-http-client-1.15.0-rc.jar:/usr/local/druid/lib/aws-java-sdk-codepipeline-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-lambda-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-machinelearning-1.10.21.jar:/usr/local/druid/lib/jackson-core-asl-1.9.13.jar:/usr/local/druid/lib/aws-java-sdk-ec2-1.10.21.jar:/usr/local/druid/lib/druid-aws-common-0.8.3.jar:/usr/local/druid/lib/aws-java-sdk-cloudwatch-1.10.21.jar:/usr/local/druid/lib/jersey-server-1.19.jar:/usr/local/druid/lib/aws-java-sdk-directconnect-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-autoscaling-1.10.21.jar:/usr/local/druid/lib/emitter-0.3.6.jar:/usr/local/druid/lib/jackson-datatype-joda-2.4.6.jar:/usr/local/druid/lib/aether-spi-0.9.0.M2.jar:/usr/local/druid/lib/log4j-core-2.4.1.jar:/usr/local/druid/lib/jackson-jaxrs-smile-provider-2.4.6.jar:/usr/local/druid/lib/druid-indexing-service-0.8.3.jar:/usr/local/druid/lib/aws-java-sdk-elasticache-1.10.21.jar:/usr/local/druid/lib/commons-cli-1.2.jar:/usr/local/druid/lib/slf4j-api-1.6.4.jar:/usr/local/druid/lib/commons-io-2.0.1.jar:/usr/local/druid/lib/aws-java-sdk-cognitosync-1.10.21.jar:/usr/local/druid/lib/RoaringBitmap-0.5.16.jar:/usr/local/druid/lib/aws-java-sdk-codecommit-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-cloudsearch-1.10.21.jar:/usr/local/druid/lib/validation-api-1.1.0.Final.jar:/usr/local/druid/lib/classmate-1.0.0.jar:/usr/local/druid/lib/mapdb-1.0.8.jar:/usr/local/druid/lib/commons-lang-2.6.jar:/usr/local/druid/lib/google-http-client-jackson2-1.15.0-rc.jar:/usr/local/druid/lib/commons-codec-1.7.jar:/usr/local/druid/lib/aws-java-sdk-dynamodb-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-workspaces-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-s3-1.10.21.jar:/usr/local/druid/lib/bytebuffer-collections-0.2.4.jar:/usr/local/druid/lib/guice-servlet-4.0-beta.jar:/usr/local/druid/lib/aws-java-sdk-glacier-1.10.21.jar:/usr/local/druid/lib/javax.el-api-3.0.0.jar:/usr/local/druid/lib/aws-java-sdk-opsworks-1.10.21.jar:/usr/local/druid/lib/aether-api-0.9.0.M2.jar:/usr/local/druid/lib/jetty-security-9.2.5.v20141112.jar:/usr/local/druid/lib/protobuf-java-2.5.0.jar:/usr/local/druid/lib/jboss-logging-3.1.3.GA.jar:/usr/local/druid/lib/icu4j-4.8.1.jar:/usr/local/druid/lib/aws-java-sdk-simpleworkflow-1.10.21.jar:/usr/local/druid/lib/maven-model-3.1.1.jar:/usr/local/druid/lib/bcprov-jdk15on-1.52.jar:/usr/local/druid/lib/jetty-continuation-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-efs-1.10.21.jar:/usr/local/druid/lib/lz4-1.3.0.jar:/usr/local/druid/lib/aws-java-sdk-devicefarm-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-simpledb-1.10.21.jar:/usr/local/druid/lib/javax.servlet-api-3.1.0.jar:/usr/local/druid/lib/org.abego.treelayout.core-1.0.1.jar:/usr/local/druid/lib/druid-services-0.8.3.jar:/usr/local/druid/lib/aopalliance-1.0.jar:/usr/local/druid/lib/aws-java-sdk-sts-1.10.21.jar:/usr/local/druid/lib/jersey-guice-1.19.jar:/usr/local/druid/lib/curator-framework-2.9.1.jar:/usr/local/druid/lib/aws-java-sdk-datapipeline-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-redshift-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-1.10.21.jar:/usr/local/druid/lib/okhttp-1.0.2.jar:/usr/local/druid/lib/rhino-1.7R5.jar:/usr/local/druid/lib/aether-connector-file-0.9.0.M2.jar:/usr/local/druid/lib/javax.inject-1.jar:/usr/local/druid/lib/aws-java-sdk-cloudwatchmetrics-1.10.21.jar:/usr/local/druid/lib/xpp3-1.1.4c.jar:/usr/local/druid/lib/jackson-jaxrs-base-2.4.6.jar:/usr/local/druid/lib/geoip2-0.4.0.jar:/usr/local/druid/lib/curator-x-discovery-2.9.1.jar:/usr/local/druid/lib/aws-java-sdk-cloudfront-1.10.21.jar:/usr/local/druid/lib/jetty-server-9.2.5.v20141112.jar:/usr/local/druid/lib/jackson-core-2.4.6.jar:/usr/local/druid/lib/commons-pool2-2.2.jar:/usr/local/druid/lib/curator-recipes-2.9.1.jar:/usr/local/druid/lib/guice-4.0-beta.jar:/usr/local/druid/lib/extendedset-1.3.9.jar:/usr/local/druid/lib/opencsv-2.3.jar:/usr/local/druid/lib/maven-model-builder-3.1.1.jar:/usr/local/druid/lib/log4j-slf4j-impl-2.4.1.jar:/usr/local/druid/lib/druid-api-0.3.13.jar:/usr/local/druid/lib/jetty-client-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-elasticloadbalancing-1.10.21.jar:/usr/local/druid/lib/jackson-module-jaxb-annotations-2.4.6.jar:/usr/local/druid/lib/derbyclient-10.11.1.1.jar:/usr/local/druid/lib/java-util-0.27.4.jar:/usr/local/druid/lib/config-magic-0.9.jar:/usr/local/druid/lib/derby-10.11.1.1.jar:/usr/local/druid/lib/irc-api-1.0-0014.jar:/usr/local/druid/lib/jdbi-2.63.1.jar:/usr/local/druid/lib/maven-settings-builder-3.1.1.jar:/usr/local/druid/lib/plexus-interpolation-1.19.jar:/usr/local/druid/lib/guava-16.0.1.jar:/usr/local/druid/lib/jackson-annotations-2.4.6.jar:/usr/local/druid/lib/netty-3.10.4.Final.jar:/usr/local/druid/lib/druid-server-0.8.3.jar:/usr/local/druid/lib/commons-logging-1.1.1.jar:/usr/local/druid/lib/jetty-servlets-9.2.5.v20141112.jar:/usr/local/druid/lib/wagon-provider-api-2.4.jar:/usr/local/druid/lib/aws-java-sdk-importexport-1.10.21.jar:/usr/local/druid/lib/jline-0.9.94.jar:/usr/local/druid/lib/aws-java-sdk-rds-1.10.21.jar:/usr/local/druid/lib/jetty-io-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-ses-1.10.21.jar:/usr/local/druid/lib/jetty-proxy-9.2.5.v20141112.jar:/usr/local/druid/lib/jersey-core-1.19.jar:/usr/local/druid/lib/aws-java-sdk-elasticbeanstalk-1.10.21.jar:/usr/local/druid/lib/hibernate-validator-5.1.3.Final.jar:/usr/local/druid/lib/aws-java-sdk-iam-1.10.21.jar:/usr/local/druid/lib/jackson-datatype-guava-2.4.6.jar:/usr/local/druid/lib/jackson-databind-2.4.6.jar:/usr/local/druid/lib/aws-java-sdk-cloudhsm-1.10.21.jar:/usr/local/druid/lib/annotations-2.0.3.jar:/usr/local/druid/lib/spymemcached-2.11.7.jar:/usr/local/druid/lib/disruptor-3.3.0.jar:/usr/local/druid/lib/jersey-servlet-1.19.jar:/usr/local/druid/lib/httpcore-4.4.3.jar:/usr/local/druid/lib/aws-java-sdk-kms-1.10.21.jar:/usr/local/druid/lib/activation-1.1.1.jar:/usr/local/druid/lib/aws-java-sdk-elastictranscoder-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-route53-1.10.21.jar:/usr/local/druid/lib/maven-aether-provider-3.1.1.jar:/usr/local/druid/lib/guice-multibindings-4.0-beta.jar:/usr/local/druid/lib/aws-java-sdk-storagegateway-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-cognitoidentity-1.10.21.jar:/usr/local/druid/lib/base64-2.3.8.jar:/usr/local/druid/lib/aws-java-sdk-cloudformation-1.10.21.jar:/usr/local/druid/lib/log4j-api-2.4.1.jar:/usr/local/druid/lib/aws-java-sdk-ecs-1.10.21.jar:/usr/local/druid/lib/maven-repository-metadata-3.1.1.jar:/usr/local/druid/lib/aws-java-sdk-sns-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-codedeploy-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-core-1.10.21.jar:/usr/local/druid/lib/zookeeper-3.4.6.jar:/usr/local/druid/lib/tesla-aether-0.0.5.jar:/usr/local/druid/lib/aether-connector-okhttp-0.0.9.jar:/usr/local/druid/lib/jetty-http-9.2.5.v20141112.jar:/usr/local/druid/lib/airline-0.7.jar:/usr/local/druid/lib/aws-java-sdk-logs-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-support-1.10.21.jar:/usr/local/druid/lib/jsr305-2.0.1.jar:/usr/local/druid/lib/aws-java-sdk-swf-libraries-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-emr-1.10.21.jar:/usr/local/druid/lib/aws-java-sdk-ssm-1.10.21.jar:/usr/local/druid/lib/compress-lzf-1.0.3.jar:/usr/local/druid/lib/java-xmlbuilder-1.1.jar:/usr/local/druid/lib/druid-indexing-hadoop-0.8.3.jar:/usr/local/druid/lib/druid-common-0.8.3.jar:/usr/local/druid/lib/jetty-servlet-9.2.5.v20141112.jar:/usr/local/druid/lib/aws-java-sdk-cloudtrail-1.10.21.jar:/usr/local/druid/lib/commons-pool-1.6.jar:/usr/local/druid/lib/jackson-jaxrs-json-provider-2.4.6.jar:/usr/local/druid/lib/jsr311-api-1.1.1.jar:/usr/local/druid/lib/log4j-1.2-api-2.4.1.jar:/usr/local/druid/lib/druid-console-0.0.2.jar:/usr/local/druid/lib/server-metrics-0.2.8.jar:/usr/local/druid/lib/aether-util-0.9.0.M2.jar:/usr/local/druid/lib/aws-java-sdk-sqs-1.10.21.jar 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler= 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64 2016-02-17T23:18:50,348 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=4.1.13-19.31.amzn1.x86_64 2016-02-17T23:18:50,349 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=ec2-user 2016-02-17T23:18:50,349 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/ec2-user 2016-02-17T23:18:50,349 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/usr/local/druid 2016-02-17T23:18:50,349 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=ec2-52-87-245-6.compute-1.amazonaws.com sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@397aec42 2016-02-17T23:18:50,365 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@39b61dae]. 2016-02-17T23:18:50,367 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181. Will not attempt to authenticate using SASL (unknown error) 2016-02-17T23:18:50,376 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181, initiating session 2016-02-17T23:18:50,382 INFO [main-SendThread(ec2-52-87-245-6.compute-1.amazonaws.com:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server ec2-52-87-245-6.compute-1.amazonaws.com/52.87.245.6:2181, sessionid = 0x152e832104900a3, negotiated timeout = 30000 2016-02-17T23:18:50,385 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED 2016-02-17T23:18:50,473 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@2fd46336]. 2016-02-17T23:18:50,473 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@20bd86c2]. 2016-02-17T23:18:50,483 INFO [main] org.eclipse.jetty.server.Server - jetty-9.2.5.v20141112 Feb 17, 2016 11:18:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class Feb 17, 2016 11:18:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering io.druid.server.StatusResource as a root resource class Feb 17, 2016 11:18:50 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.19 02/11/2015 03:25 AM' Feb 17, 2016 11:18:50 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton" Feb 17, 2016 11:18:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider Feb 17, 2016 11:18:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider Feb 17, 2016 11:18:51 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined" 2016-02-17T23:18:51,104 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@749cc148{/,null,AVAILABLE} 2016-02-17T23:18:51,113 INFO [main] org.eclipse.jetty.server.ServerConnector - Started ServerConnector@12c1bb86{HTTP/1.1}{0.0.0.0:8100} 2016-02-17T23:18:51,113 INFO [main] org.eclipse.jetty.server.Server - Started @8206ms 2016-02-17T23:18:51,113 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@22eb5cb0]. 2016-02-17T23:18:51,114 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='ec2-54-226-18-108.compute-1.amazonaws.com:8100', host='ec2-54-226-18-108.compute-1.amazonaws.com:8100', maxSize=0, tier='_default_tier', type='realtime', priority='0'}] at [/druid/announcements/ec2-54-226-18-108.compute-1.amazonaws.com:8100] 2016-02-17T23:18:51,147 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5dbc9982]. 2016-02-17T23:18:51,346 INFO [main] io.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2016-02-17T23:18:51,346 INFO [main] io.druid.guice.PropertiesModule - Loading properties from runtime.properties 2016-02-17T23:18:51,353 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.size, ${base_path}.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()] 2016-02-17T23:18:51,353 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()] 2016-02-17T23:18:51,353 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()] 2016-02-17T23:18:51,353 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()] 2016-02-17T23:18:51,358 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [ConciseBitmapSerdeFactory{}] 2016-02-17T23:18:51,402 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: { "type" : "index_realtime", "id" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0", "resource" : { "availabilityGroup" : "000C7221A34CA9DD8444662FFFB2EFD0-17-0000", "requiredCapacity" : 1 }, "spec" : { "dataSchema" : { "dataSource" : "000C7221A34CA9DD8444662FFFB2EFD0", "parser" : { "type" : "map", "parseSpec" : { "format" : "json", "timestampSpec" : { "column" : "timeStampRecord", "format" : "auto", "missingValue" : null }, "dimensionsSpec" : { "dimensions" : [ "some-dimensions" ], "spatialDimensions" : [ ] } } }, "metricsSpec" : [ { "type" : "count", "name" : "count" } ], "granularitySpec" : { "type" : "uniform", "segmentGranularity" : "DAY", "queryGranularity" : { "type" : "none" }, "intervals" : null } }, "ioConfig" : { "type" : "realtime", "firehose" : { "type" : "clipped", "delegate" : { "type" : "timed", "delegate" : { "type" : "receiver", "serviceName" : "firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000", "bufferSize" : 100000 }, "shutoffTime" : "2016-02-18T05:05:00.000Z" }, "interval" : "2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z" }, "firehoseV2" : null }, "tuningConfig" : { "type" : "realtime", "maxRowsInMemory" : 100000, "intermediatePersistPeriod" : "PT5H", "windowPeriod" : "PT5H", "basePersistDirectory" : "/tmp/1455688245320-0", "versioningPolicy" : { "type" : "intervalStart" }, "rejectionPolicy" : { "type" : "none" }, "maxPendingPersists" : 0, "shardSpec" : { "type" : "linear", "partitionNum" : 0 }, "indexSpec" : { "bitmap" : { "type" : "concise" }, "dimensionCompression" : null, "metricCompression" : null }, "persistInHeap" : false, "ingestOffheap" : false, "aggregationBufferRatio" : 0.5, "bufferSize" : 134217728 } }, "context" : null, "groupId" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0", "dataSource" : "000C7221A34CA9DD8444662FFFB2EFD0" } 2016-02-17T23:18:51,403 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/tmp/persistent/task/index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0/lock]. 2016-02-17T23:18:51,404 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/tmp/persistent/task/index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0/lock] in 1ms. 2016-02-17T23:18:51,407 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0 2016-02-17T23:18:51,417 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Creating plumber using rejectionPolicy[io.druid.segment.realtime.plumber.NoopRejectionPolicyFactory$1@bd7f550] 2016-02-17T23:18:51,420 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Expect to run at [2016-02-18T05:00:00.000Z] 2016-02-17T23:18:51,422 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Starting merge and push. 2016-02-17T23:18:51,422 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] segments. Attempting to hand off segments that start before [1970-01-01T00:00:00.000Z]. 2016-02-17T23:18:51,422 INFO [task-runner-0] io.druid.segment.realtime.plumber.RealtimePlumber - Found [0] sinks to persist and merge 2016-02-17T23:18:51,452 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Connecting firehose: firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000 2016-02-17T23:18:51,453 INFO [task-runner-0] io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory - Found chathandler of class[io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider] 2016-02-17T23:18:51,454 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T23:18:51,456 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8100}] 2016-02-17T23:18:51,483 INFO [task-runner-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T23:18:51,483 INFO [task-runner-0] io.druid.curator.discovery.CuratorServiceAnnouncer - Announcing service[DruidNode{serviceName='000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000', host='ec2-54-226-18-108.compute-1.amazonaws.com', port=8100}] 2016-02-17T23:18:51,494 WARN [task-runner-0] org.apache.curator.utils.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. 2016-02-17T23:18:51,497 INFO [task-runner-0] io.druid.server.metrics.EventReceiverFirehoseRegister - Registering EventReceiverFirehoseMetric for service [firehose:overlord:000C7221A34CA9DD8444662FFFB2EFD0-17-0000-0000] 2016-02-17T23:18:51,498 INFO [task-runner-0] io.druid.data.input.FirehoseFactory - Firehose created, will shut down at: 2016-02-18T05:05:00.000Z 2016-02-17T23:18:52,967 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T23:18:52,982 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0] to overlord[http://ec2-54-226-18-108.compute-1.amazonaws.com:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T23:18:52,999 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,037 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,038 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,038 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,038 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,039 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,039 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,039 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,040 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,040 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,042 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,042 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,043 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,043 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,044 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,044 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,045 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,045 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,046 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,046 INFO [task-runner-0] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://ec2-54-226-18-108.compute-1.amazonaws.com:8090 2016-02-17T23:18:53,135 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T23:18:53,136 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0] to overlord[http://ec2-54-226-18-108.compute-1.amazonaws.com:8090/druid/indexer/v1/action]: LockAcquireAction{interval=2016-02-17T00:00:00.000Z/2016-02-18T00:00:00.000Z} 2016-02-17T23:18:53,164 INFO [task-runner-0] io.druid.server.coordination.BatchDataSegmentAnnouncer - Announcing segment[000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_2016-02-18T00:00:00.000Z_2016-02-17T23:18:53.082Z] at new path[/druid/segments/ec2-54-226-18-108.compute-1.amazonaws.com:8100/ec2-54-226-18-108.compute-1.amazonaws.com:8100_realtime__default_tier_2016-02-17T23:18:53.162Z_e9c601c315e84002be6ece0b8d5a600f0] 2016-02-17T23:26:05,919 INFO [parent-monitor-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Triggering JVM shutdown. 2016-02-17T23:26:05,923 INFO [Thread-44] io.druid.cli.CliPeon - Running shutdown hook 2016-02-17T23:26:05,928 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@22eb5cb0]. 2016-02-17T23:26:05,928 INFO [Thread-44] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig@22e2266d] 2016-02-17T23:26:05,928 INFO [Thread-44] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/ec2-54-226-18-108.compute-1.amazonaws.com:8100] 2016-02-17T23:26:05,959 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@5dbc9982]. 2016-02-17T23:26:05,961 INFO [Thread-44] org.eclipse.jetty.server.ServerConnector - Stopped ServerConnector@12c1bb86{HTTP/1.1}{0.0.0.0:8100} 2016-02-17T23:26:05,963 INFO [Thread-44] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@749cc148{/,null,UNAVAILABLE} 2016-02-17T23:26:05,967 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@1be77d4b]. 2016-02-17T23:26:05,968 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@20bd86c2]. 2016-02-17T23:26:05,973 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@2fd46336]. 2016-02-17T23:26:05,974 INFO [Thread-44] io.druid.curator.announcement.Announcer - unannouncing [/druid/segments/ec2-54-226-18-108.compute-1.amazonaws.com:8100/ec2-54-226-18-108.compute-1.amazonaws.com:8100_realtime__default_tier_2016-02-17T23:18:53.162Z_e9c601c315e84002be6ece0b8d5a600f0] 2016-02-17T23:26:05,976 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@39b61dae]. 2016-02-17T23:26:05,980 INFO [Thread-44] io.druid.curator.CuratorModule - Stopping Curator 2016-02-17T23:26:05,975 ERROR [task-runner-0] io.druid.indexing.common.task.RealtimeIndexTask - Exception aborted realtime processing[000C7221A34CA9DD8444662FFFB2EFD0]: {class=io.druid.indexing.common.task.RealtimeIndexTask, exceptionType=class java.lang.RuntimeException, exceptionMessage=java.lang.InterruptedException} java.lang.RuntimeException: java.lang.InterruptedException at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:209) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.TimedShutoffFirehoseFactory$TimedShutoffFirehose.hasMore(TimedShutoffFirehoseFactory.java:99) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.PredicateFirehose.hasMore(PredicateFirehose.java:50) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:314) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:285) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:265) [druid-indexing-service-0.8.3.jar:0.8.3] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_95] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95] Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) ~[?:1.7.0_95] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095) ~[?:1.7.0_95] at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389) ~[?:1.7.0_95] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:201) ~[druid-server-0.8.3.jar:0.8.3] ... 9 more 2016-02-17T23:26:05,983 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down 2016-02-17T23:26:05,983 INFO [Thread-44] org.apache.zookeeper.ZooKeeper - Session: 0x152e832104900a3 closed 2016-02-17T23:26:05,983 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.NettyHttpClient.stop()] on object[com.metamx.http.client.NettyHttpClient@35fe7ec2]. 2016-02-17T23:26:05,983 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[RealtimeIndexTask{id=index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0, type=index_realtime, dataSource=000C7221A34CA9DD8444662FFFB2EFD0}] java.lang.RuntimeException: java.lang.InterruptedException at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.1.jar:?] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:209) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.TimedShutoffFirehoseFactory$TimedShutoffFirehose.hasMore(TimedShutoffFirehoseFactory.java:99) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.segment.realtime.firehose.PredicateFirehose.hasMore(PredicateFirehose.java:50) ~[druid-server-0.8.3.jar:0.8.3] at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:314) ~[druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:285) [druid-indexing-service-0.8.3.jar:0.8.3] at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:265) [druid-indexing-service-0.8.3.jar:0.8.3] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_95] at java.lang.Thread.run(Thread.java:745) [?:1.7.0_95] Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) ~[?:1.7.0_95] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095) ~[?:1.7.0_95] at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389) ~[?:1.7.0_95] at io.druid.segment.realtime.firehose.EventReceiverFirehoseFactory$EventReceiverFirehose.hasMore(EventReceiverFirehoseFactory.java:201) ~[druid-server-0.8.3.jar:0.8.3] ... 9 more 2016-02-17T23:26:05,988 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: { "id" : "index_realtime_000C7221A34CA9DD8444662FFFB2EFD0_2016-02-17T00:00:00.000Z_0_0", "status" : "FAILED", "duration" : 434577 } 2016-02-17T23:26:05,991 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@3d75caf9]. 2016-02-17T23:26:05,991 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@477c7b19]. 2016-02-17T23:26:05,991 INFO [Thread-44] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[io.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@673ebb53].