Issue with Tranquility

421 views

Skip to first unread message

Fred Astaire

unread,

Apr 6, 2016, 1:41:41 AM4/6/16

to Druid User

Running Druid-0.9.0-RC3 with Tranquility 0.7.3. Config/setup is as seen here: http://druid.io/docs/latest/configuration/production-cluster.html. Other than for the druid.service properties there is no druid/prod prefix. I run into the following on each start of Tranquility. Thanks for the help:

2016-04-06 05:36:08,111 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [useTopicAsDataSource] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#useTopicAsDataSource()]

2016-04-06 05:36:08,111 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [1] for [topicPattern.priority] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPatternPriority()]

2016-04-06 05:36:08,111 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [PT2M] for [zookeeper.timeout] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperTimeout()]

2016-04-06 05:36:08,150 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [overlord] for [druid.selectors.indexing.serviceName] on [com.metamx.tranquility.config.PropertiesBasedConfig#druidIndexingServiceName()]

2016-04-06 05:36:08,150 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.partitions] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskPartitions()]

2016-04-06 05:36:08,150 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.replicants] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskReplicants()]

2016-04-06 05:36:08,151 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.warmingPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskWarmingPeriod()]

2016-04-06 05:36:08,151 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [druid-001.aws.taplytics.com:2181] for [zookeeper.connect] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperConnect()]

2016-04-06 05:36:08,151 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxBatchSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxBatchSize()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxPendingBatches] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxPendingBatches()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.lingerMillis] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityLingerMillis()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [/druid/discovery] for [druid.discovery.curator.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#discoPath()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseGracePeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseGracePeriod()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseQuietPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseQuietPeriod()]

2016-04-06 05:36:08,154 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseRetryPeriod()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseChunkSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseChunkSize()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.randomizeTaskId] on [com.metamx.tranquility.config.PropertiesBasedConfig#randomizeTaskId()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.indexRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#indexRetryPeriod()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseBufferSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseBufferSize()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordLocator()]

2016-04-06 05:36:08,155 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.taskLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskLocator()]

2016-04-06 05:36:08,156 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordPollPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordPollPeriod()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [tranquility-kafka] for [kafka.group.id] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaGroupId()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [kafka-003.aws.taplytics.com:2181] for [kafka.zookeeper.connect] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getKafkaZookeeperConnect()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [15000] for [commit.periodMillis] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getCommitPeriodMillis()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [false] for [reportDropsAsExceptions] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#reportDropsAsExceptions()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [clientevents] for [topicPattern] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPattern()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [2] for [consumer.numThreads] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getConsumerNumThreads()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [false] for [useTopicAsDataSource] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#useTopicAsDataSource()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [1] for [topicPattern.priority] on [com.metamx.tranquility.kafka.model.PropertiesBasedKafkaConfig#getTopicPatternPriority()]

2016-04-06 05:36:08,245 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [PT2M] for [zookeeper.timeout] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperTimeout()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [overlord] for [druid.selectors.indexing.serviceName] on [com.metamx.tranquility.config.PropertiesBasedConfig#druidIndexingServiceName()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.partitions] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskPartitions()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.replicants] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskReplicants()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [task.warmingPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskWarmingPeriod()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [druid-001.aws.taplytics.com:2181] for [zookeeper.connect] on [com.metamx.tranquility.config.PropertiesBasedConfig#zookeeperConnect()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxBatchSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxBatchSize()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.maxPendingBatches] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityMaxPendingBatches()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [tranquility.lingerMillis] on [com.metamx.tranquility.config.PropertiesBasedConfig#tranquilityLingerMillis()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Assigning value [/druid/discovery] for [druid.discovery.curator.path] on [com.metamx.tranquility.config.PropertiesBasedConfig#discoPath()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseGracePeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseGracePeriod()]

2016-04-06 05:36:08,246 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseQuietPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseQuietPeriod()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseRetryPeriod()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseChunkSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseChunkSize()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.randomizeTaskId] on [com.metamx.tranquility.config.PropertiesBasedConfig#randomizeTaskId()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.indexRetryPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#indexRetryPeriod()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.firehoseBufferSize] on [com.metamx.tranquility.config.PropertiesBasedConfig#firehoseBufferSize()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordLocator()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.taskLocator] on [com.metamx.tranquility.config.PropertiesBasedConfig#taskLocator()]

2016-04-06 05:36:08,247 [main] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druidBeam.overlordPollPeriod] on [com.metamx.tranquility.config.PropertiesBasedConfig#overlordPollPeriod()]

2016-04-06 05:36:08,259 [main] WARN o.a.c.retry.ExponentialBackoffRetry - maxRetries too large (500). Pinning to 29

2016-04-06 05:36:08,260 [main] INFO c.m.t.kafka.writer.WriterController - Ready: [topicPattern] -> dataSource mappings:

2016-04-06 05:36:08,260 [main] INFO c.m.t.kafka.writer.WriterController - [clientevents] -> clientevents2 (priority: 1)

2016-04-06 05:36:08,362 [main] INFO kafka.utils.VerifiableProperties - Verifying properties

2016-04-06 05:36:08,367 [main] INFO kafka.utils.VerifiableProperties - Property auto.commit.enable is overridden to false

2016-04-06 05:36:08,367 [main] INFO kafka.utils.VerifiableProperties - Property group.id is overridden to tranquility-kafka

2016-04-06 05:36:08,367 [main] INFO kafka.utils.VerifiableProperties - Property zookeeper.connect is overridden to kafka-003.aws.taplytics.com:2181

2016-04-06 05:36:08,367 [main] INFO kafka.utils.VerifiableProperties - Property zookeeper.session.timeout.ms is overridden to 120000

2016-04-06 05:36:08,413 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Connecting to zookeeper instance at kafka-003.aws.taplytics.com:2181

2016-04-06 05:36:08,421 [ZkClient-EventThread-25-kafka-003.aws.taplytics.com:2181] INFO org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread.

2016-04-06 05:36:08,426 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT

2016-04-06 05:36:08,426 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=ip-10-0-15-174.ec2.internal

2016-04-06 05:36:08,426 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_77

2016-04-06 05:36:08,426 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation

2016-04-06 05:36:08,426 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-oracle/jre

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.tranquility-distribution-0.7.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.tranquility-kafka-0.7.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.tranquility-core-0.7.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.tranquility-server-0.7.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scala-lang.scala-library-2.11.7.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.scala-util_2.11-1.11.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.loglady_2.11-1.1.0-mmx.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.java-util-0.27.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.skife.config.config-magic-0.9.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.guava.guava-16.0.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.core.jackson-annotations-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.core.jackson-core-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.core.jackson-databind-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/net.sf.opencsv.opencsv-2.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.netty.netty-3.10.5.Final.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.emitter-0.3.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/javax.validation.validation-api-1.1.0.Final.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.server-metrics-0.2.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-lang.commons-lang-2.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scalaj.scalaj-time_2.11-0.5.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.yaml.snakeyaml-1.11.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.dataformat.jackson-dataformat-smile-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.datatype.jackson-datatype-joda-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.module.jackson-module-scala_2.11-2.4.5.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scala-lang.scala-reflect-2.11.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.thoughtworks.paranamer.paranamer-2.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/mysql.mysql-connector-java-5.1.18.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.h2database.h2-1.3.158.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/c3p0.c3p0-0.9.1.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/jline.jline-0.9.94.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/junit.junit-3.8.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.zookeeper.zookeeper-3.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.codehaus.jackson.jackson-mapper-asl-1.9.13.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.codehaus.jackson.jackson-core-asl-1.9.13.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-core_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-function_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.jsr166e-1.0.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scala-lang.modules.scala-parser-combinators_2.11-1.0.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.finagle-core_2.11-6.31.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-app_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-registry_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-cache_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-codec_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-codec.commons-codec-1.9.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-collection_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/javax.inject.javax.inject-1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-collections.commons-collections-3.2.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-hashing_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-jvm_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-lint_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-logging_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.util-stats_2.11-6.30.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.twitter.finagle-http_2.11-6.31.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.slf4j.slf4j-api-1.7.12.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-logging.commons-logging-1.1.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-server-0.8.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-processing-0.8.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-common-0.8.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-api-0.3.13.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/aopalliance.aopalliance-1.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.airlift.airline-0.7.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.code.findbugs.annotations-2.0.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.hibernate.hibernate-validator-5.1.3.Final.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.jboss.logging.jboss-logging-3.1.3.GA.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.classmate-1.0.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-io.commons-io-2.0.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.commons.commons-dbcp2-2.0.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.commons.commons-pool2-2.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-pool.commons-pool-1.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/javax.el.javax.el-api-3.0.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.datatype.jackson-datatype-guava-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.jdbi.jdbi-2.63.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/joda-time.joda-time-2.8.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.logging.log4j.log4j-jul-2.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.bytebuffer-collections-0.2.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.extendedset-1.3.9.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.roaringbitmap.RoaringBitmap-0.5.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.ning.compress-lzf-1.0.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.protobuf.protobuf-java-2.5.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.ibm.icu.icu4j-4.8.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.mozilla.rhino-1.7R5.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/net.jpountz.lz4.lz4-1.3.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.mapdb.mapdb-1.0.8.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-aws-common-0.8.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-support-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-core-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.httpcomponents.httpclient-4.5.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.httpcomponents.httpcore-4.4.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-simpledb-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-simpleworkflow-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-storagegateway-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-route53-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-s3-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-kms-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-importexport-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-sts-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-sqs-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-rds-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-redshift-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-elasticbeanstalk-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-glacier-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-sns-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-iam-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-datapipeline-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-elasticloadbalancing-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-emr-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-elasticache-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-elastictranscoder-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-ec2-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-dynamodb-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudtrail-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudwatch-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-logs-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cognitoidentity-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cognitosync-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-directconnect-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudformation-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudfront-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-kinesis-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-opsworks-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-ses-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-autoscaling-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudsearch-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudwatchmetrics-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-swf-libraries-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-codedeploy-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-codepipeline-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-config-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-lambda-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-ecs-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-cloudhsm-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-ssm-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-workspaces-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-machinelearning-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-directory-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-efs-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-codecommit-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.amazonaws.aws-java-sdk-devicefarm-1.10.21.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.druid.druid-console-0.0.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.metamx.http-client-1.0.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/commons-cli.commons-cli-1.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.glassfish.javax.el-3.0.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.curator.curator-framework-2.8.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.curator.curator-client-2.8.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.curator.curator-x-discovery-2.8.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.curator.curator-recipes-2.8.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-json-provider-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-base-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-smile-provider-2.4.6.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.sun.jersey.jersey-server-1.19.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.sun.jersey.jersey-core-1.19.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/javax.ws.rs.jsr311-api-1.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.sun.jersey.contribs.jersey-guice-1.19.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-server-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/javax.servlet.javax.servlet-api-3.1.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-http-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-util-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-io-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-proxy-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-client-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.tesla.aether.tesla-aether-0.0.5.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.aether.aether-api-0.9.0.M2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.aether.aether-spi-0.9.0.M2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.aether.aether-util-0.9.0.M2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.aether.aether-impl-0.9.0.M2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.aether.aether-connector-file-0.9.0.M2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/io.tesla.aether.aether-connector-okhttp-0.0.9.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.squareup.okhttp.okhttp-1.0.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.wagon.wagon-provider-api-2.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.codehaus.plexus.plexus-utils-3.0.15.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-aether-provider-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-model-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-model-builder-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.codehaus.plexus.plexus-interpolation-1.19.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-repository-metadata-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-settings-builder-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.maven.maven-settings-3.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.antlr.antlr4-runtime-4.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.abego.treelayout.org.abego.treelayout.core-1.0.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/net.spy.spymemcached-2.11.7.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-servlet-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-security-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-servlets-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.eclipse.jetty.jetty-continuation-9.2.5.v20141112.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.ircclouds.irc.irc-api-1.0-0014.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.maxmind.geoip2.geoip2-0.4.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.maxmind.maxminddb.maxminddb-0.2.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.http-client.google-http-client-1.15.0-rc.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/xpp3.xpp3-1.1.4c.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.http-client.google-http-client-jackson2-1.15.0-rc.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.derby.derby-10.11.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.derby.derbynet-10.11.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.derby.derbyclient-10.11.1.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.inject.guice-4.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.inject.extensions.guice-servlet-4.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.google.inject.extensions.guice-multibindings-4.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.kafka.kafka_2.11-0.8.2.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.yammer.metrics.metrics-core-2.2.0.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/net.sf.jopt-simple.jopt-simple-3.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.101tec.zkclient-0.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.kafka.kafka-clients-0.8.2.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.xerial.snappy.snappy-java-1.1.1.7.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/ch.qos.logback.logback-core-1.1.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/ch.qos.logback.logback-classic-1.1.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.logging.log4j.log4j-to-slf4j-2.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.apache.logging.log4j.log4j-api-2.4.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.slf4j.log4j-over-slf4j-1.7.12.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scalatra.scalatra_2.11-2.3.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scalatra.scalatra-common_2.11-2.3.1.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.clapper.grizzled-slf4j_2.11-1.0.2.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scalatra.rl.rl_2.11-0.4.10.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/com.googlecode.juniversalchardet.juniversalchardet-1.0.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/eu.medsea.mimeutil.mime-util-2.1.3.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.joda.joda-convert-1.7.jar:/home/ubuntu/tranquility-distribution-0.7.4/lib/org.scala-lang.modules.scala-xml_2.11-1.0.3.jar

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.13.0-74-generic

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root

2016-04-06 05:36:08,427 [main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/ubuntu/tranquility-distribution-0.7.4

2016-04-06 05:36:08,428 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=kafka-003.aws.taplytics.com:2181 sessionTimeout=120000 watcher=org.I0Itec.zkclient.ZkClient@563e4951

2016-04-06 05:36:08,447 [main-SendThread(ip-10-0-12-147.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server ip-10-0-12-147.ec2.internal/10.0.12.147:2181. Will not attempt to authenticate using SASL (unknown error)

2016-04-06 05:36:08,501 [main-SendThread(ip-10-0-12-147.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to ip-10-0-12-147.ec2.internal/10.0.12.147:2181, initiating session

2016-04-06 05:36:08,506 [main-SendThread(ip-10-0-12-147.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server ip-10-0-12-147.ec2.internal/10.0.12.147:2181, sessionid = 0x153653bccd0b3c2, negotiated timeout = 40000

2016-04-06 05:36:08,507 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected)

2016-04-06 05:36:08,517 [main] INFO c.m.tranquility.kafka.KafkaConsumer - Kafka topic filter [(clientevents)]

2016-04-06 05:36:08,545 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], begin registering consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 in ZK

2016-04-06 05:36:08,567 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], end registering consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 in ZK

2016-04-06 05:36:08,572 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], starting watcher executor thread for consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470

2016-04-06 05:36:08,593 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], begin rebalancing consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 try #0

2016-04-06 05:36:08,716 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] Stopping leader finder thread

2016-04-06 05:36:08,717 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] Stopping all fetchers

2016-04-06 05:36:08,718 [main] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] All connections stopped

2016-04-06 05:36:08,719 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Cleared all relevant queues for this fetcher

2016-04-06 05:36:08,721 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Cleared the data chunks in all the consumer message iterators

2016-04-06 05:36:08,721 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Committing all offsets after clearing the fetcher queues

2016-04-06 05:36:08,722 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Releasing partition ownership

2016-04-06 05:36:08,747 [main] INFO kafka.consumer.RangeAssignor - Consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 rebalancing the following partitions: ArrayBuffer(0) for topic clientevents with consumers: List(tranquility-kafka_ip-10-0-15-174-1459920547799-5458cf8f-0, tranquility-kafka_ip-10-0-15-174-1459920547799-5458cf8f-1, tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0, tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-1)

2016-04-06 05:36:08,748 [main] WARN kafka.consumer.RangeAssignor - No broker partitions consumed by consumer thread tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0 for topic clientevents

2016-04-06 05:36:08,748 [main] WARN kafka.consumer.RangeAssignor - No broker partitions consumed by consumer thread tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-1 for topic clientevents

2016-04-06 05:36:08,759 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 selected partitions :

2016-04-06 05:36:08,760 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread], Starting

2016-04-06 05:36:08,761 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], end rebalancing consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 try #0

2016-04-06 05:36:08,763 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Creating topic event watcher for topics (clientevents)

2016-04-06 05:36:08,770 [main] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Topics to consume = List(clientevents)

2016-04-06 05:36:23,521 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed 0 pending messages in 0ms and committed offsets in 1ms.

2016-04-06 05:36:28,756 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], begin rebalancing consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 try #0

2016-04-06 05:36:28,782 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] Stopping leader finder thread

2016-04-06 05:36:28,783 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread], Shutting down

2016-04-06 05:36:28,783 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread], Stopped

2016-04-06 05:36:28,783 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] Stopping all fetchers

2016-04-06 05:36:28,784 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Cleared all relevant queues for this fetcher

2016-04-06 05:36:28,795 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO kafka.consumer.RangeAssignor - Consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 rebalancing the following partitions: ArrayBuffer(0) for topic clientevents with consumers: List(tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0, tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-1)

2016-04-06 05:36:28,796 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO kafka.consumer.RangeAssignor - tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0 attempting to claim partition 0

2016-04-06 05:36:28,797 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] WARN kafka.consumer.RangeAssignor - No broker partitions consumed by consumer thread tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-1 for topic clientevents

2016-04-06 05:36:28,847 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0 successfully owned partition 0 for topic clientevents

2016-04-06 05:36:28,853 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], Consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 selected partitions : clientevents:0: fetched offset = 1152278377: consumed offset = 1152278377

2016-04-06 05:36:28,853 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470_watcher_executor] INFO k.c.ZookeeperConsumerConnector - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470], end rebalancing consumer tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470 try #0

2016-04-06 05:36:28,853 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO k.c.ConsumerFetcherManager$LeaderFinderThread - [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread], Starting

2016-04-06 05:36:28,872 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Verifying properties

2016-04-06 05:36:28,872 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property client.id is overridden to tranquility-kafka

2016-04-06 05:36:28,873 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to kafka-003.aws.taplytics.com:9092,kafka-002.aws.taplytics.com:9092

2016-04-06 05:36:28,873 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000

2016-04-06 05:36:28,890 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:1001,host:kafka-003.aws.taplytics.com,port:9092 with correlation id 0 for 1 topic(s) Set(clientevents)

2016-04-06 05:36:28,892 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to kafka-003.aws.taplytics.com:9092 for producing

2016-04-06 05:36:28,907 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from kafka-003.aws.taplytics.com:9092

2016-04-06 05:36:28,956 [ConsumerFetcherThread-tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0-1003] INFO kafka.consumer.ConsumerFetcherThread - [ConsumerFetcherThread-tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-0-1003], Starting

2016-04-06 05:36:28,958 [tranquility-kafka_ip-10-0-15-174-1459920968412-654eb470-leader-finder-thread] INFO k.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1459920968512] Added fetcher for partitions ArrayBuffer([[clientevents,0], initOffset 1152278377 to broker id:1003,host:kafka-002.aws.taplytics.com,port:9092] )

2016-04-06 05:36:29,032 [KafkaConsumer-0] INFO c.m.t.kafka.writer.WriterController - Creating EventWriter for topic [clientevents] using dataSource [clientevents2]

2016-04-06 05:36:29,066 [KafkaConsumer-0] WARN o.a.curator.CuratorZookeeperClient - session timeout [60000] is less than connection timeout [120000]

2016-04-06 05:36:29,076 [KafkaConsumer-0] INFO o.a.c.f.imps.CuratorFrameworkImpl - Starting

2016-04-06 05:36:29,078 [KafkaConsumer-0] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=druid-001.aws.taplytics.com:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@6b2b2a9d

2016-04-06 05:36:29,086 [KafkaConsumer-0-SendThread(ip-10-0-9-112.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server ip-10-0-9-112.ec2.internal/10.0.9.112:2181. Will not attempt to authenticate using SASL (unknown error)

2016-04-06 05:36:29,087 [KafkaConsumer-0-SendThread(ip-10-0-9-112.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to ip-10-0-9-112.ec2.internal/10.0.9.112:2181, initiating session

2016-04-06 05:36:29,090 [KafkaConsumer-0-SendThread(ip-10-0-9-112.ec2.internal:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server ip-10-0-9-112.ec2.internal/10.0.9.112:2181, sessionid = 0x153a3e8c5e91652, negotiated timeout = 40000

2016-04-06 05:36:29,094 [KafkaConsumer-0-EventThread] INFO o.a.c.f.state.ConnectionStateManager - State change: CONNECTED

2016-04-06 05:36:29,230 [KafkaConsumer-0] INFO c.m.t.finagle.FinagleRegistry - Adding resolver for scheme[disco].

2016-04-06 05:36:29,571 [KafkaConsumer-0] INFO o.h.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final

2016-04-06 05:36:29,852 [KafkaConsumer-0] INFO io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[], defaultVersion='0.3.13', localRepository='/root/.m2/repository', remoteRepositories=[https://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]

2016-04-06 05:36:30,191 [KafkaConsumer-0] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [io.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]

2016-04-06 05:36:30,192 [KafkaConsumer-0] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [${base_path}.numThreads] on [io.druid.query.DruidProcessingConfig#getNumThreads()]

2016-04-06 05:36:30,192 [KafkaConsumer-0] INFO o.s.c.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.size, ${base_path}.buffer.sizeBytes] on [io.druid.query.DruidProcessingConfig#intermediateComputeSizeBytes()]

2016-04-06 05:36:30,192 [KafkaConsumer-0] INFO o.s.c.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]

2016-04-06 05:36:30,216 [KafkaConsumer-0] INFO io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.segment.data.BitmapSerdeFactory] from props[druid.processing.bitmap.] as [ConciseBitmapSerdeFactory{}]

2016-04-06 05:36:30,296 [KafkaConsumer-0] INFO c.metamx.emitter.core.LoggingEmitter - Start: started [true]

2016-04-06 05:36:38,530 [KafkaConsumer-CommitThread] INFO c.m.tranquility.kafka.KafkaConsumer - Flushed {clientevents={receivedCount=69285, sentCount=0, failedCount=69285}} pending messages in 3ms and committed offsets in 5ms.

2016-04-06 05:36:40,564 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] INFO c.m.tranquility.beam.ClusteredBeam - Creating new merged beam for identifier[overlord/clientevents2] timestamp[2016-04-06T05:00:00.000Z] (target = 1, actual = 0)

2016-04-06 05:36:40,677 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] INFO com.metamx.common.scala.control$ - Creating druid indexing task (service = overlord): {

"type" : "index_realtime",

"id" : "index_realtime_clientevents2_2016-04-06T05:00:00.000Z_0_0",

"resource" : {

"availabilityGroup" : "clientevents2-05-0000",

"requiredCapacity" : 1

"spec" : {

"dataSchema" : {

"dataSource" : "clientevents2",

"parser" : {

"type" : "map",

"parseSpec" : {

"format" : "json",

"timestampSpec" : {

"column" : "date",

"format" : "iso",

"missingValue" : null

"dimensionsSpec" : {

"dimensions" : [ "appUser", "appVersion", "client", "elementKey", "expVars", "goalName", "os", "osVersion", "production", "project", "session", "topViewKey", "type", "viewKey" ],

"spatialDimensions" : [ ]

}

"metricsSpec" : [ {

"type" : "count",

"name" : "count"

}, {

"type" : "doubleSum",

"name" : "value",

"fieldName" : "value"

} ],

"granularitySpec" : {

"type" : "uniform",

"segmentGranularity" : "HOUR",

"queryGranularity" : {

"type" : "none"

}

"ioConfig" : {

"type" : "realtime",

"plumber" : null,

"firehose" : {

"type" : "clipped",

"interval" : "2016-04-06T05:00:00.000Z/2016-04-06T06:00:00.000Z",

"delegate" : {

"type" : "timed",

"shutoffTime" : "2016-04-06T06:15:00.000Z",

"delegate" : {

"type" : "receiver",

"serviceName" : "firehose:overlord:clientevents2-05-0000-0000",

"bufferSize" : 100000

}

"tuningConfig" : {

"shardSpec" : {

"type" : "linear",

"partitionNum" : 0

"rejectionPolicy" : {

"type" : "none"

"buildV9Directly" : false,

"maxPendingPersists" : 0,

"intermediatePersistPeriod" : "PT10M",

"windowPeriod" : "PT10M",

"type" : "realtime",

"maxRowsInMemory" : "100000"

}

Apr 06, 2016 5:36:40 AM com.twitter.finagle.Init$$anonfun$1 apply$mcV$sp

INFO: Finagle version 6.31.0 (rev=50d3bb0eea5ad3ed332111d707184c80fed6a506) built at 20151203-164135

2016-04-06 05:36:40,916 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] INFO c.m.c.s.net.finagle.DiscoResolver - Updating instances for service[overlord] to Set(ServiceInstance{name='overlord', id='aa1a35a5-f543-4046-9b38-05372503100c', address='druid-001.aws.taplytics.com', port=8080, sslPort=null, payload=null, registrationTimeUTC=1459918145991, serviceType=DYNAMIC, uriSpec=null})

2016-04-06 05:36:40,989 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] INFO c.m.t.finagle.FinagleRegistry - Created client for service: disco!overlord

2016-04-06 05:38:11,045 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] ERROR c.m.tranquility.beam.ClusteredBeam - Failed to update cluster state: overlord/clientevents2

com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to disco!overlord while waiting for a response for the request, including retries (if applicable)

at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]

2016-04-06 05:38:11,056 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] WARN c.m.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to create merged beam: overlord/clientevents2

{ }

java.lang.IllegalStateException: Failed to save new beam for identifier[overlord/clientevents2] timestamp[2016-04-06T05:00:00.000Z]

at com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:286) ~[io.druid.tranquility-core-0.7.4.jar:0.7.4]

at com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:283) ~[io.druid.tranquility-core-0.7.4.jar:0.7.4]

at com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:924) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:922) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise$Transformer.liftedTree1$1(Promise.scala:112) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise$Transformer.k(Promise.scala:112) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise$Transformer.apply(Promise.scala:122) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise$Transformer.apply(Promise.scala:103) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise$$anon$1.run(Promise.scala:366) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.concurrent.LocalScheduler$Activation.run(Scheduler.scala:178) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.concurrent.LocalScheduler$Activation.submit(Scheduler.scala:136) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.concurrent.LocalScheduler.submit(Scheduler.scala:207) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.concurrent.Scheduler$.submit(Scheduler.scala:92) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise.runq(Promise.scala:350) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.Promise.updateIfEmpty(Promise.scala:721) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at com.twitter.util.ExecutorServiceFuturePool$$anon$2.run(FuturePool.scala:107) [com.twitter.util-core_2.11-6.30.0.jar:6.30.0]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_77]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_77]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77]

Caused by: com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to disco!overlord while waiting for a response for the request, including retries (if applicable)

at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]

2016-04-06 05:38:11,069 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] INFO c.metamx.emitter.core.LoggingEmitter - Event [{"feed":"alerts","timestamp":"2016-04-06T05:38:11.063Z","service":"tranquility","host":"localhost","severity":"anomaly","description":"Failed to create merged beam: overlord/clientevents2","data":{"exceptionType":"java.lang.IllegalStateException","exceptionMessage":"Failed to save new beam for identifier[overlord/clientevents2] timestamp[2016-04-06T05:00:00.000Z]","exceptionStackTrace":"java.lang.IllegalStateException: Failed to save new beam for identifier[overlord/clientevents2] timestamp[2016-04-06T05:00:00.000Z]\n\tat com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:286)\n\tat com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:283)\n\tat com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:924)\n\tat com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:922)\n\tat com.twitter.util.Promise$Transformer.liftedTree1$1(Promise.scala:112)\n\tat com.twitter.util.Promise$Transformer.k(Promise.scala:112)\n\tat com.twitter.util.Promise$Transformer.apply(Promise.scala:122)\n\tat com.twitter.util.Promise$Transformer.apply(Promise.scala:103)\n\tat com.twitter.util.Promise$$anon$1.run(Promise.scala:366)\n\tat com.twitter.concurrent.LocalScheduler$Activation.run(Scheduler.scala:178)\n\tat com.twitter.concurrent.LocalScheduler$Activation.submit(Scheduler.scala:136)\n\tat com.twitter.concurrent.LocalScheduler.submit(Scheduler.scala:207)\n\tat com.twitter.concurrent.Scheduler$.submit(Scheduler.scala:92)\n\tat com.twitter.util.Promise.runq(Promise.scala:350)\n\tat com.twitter.util.Promise.updateIfEmpty(Promise.scala:721)\n\tat com.twitter.util.ExecutorServiceFuturePool$$anon$2.run(FuturePool.scala:107)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)\n\tat java.lang.Thread.run(Thread.java:745)\nCaused by: com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to disco!overlord while waiting for a response for the request, including retries (if applicable)\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n"}}]

2016-04-06 05:38:11,070 [ClusteredBeam-ZkFuturePool-c334cfc9-6f39-474d-be55-78413d0d6a5b] WARN c.m.t.tranquilizer.Tranquilizer - Failed to send 1 messages.