log4j:WARN Please initialize the log4j system properly.
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.zookeeper.ZooKeeper.<init>(Ljava/lang/String;ILorg/apache/zookeeper/Watcher;Z)V
at org.apache.curator.utils.DefaultZookeeperFactory.newZooKeeper(DefaultZookeeperFactory.java:29)
at org.apache.curator.framework.imps.CuratorFrameworkImpl$2.newZooKeeper(CuratorFrameworkImpl.java:169)
final List<AggregatorFactory> aggregators = ImmutableList.<AggregatorFactory> of(new CountAggregatorFactory("count"));
My realtime task file had the following.
"aggregators": [
{
"type": "count",
"name": "count"
},
{
"type": "doubleSum",
"fieldName": "GMB_USD_OL_SC",
"name": "gmb_usd"
},
{
"type": "doubleSum",
"fieldName": "FP_GMB_USD_OL_SC",
"name": "gmb_fp"
},
{
"type": "doubleSum",
"fieldName": "AUCT_GMB_USD_OL_SC",
"name": "gmb_act"
},
{
"type": "doubleSum",
"fieldName": "QTY_BOUGHT_OL_SC",
"name": "bi"
},
{
"type": "doubleSum",
"fieldName": "FP_QTY_BOUGHT_OL_SC",
"name": "bi_fp"
},
{
"type": "doubleSum",
"fieldName": "AUCT_QTY_BOUGHT_OL_SC",
"name": "bi_act"
}
],
<dependency>
<groupId>com.metamx</groupId>
<artifactId>tranquility_2.10</artifactId>
<!-- Or for scala 2.9: -->
<!-- <artifactId>tranquility_2.9.1</artifactId> -->
<version>0.2.1</version>
<exclusions>
<exclusion>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
<version>3.4.6</version>
</dependency>
...
final Integer numSent = Await.result(numSentFuture);
returns 0
Regards,
Deepak
...
.rollup(DruidRollup.create(DruidDimensions.schemaless(), aggregators, QueryGranularity.MINUTE))
or
final List<String> dimensions = ImmutableList.of("EXPRMNT_ID",
"CHNL_ID", "GUID", "CUMM_START_DT");
.rollup(DruidRollup.create(dimensions, aggregators,QueryGranularity.MINUTE))
Promise@630856129(state=Done(Return(0)))
0
// Send events to Druid:
final Future<Integer> numSentFuture = druidService
.apply(listOfEvents);
System.out.println(numSentFuture);
// Wait for confirmation:
final Integer numSent = Await.result(numSentFuture);
System.out.println(numSent);
Regards,
Deepak
.timestampSpec(new TimestampSpec("TSTAMP", "posix"))
does not help.
Example TSTAMP value: TSTAMP=1404210353133
After changing to
Overlord runtime:
Thanks Gian.More questions
...<span style="font-size:12px;line-height:16.799999237060547px;white-space:pre"
2) As there was a exception. I switched service name to use / instead of : (Very confusing, what needs to be done)
This time its stuck at
final Integer numSent = Await.result(numSentFuture);
In either case, there is no movement in overlord logs, no creation of RT task.
4694 [pool-1-thread-1] INFO com.metamx.common.scala.net.finagle.DiscoResolver - Updating instances for service[druid/prod/overlord] to Set()
4702 [pool-1-thread-1] WARN finagle - Name resolution is pending
4746 [pool-1-thread-1] INFO com.metamx.tranquility.finagle.FinagleRegistry - Created client for service: druid/prod/overlord
6973 [ClusteredBeam-ZkFuturePool-4c5b8788-7ea4-4e69-96dd-3526f6d44d18] INFO com.metamx.tranquility.beam.ClusteredBeam - Creating new beams for identifier[druid/prod/overlord/expt_real] timestamp[2014-07-01T15:00:00.000+05:30] (target = 1, actual = 0)
new DruidLocation(new DruidEnvironment("druid:prod:overlord", "druid:firehose:%s"),
I still see the exception
org.codehaus.jackson.map.exc.UnrecognizedPropertyException: Unrecognized field "name" (Class org.apache.curator.x.discovery.ServiceInstance), not marked as ignorable at [Source: [B@42e68d00; line: 1, column: 10] (through reference chain: org.apache.curator.x.discovery.ServiceInstance["name"])
$ mvn dependency:list
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building producer 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-dependency-plugin:2.8:list (default-cli) @ producer ---
[INFO]
[INFO] The following files have been resolved:
[INFO] io.druid:druid-server:jar:0.6.121:compile
[INFO] org.apache.maven:maven-aether-provider:jar:3.1.1:compile
[INFO] com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] com.sun.jersey:jersey-json:jar:1.9:provided
[INFO] com.twitter:finagle-core_2.10:jar:6.16.0:compile
[INFO] stax:stax-api:jar:1.0.1:provided
[INFO] javax.mail:mail:jar:1.4:compile
[INFO] com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.2.3:compile
[INFO] commons-dbcp:commons-dbcp:jar:1.4:compile
[INFO] com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.2.3:compile
[INFO] commons-daemon:commons-daemon:jar:1.0.13:provided
[INFO] commons-io:commons-io:jar:2.1:compile
[INFO] io.airlift:airline:jar:0.5:compile
[INFO] com.google.guava:guava:jar:11.0.2:compile
[INFO] org.mozilla:rhino:jar:1.7R4:compile
[INFO] io.druid:druid-indexing-service:jar:0.6.121:compile
[INFO] com.thoughtworks.paranamer:paranamer:jar:2.3:compile
[INFO] com.yammer.metrics:metrics-annotation:jar:2.2.0:compile
[INFO] org.apache.curator:curator-framework:jar:2.4.0:compile
[INFO] org.eclipse.aether:aether-api:jar:0.9.0.M2:compile
[INFO] org.scala-lang:scala-compiler:jar:2.10.1:compile
[INFO] com.twitter:util-hashing_2.10:jar:6.16.0:compile
[INFO] commons-cli:commons-cli:jar:1.2:compile
[INFO] org.joda:joda-convert:jar:1.6:compile
[INFO] com.twitter:util-logging_2.10:jar:6.16.0:compile
[INFO] org.slf4j:slf4j-api:jar:1.7.5:compile
[INFO] com.ning:compress-lzf:jar:0.8.4:compile
[INFO] com.davekoelle:alphanum:jar:1.0.3:compile
[INFO] org.apache.zookeeper:zookeeper:jar:3.4.6:compile
[INFO] tomcat:jasper-compiler:jar:5.5.23:provided
[INFO] org.glassfish.grizzly:grizzly-rcm:jar:2.1.2:provided
[INFO] org.apache.hadoop:hadoop-yarn-server-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.codehaus.jettison:jettison:jar:1.1:provided
[INFO] org.eclipse.jetty:jetty-http:jar:9.1.5.v20140505:compile
[INFO] org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.apache.commons:commons-compress:jar:1.4.1:provided
[INFO] javax.validation:validation-api:jar:1.1.0.Final:compile
[INFO] net.sf.kosmosfs:kfs:jar:0.3:provided
[INFO] org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
[INFO] io.tesla.aether:aether-connector-okhttp:jar:0.0.9:compile
[INFO] commons-codec:commons-codec:jar:1.4:compile
[INFO] org.eclipse.aether:aether-connector-file:jar:0.9.0.M2:compile
[INFO] log4j:log4j:jar:1.2.15:compile
[INFO] com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.2.3:compile
[INFO] com.metamx:scala-util_2.10:jar:1.8.15:compile
[INFO] com.amazonaws:aws-java-sdk:jar:1.6.0.1:compile
[INFO] org.apache.maven:maven-repository-metadata:jar:3.1.1:compile
[INFO] com.sun.jersey:jersey-grizzly2:jar:1.9:provided
[INFO] org.eintr.loglady:loglady_2.10:jar:1.1.0:compile
[INFO] io.tesla.aether:tesla-aether:jar:0.0.5:compile
[INFO] org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1:compile
[INFO] com.sun.jersey.jersey-test-framework:jersey-test-framework-grizzly2:jar:1.9:provided
[INFO] commons-net:commons-net:jar:3.1:provided
[INFO] commons-el:commons-el:jar:1.0:provided
[INFO] ant:ant:jar:1.6.5:provided
[INFO] org.apache.pig:pig:jar:0.12.0.2.0.6.0-76:provided
[INFO] org.apache.hadoop:hadoop-auth:jar:2.2.0.2.0.6.0-76:provided
[INFO] asm:asm:jar:3.1:compile
[INFO] org.skife.config:config-magic:jar:0.9:compile
[INFO] org.eclipse.jdt:core:jar:3.1.1:provided
[INFO] io.druid:druid-api:jar:0.2.3:compile
[INFO] org.antlr:ST4:jar:4.0.4:provided
[INFO] org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.eclipse.jetty:jetty-security:jar:9.1.5.v20140505:compile
[INFO] org.apache.curator:curator-recipes:jar:2.4.0:compile
[INFO] io.druid:druid-processing:jar:0.6.121:compile
[INFO] commons-logging:commons-logging:jar:1.1.1:compile
[INFO] org.eclipse.aether:aether-impl:jar:0.9.0.M2:compile
[INFO] com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.2.3:compile
[INFO] org.mortbay.jetty:jsp-2.1:jar:6.1.14:provided
[INFO] com.sun.jersey:jersey-core:jar:1.9:compile
[INFO] com.google.http-client:google-http-client-jackson2:jar:1.15.0-rc:compile
[INFO] io.netty:netty:jar:3.6.2.Final:compile
[INFO] org.codehaus.plexus:plexus-utils:jar:3.0.15:compile
[INFO] commons-digester:commons-digester:jar:1.8:provided
[INFO] javax.activation:activation:jar:1.1:compile
[INFO] com.metamx:bytebuffer-collections:jar:0.0.2:compile
[INFO] org.eclipse.jetty:jetty-util:jar:9.1.5.v20140505:compile
[INFO] com.maxmind.geoip2:geoip2:jar:0.4.0:compile
[INFO] com.fasterxml.jackson.core:jackson-databind:jar:2.2.2:compile
[INFO] aopalliance:aopalliance:jar:1.0:compile
[INFO] com.yammer.metrics:metrics-core:jar:2.2.0:compile
[INFO] org.jboss.logging:jboss-logging:jar:3.1.1.GA:compile
[INFO] com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.2.2:compile
[INFO] org.apache.maven:maven-settings:jar:3.1.1:compile
[INFO] com.metamx:emitter:jar:0.2.12:compile
[INFO] hsqldb:hsqldb:jar:1.8.0.10:provided
[INFO] org.apache.httpcomponents:httpclient:jar:4.2:compile
[INFO] com.fasterxml.jackson.core:jackson-annotations:jar:2.2.2:compile
[INFO] org.apache.maven:maven-model-builder:jar:3.1.1:compile
[INFO] c3p0:c3p0:jar:0.9.1.2:compile
[INFO] com.google.code.findbugs:jsr305:jar:1.3.9:compile
[INFO] com.ibm.icu:icu4j:jar:4.8.1:compile
[INFO] org.apache.avro:avro:jar:1.7.4:provided
[INFO] org.scala-tools.time:time_2.10:jar:0.6-mmx1:compile
[INFO] org.mortbay.jetty:servlet-api-2.5:jar:6.1.14:provided
[INFO] javax.xml.bind:jaxb-api:jar:2.2.2:provided
[INFO] joda-time:joda-time:jar:2.1:compile
[INFO] org.codehaus.jackson:jackson-jaxrs:jar:1.8.3:provided
[INFO] org.mortbay.jetty:jsp-api-2.1:jar:6.1.14:provided
[INFO] com.twitter:util-collection_2.10:jar:6.16.0:compile
[INFO] org.apache.maven:maven-settings-builder:jar:3.1.1:compile
[INFO] com.sun.jersey.jersey-test-framework:jersey-test-framework-core:jar:1.9:provided
[INFO] javax.servlet:javax.servlet-api:jar:3.1.0:compile
[INFO] commons-configuration:commons-configuration:jar:1.6:provided
[INFO] org.glassfish.external:management-api:jar:3.0.0-b012:provided
[INFO] javax.inject:javax.inject:jar:1:compile
[INFO] commons-pool:commons-pool:jar:1.6:compile
[INFO] com.twitter:util-app_2.10:jar:6.16.0:compile
[INFO] com.sun.jersey.contribs:jersey-guice:jar:1.9:compile
[INFO] org.apache.commons:commons-math:jar:2.1:provided
[INFO] javax.servlet.jsp:jsp-api:jar:2.1:provided
[INFO] org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.glassfish:javax.servlet:jar:3.1:provided
[INFO] io.druid:druid-common:jar:0.6.121:compile
[INFO] org.slf4j:jul-to-slf4j:jar:1.7.2:compile
[INFO] oro:oro:jar:2.0.8:provided
[INFO] com.google.code.simple-spring-memcached:spymemcached:jar:2.8.4:compile
[INFO] net.sf.jopt-simple:jopt-simple:jar:3.2:compile
[INFO] org.codehaus.jackson:jackson-xc:jar:1.8.3:provided
[INFO] org.apache.curator:curator-x-discovery:jar:2.4.0:compile
[INFO] com.google.inject:guice:jar:4.0-beta:compile
[INFO] org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:2.2.0.2.0.6.0-76:provided
[INFO] jline:jline:jar:0.9.94:compile
[INFO] commons-beanutils:commons-beanutils:jar:1.7.0:provided
[INFO] org.apache.httpcomponents:httpcore:jar:4.2:compile
[INFO] com.metamx:java-util:jar:0.25.1:compile
[INFO] commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] com.jcraft:jsch:jar:0.1.42:provided
[INFO] org.slf4j:slf4j-simple:jar:1.6.4:compile
[INFO] org.jdbi:jdbi:jar:2.27:compile
[INFO] org.apache.curator:curator-client:jar:2.4.0:compile
[INFO] org.glassfish.grizzly:grizzly-http-server:jar:2.1.2:provided
[INFO] org.apache.hadoop:hadoop-hdfs:jar:2.2.0.2.0.6.0-76:provided
[INFO] com.twitter:finagle-http_2.10:jar:6.16.0:compile
[INFO] com.fasterxml:classmate:jar:0.8.0:compile
[INFO] com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.2.2:compile
[INFO] com.google.inject.extensions:guice-servlet:jar:3.0:compile
[INFO] com.maxmind.maxminddb:maxminddb:jar:0.2.0:compile
[INFO] org.antlr:stringtemplate:jar:3.2.1:provided
[INFO] com.ircclouds.irc:irc-api:jar:1.0-0011:compile
[INFO] org.glassfish.grizzly:grizzly-http:jar:2.1.2:provided
[INFO] javax.servlet:servlet-api:jar:2.5:provided
[INFO] org.glassfish.grizzly:grizzly-framework:jar:2.1.2:provided
[INFO] org.antlr:antlr-runtime:jar:3.4:provided
[INFO] org.eclipse.aether:aether-spi:jar:0.9.0.M2:compile
[INFO] com.twitter:util-core_2.10:jar:6.16.0:compile
[INFO] org.eclipse.jetty:jetty-continuation:jar:9.1.5.v20140505:compile
[INFO] org.scala-lang:scala-library:jar:2.10.1:compile
[INFO] com.metamx:server-metrics:jar:0.0.9:compile
[INFO] org.antlr:antlr4-runtime:jar:4.0:compile
[INFO] com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:provided
[INFO] org.apache.maven.wagon:wagon-provider-api:jar:2.4:compile
[INFO] org.glassfish.grizzly:grizzly-http-servlet:jar:2.1.2:provided
[INFO] org.xerial.snappy:snappy-java:jar:1.0.4.1:compile
[INFO] org.apache.maven:maven-model:jar:3.1.1:compile
[INFO] org.glassfish.gmbal:gmbal-api-only:jar:3.0.0-b023:provided
[INFO] org.scala-lang:scala-reflect:jar:2.10.1:compile
[INFO] org.tukaani:xz:jar:1.0:provided
[INFO] junit:junit:jar:3.8.1:test
[INFO] org.eclipse.jetty:jetty-server:jar:9.1.5.v20140505:compile
[INFO] org.apache.hadoop:hadoop-yarn-client:jar:2.2.0.2.0.6.0-76:provided
[INFO] com.metamx:http-client:jar:0.9.6:compile
[INFO] com.fasterxml.jackson.module:jackson-module-scala_2.10:jar:2.2.2:compile
[INFO] com.google.http-client:google-http-client:jar:1.15.0-rc:compile
[INFO] org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] org.eclipse.jetty:jetty-io:jar:9.1.5.v20140505:compile
[INFO] org.apache.kafka:kafka_2.10:jar:0.8.0:compile
[INFO] org.mortbay.jetty:jetty-util:jar:6.1.26:provided
[INFO] org.hyperic:sigar:jar:1.6.5.132:compile
[INFO] org.apache.hadoop:hadoop-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] org.hibernate:hibernate-validator:jar:5.0.1.Final:compile
[INFO] com.metamx:tranquility_2.10:jar:0.2.1:compile
[INFO] net.jpountz.lz4:lz4:jar:1.1.2:compile
[INFO] commons-lang:commons-lang:jar:2.5:compile
[INFO] xmlenc:xmlenc:jar:0.52:provided
[INFO] org.apache.hadoop:hadoop-yarn-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] commons-beanutils:commons-beanutils-core:jar:1.8.0:provided
[INFO] antlr:antlr:jar:2.7.7:provided
[INFO] com.squareup.okhttp:okhttp:jar:1.0.2:compile
[INFO] com.twitter:util-codec_2.10:jar:6.16.0:compile
[INFO] mysql:mysql-connector-java:jar:5.1.18:compile
[INFO] org.codehaus.plexus:plexus-interpolation:jar:1.19:compile
[INFO] it.uniroma3.mat:extendedset:jar:1.3.4:compile
[INFO] com.twitter:util-jvm_2.10:jar:6.16.0:compile
[INFO] net.java.dev.jets3t:jets3t:jar:0.6.1:compile
[INFO] org.apache.hadoop:hadoop-annotations:jar:2.2.0.2.0.6.0-76:provided
[INFO] commons-collections:commons-collections:jar:3.2.1:compile
[INFO] org.eclipse.aether:aether-util:jar:0.9.0.M2:compile
[INFO] org.yaml:snakeyaml:jar:1.11:compile
[INFO] com.sun.jersey:jersey-client:jar:1.9:provided
[INFO] org.eclipse.jetty:jetty-servlet:jar:9.1.5.v20140505:compile
[INFO] com.101tec:zkclient:jar:0.3:compile
[INFO] org.slf4j:slf4j-log4j12:jar:1.7.5:compile
[INFO] org.eclipse.jetty:jetty-servlets:jar:9.1.5.v20140505:compile
[INFO] com.h2database:h2:jar:1.3.158:compile
[INFO] net.sf.opencsv:opencsv:jar:2.3:compile
[INFO] tomcat:jasper-runtime:jar:5.5.23:provided
[INFO] org.apache.hadoop:hadoop-yarn-api:jar:2.2.0.2.0.6.0-76:provided
[INFO] com.google.inject.extensions:guice-multibindings:jar:4.0-beta:compile
[INFO] xpp3:xpp3:jar:1.1.4c:compile
[INFO] io.druid:druid-indexing-hadoop:jar:0.6.121:compile
[INFO] org.mortbay.jetty:jetty:jar:6.1.26:provided
[INFO] com.sun.jersey:jersey-server:jar:1.9:compile
[INFO] com.fasterxml.jackson.core:jackson-core:jar:2.2.2:compile
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.010s
[INFO] Finished at: Fri Aug 29 22:23:17 GMT+05:30 2014
[INFO] Final Memory: 13M/81M
[INFO] ------------------------------------------------------------------------
:druid_producer dvasthimal$
AND
Building producer 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ producer ---
[INFO] com.ebay.metricstore:producer:jar:1.0-SNAPSHOT
[INFO] +- junit:junit:jar:3.8.1:test
[INFO] +- org.apache.kafka:kafka_2.10:jar:0.8.0:compile
[INFO] | +- org.scala-lang:scala-library:jar:2.10.1:compile
[INFO] | +- log4j:log4j:jar:1.2.15:compile
[INFO] | | \- javax.mail:mail:jar:1.4:compile
[INFO] | | \- javax.activation:activation:jar:1.1:compile
[INFO] | +- net.sf.jopt-simple:jopt-simple:jar:3.2:compile
[INFO] | +- org.slf4j:slf4j-simple:jar:1.6.4:compile
[INFO] | +- org.scala-lang:scala-compiler:jar:2.10.1:compile
[INFO] | | \- org.scala-lang:scala-reflect:jar:2.10.1:compile
[INFO] | +- com.101tec:zkclient:jar:0.3:compile
[INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile
[INFO] | +- com.yammer.metrics:metrics-core:jar:2.2.0:compile
[INFO] | \- com.yammer.metrics:metrics-annotation:jar:2.2.0:compile
[INFO] +- org.apache.hadoop:hadoop-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] | +- org.apache.hadoop:hadoop-annotations:jar:2.2.0.2.0.6.0-76:provided
[INFO] | +- com.google.guava:guava:jar:11.0.2:compile
[INFO] | | \- com.google.code.findbugs:jsr305:jar:1.3.9:compile
[INFO] | +- commons-cli:commons-cli:jar:1.2:compile
[INFO] | +- org.apache.commons:commons-math:jar:2.1:provided
[INFO] | +- xmlenc:xmlenc:jar:0.52:provided
[INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile
[INFO] | +- commons-codec:commons-codec:jar:1.4:compile
[INFO] | +- commons-io:commons-io:jar:2.1:compile
[INFO] | +- commons-net:commons-net:jar:3.1:provided
[INFO] | +- javax.servlet:servlet-api:jar:2.5:provided
[INFO] | +- org.mortbay.jetty:jetty:jar:6.1.26:provided
[INFO] | +- org.mortbay.jetty:jetty-util:jar:6.1.26:provided
[INFO] | +- com.sun.jersey:jersey-core:jar:1.9:compile
[INFO] | +- com.sun.jersey:jersey-json:jar:1.9:provided
[INFO] | | +- org.codehaus.jettison:jettison:jar:1.1:provided
[INFO] | | | \- stax:stax-api:jar:1.0.1:provided
[INFO] | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:provided
[INFO] | | | \- javax.xml.bind:jaxb-api:jar:2.2.2:provided
[INFO] | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.8.3:provided
[INFO] | | \- org.codehaus.jackson:jackson-xc:jar:1.8.3:provided
[INFO] | +- com.sun.jersey:jersey-server:jar:1.9:compile
[INFO] | | \- asm:asm:jar:3.1:compile
[INFO] | +- tomcat:jasper-compiler:jar:5.5.23:provided
[INFO] | +- tomcat:jasper-runtime:jar:5.5.23:provided
[INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:provided
[INFO] | +- commons-el:commons-el:jar:1.0:provided
[INFO] | +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] | +- net.java.dev.jets3t:jets3t:jar:0.6.1:compile
[INFO] | +- commons-lang:commons-lang:jar:2.5:compile
[INFO] | +- commons-configuration:commons-configuration:jar:1.6:provided
[INFO] | | +- commons-collections:commons-collections:jar:3.2.1:compile
[INFO] | | +- commons-digester:commons-digester:jar:1.8:provided
[INFO] | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:provided
[INFO] | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:provided
[INFO] | +- org.slf4j:slf4j-api:jar:1.7.5:compile
[INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile
[INFO] | +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
[INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] | +- org.apache.avro:avro:jar:1.7.4:provided
[INFO] | | \- com.thoughtworks.paranamer:paranamer:jar:2.3:compile
[INFO] | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] | +- org.apache.hadoop:hadoop-auth:jar:2.2.0.2.0.6.0-76:provided
[INFO] | +- com.jcraft:jsch:jar:0.1.42:provided
[INFO] | \- org.apache.commons:commons-compress:jar:1.4.1:provided
[INFO] | \- org.tukaani:xz:jar:1.0:provided
[INFO] +- org.apache.hadoop:hadoop-hdfs:jar:2.2.0.2.0.6.0-76:provided
[INFO] | \- commons-daemon:commons-daemon:jar:1.0.13:provided
[INFO] +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0.2.0.6.0-76:provided
[INFO] | +- org.apache.hadoop:hadoop-yarn-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] | | +- org.apache.hadoop:hadoop-yarn-api:jar:2.2.0.2.0.6.0-76:provided
[INFO] | | +- com.sun.jersey.jersey-test-framework:jersey-test-framework-grizzly2:jar:1.9:provided
[INFO] | | | +- com.sun.jersey.jersey-test-framework:jersey-test-framework-core:jar:1.9:provided
[INFO] | | | | \- com.sun.jersey:jersey-client:jar:1.9:provided
[INFO] | | | \- com.sun.jersey:jersey-grizzly2:jar:1.9:provided
[INFO] | | | +- org.glassfish.grizzly:grizzly-http:jar:2.1.2:provided
[INFO] | | | | \- org.glassfish.grizzly:grizzly-framework:jar:2.1.2:provided
[INFO] | | | | \- org.glassfish.gmbal:gmbal-api-only:jar:3.0.0-b023:provided
[INFO] | | | | \- org.glassfish.external:management-api:jar:3.0.0-b012:provided
[INFO] | | | +- org.glassfish.grizzly:grizzly-http-server:jar:2.1.2:provided
[INFO] | | | | \- org.glassfish.grizzly:grizzly-rcm:jar:2.1.2:provided
[INFO] | | | +- org.glassfish.grizzly:grizzly-http-servlet:jar:2.1.2:provided
[INFO] | | | \- org.glassfish:javax.servlet:jar:3.1:provided
[INFO] | | \- com.sun.jersey.contribs:jersey-guice:jar:1.9:compile
[INFO] | +- com.google.inject.extensions:guice-servlet:jar:3.0:compile
[INFO] | \- io.netty:netty:jar:3.6.2.Final:compile
[INFO] +- org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.2.0.2.0.6.0-76:provided
[INFO] | +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] | | +- org.apache.hadoop:hadoop-yarn-client:jar:2.2.0.2.0.6.0-76:provided
[INFO] | | \- org.apache.hadoop:hadoop-yarn-server-common:jar:2.2.0.2.0.6.0-76:provided
[INFO] | \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.2.0.2.0.6.0-76:provided
[INFO] | \- org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:2.2.0.2.0.6.0-76:provided
[INFO] +- org.apache.pig:pig:jar:0.12.0.2.0.6.0-76:provided
[INFO] | +- org.mortbay.jetty:jsp-api-2.1:jar:6.1.14:provided
[INFO] | +- org.mortbay.jetty:jsp-2.1:jar:6.1.14:provided
[INFO] | | +- org.eclipse.jdt:core:jar:3.1.1:provided
[INFO] | | \- ant:ant:jar:1.6.5:provided
[INFO] | +- org.mortbay.jetty:servlet-api-2.5:jar:6.1.14:provided
[INFO] | +- net.sf.kosmosfs:kfs:jar:0.3:provided
[INFO] | +- hsqldb:hsqldb:jar:1.8.0.10:provided
[INFO] | +- oro:oro:jar:2.0.8:provided
[INFO] | +- org.antlr:antlr-runtime:jar:3.4:provided
[INFO] | | +- org.antlr:stringtemplate:jar:3.2.1:provided
[INFO] | | \- antlr:antlr:jar:2.7.7:provided
[INFO] | +- org.antlr:ST4:jar:4.0.4:provided
[INFO] | \- joda-time:joda-time:jar:2.1:compile
[INFO] +- com.metamx:tranquility_2.10:jar:0.2.1:compile
[INFO] | +- com.metamx:scala-util_2.10:jar:1.8.15:compile
[INFO] | | +- org.eintr.loglady:loglady_2.10:jar:1.1.0:compile
[INFO] | | +- com.metamx:java-util:jar:0.25.1:compile
[INFO] | | | \- net.sf.opencsv:opencsv:jar:2.3:compile
[INFO] | | +- com.metamx:http-client:jar:0.9.6:compile
[INFO] | | +- com.metamx:emitter:jar:0.2.12:compile
[INFO] | | +- com.metamx:server-metrics:jar:0.0.9:compile
[INFO] | | | \- org.hyperic:sigar:jar:1.6.5.132:compile
[INFO] | | +- org.joda:joda-convert:jar:1.6:compile
[INFO] | | +- org.scala-tools.time:time_2.10:jar:0.6-mmx1:compile
[INFO] | | +- org.skife.config:config-magic:jar:0.9:compile
[INFO] | | +- org.yaml:snakeyaml:jar:1.11:compile
[INFO] | | +- org.jdbi:jdbi:jar:2.27:compile
[INFO] | | +- mysql:mysql-connector-java:jar:5.1.18:compile
[INFO] | | +- com.h2database:h2:jar:1.3.158:compile
[INFO] | | +- c3p0:c3p0:jar:0.9.1.2:compile
[INFO] | | +- org.apache.curator:curator-framework:jar:2.4.0:compile
[INFO] | | | \- org.apache.curator:curator-client:jar:2.4.0:compile
[INFO] | | +- org.apache.curator:curator-recipes:jar:2.4.0:compile
[INFO] | | +- org.apache.curator:curator-x-discovery:jar:2.4.0:compile
[INFO] | | +- com.twitter:util-core_2.10:jar:6.16.0:compile
[INFO] | | +- com.twitter:finagle-core_2.10:jar:6.16.0:compile
[INFO] | | | +- com.twitter:util-app_2.10:jar:6.16.0:compile
[INFO] | | | +- com.twitter:util-collection_2.10:jar:6.16.0:compile
[INFO] | | | +- com.twitter:util-hashing_2.10:jar:6.16.0:compile
[INFO] | | | +- com.twitter:util-jvm_2.10:jar:6.16.0:compile
[INFO] | | | \- com.twitter:util-logging_2.10:jar:6.16.0:compile
[INFO] | | \- com.twitter:finagle-http_2.10:jar:6.16.0:compile
[INFO] | | \- com.twitter:util-codec_2.10:jar:6.16.0:compile
[INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.2:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-core:jar:2.2.2:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.2.2:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.2.2:compile
[INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.2.2:compile
[INFO] | +- com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.2.2:compile
[INFO] | +- com.fasterxml.jackson.module:jackson-module-scala_2.10:jar:2.2.2:compile
[INFO] | +- io.druid:druid-server:jar:0.6.121:compile
[INFO] | | +- io.druid:druid-processing:jar:0.6.121:compile
[INFO] | | | +- com.metamx:bytebuffer-collections:jar:0.0.2:compile
[INFO] | | | +- com.ning:compress-lzf:jar:0.8.4:compile
[INFO] | | | +- it.uniroma3.mat:extendedset:jar:1.3.4:compile
[INFO] | | | +- com.ibm.icu:icu4j:jar:4.8.1:compile
[INFO] | | | +- org.mozilla:rhino:jar:1.7R4:compile
[INFO] | | | \- com.davekoelle:alphanum:jar:1.0.3:compile
[INFO] | | +- javax.inject:javax.inject:jar:1:compile
[INFO] | | +- com.amazonaws:aws-java-sdk:jar:1.6.0.1:compile
[INFO] | | | \- org.apache.httpcomponents:httpclient:jar:4.2:compile
[INFO] | | +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.2.3:compile
[INFO] | | | +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.2.3:compile
[INFO] | | | \- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.2.3:compile
[INFO] | | +- org.eclipse.jetty:jetty-server:jar:9.1.5.v20140505:compile
[INFO] | | | +- javax.servlet:javax.servlet-api:jar:3.1.0:compile
[INFO] | | | +- org.eclipse.jetty:jetty-http:jar:9.1.5.v20140505:compile
[INFO] | | | \- org.eclipse.jetty:jetty-io:jar:9.1.5.v20140505:compile
[INFO] | | +- io.tesla.aether:tesla-aether:jar:0.0.5:compile
[INFO] | | | +- org.eclipse.aether:aether-spi:jar:0.9.0.M2:compile
[INFO] | | | +- org.eclipse.aether:aether-util:jar:0.9.0.M2:compile
[INFO] | | | +- org.eclipse.aether:aether-impl:jar:0.9.0.M2:compile
[INFO] | | | +- org.eclipse.aether:aether-connector-file:jar:0.9.0.M2:compile
[INFO] | | | +- io.tesla.aether:aether-connector-okhttp:jar:0.0.9:compile
[INFO] | | | | +- com.squareup.okhttp:okhttp:jar:1.0.2:compile
[INFO] | | | | \- org.apache.maven.wagon:wagon-provider-api:jar:2.4:compile
[INFO] | | | +- org.apache.maven:maven-aether-provider:jar:3.1.1:compile
[INFO] | | | | +- org.apache.maven:maven-model:jar:3.1.1:compile
[INFO] | | | | +- org.apache.maven:maven-model-builder:jar:3.1.1:compile
[INFO] | | | | +- org.apache.maven:maven-repository-metadata:jar:3.1.1:compile
[INFO] | | | | \- org.codehaus.plexus:plexus-utils:jar:3.0.15:compile
[INFO] | | | +- org.apache.maven:maven-settings-builder:jar:3.1.1:compile
[INFO] | | | | \- org.codehaus.plexus:plexus-interpolation:jar:1.19:compile
[INFO] | | | \- org.apache.maven:maven-settings:jar:3.1.1:compile
[INFO] | | +- org.eclipse.aether:aether-api:jar:0.9.0.M2:compile
[INFO] | | +- org.antlr:antlr4-runtime:jar:4.0:compile
[INFO] | | | \- org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1:compile
[INFO] | | +- com.google.code.simple-spring-memcached:spymemcached:jar:2.8.4:compile
[INFO] | | +- net.jpountz.lz4:lz4:jar:1.1.2:compile
[INFO] | | +- org.eclipse.jetty:jetty-servlet:jar:9.1.5.v20140505:compile
[INFO] | | | \- org.eclipse.jetty:jetty-security:jar:9.1.5.v20140505:compile
[INFO] | | +- org.eclipse.jetty:jetty-servlets:jar:9.1.5.v20140505:compile
[INFO] | | | +- org.eclipse.jetty:jetty-continuation:jar:9.1.5.v20140505:compile
[INFO] | | | \- org.eclipse.jetty:jetty-util:jar:9.1.5.v20140505:compile
[INFO] | | +- com.ircclouds.irc:irc-api:jar:1.0-0011:compile
[INFO] | | \- com.maxmind.geoip2:geoip2:jar:0.4.0:compile
[INFO] | | +- com.maxmind.maxminddb:maxminddb:jar:0.2.0:compile
[INFO] | | +- com.google.http-client:google-http-client:jar:1.15.0-rc:compile
[INFO] | | | \- xpp3:xpp3:jar:1.1.4c:compile
[INFO] | | \- com.google.http-client:google-http-client-jackson2:jar:1.15.0-rc:compile
[INFO] | +- io.druid:druid-indexing-service:jar:0.6.121:compile
[INFO] | | +- io.druid:druid-common:jar:0.6.121:compile
[INFO] | | | +- io.druid:druid-api:jar:0.2.3:compile
[INFO] | | | | \- io.airlift:airline:jar:0.5:compile
[INFO] | | | +- commons-dbcp:commons-dbcp:jar:1.4:compile
[INFO] | | | +- commons-pool:commons-pool:jar:1.6:compile
[INFO] | | | +- org.hibernate:hibernate-validator:jar:5.0.1.Final:compile
[INFO] | | | | +- org.jboss.logging:jboss-logging:jar:3.1.1.GA:compile
[INFO] | | | | \- com.fasterxml:classmate:jar:0.8.0:compile
[INFO] | | | \- com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.2.3:compile
[INFO] | | \- io.druid:druid-indexing-hadoop:jar:0.6.121:compile
[INFO] | | \- org.apache.httpcomponents:httpcore:jar:4.2:compile
[INFO] | +- com.google.inject:guice:jar:4.0-beta:compile
[INFO] | | \- aopalliance:aopalliance:jar:1.0:compile
[INFO] | +- com.google.inject.extensions:guice-multibindings:jar:4.0-beta:compile
[INFO] | \- javax.validation:validation-api:jar:1.1.0.Final:compile
[INFO] \- org.apache.zookeeper:zookeeper:jar:3.4.6:compile
[INFO] \- jline:jline:jar:0.9.94:compile
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.117s
[INFO] Finished at: Fri Aug 29 22:23:43 GMT+05:30 2014
[INFO] Final Memory: 13M/81M
AND
pom.xml
<url>http://maven.apache.org</url>
<dependencies>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>3.8.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.kafka</groupId>
<artifactId>kafka_2.10</artifactId>
<version>0.8.0</version>
<exclusions>
<exclusion>
<groupId>com.sun.jmx</groupId>
<artifactId>jmxri</artifactId>
</exclusion>
<exclusion>
<groupId>com.sun.jdmk</groupId>
<artifactId>jmxtools</artifactId>
</exclusion>
<exclusion>
<groupId>javax.jms</groupId>
<artifactId>jms</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>2.2.0.2.0.6.0-76</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-hdfs</artifactId>
<version>2.2.0.2.0.6.0-76</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-core</artifactId>
<version>2.2.0.2.0.6.0-76</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-jobclient</artifactId>
<version>2.2.0.2.0.6.0-76</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.pig</groupId>
<artifactId>pig</artifactId>
<version>0.12.0.2.0.6.0-76</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.metamx</groupId>
<artifactId>tranquility_2.10</artifactId>
<!-- Or for scala 2.9: -->
<!-- <artifactId>tranquility_2.9.1</artifactId> -->
<version>0.2.1</version>
<exclusions>
<exclusion>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
<version>3.4.6</version>
</dependency>
</dependencies>
--
You received this message because you are subscribed to a topic in the Google Groups "Druid Development" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-development/eIiuSS-fM8I/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/ae0aebae-ed79-4f60-a077-cecfce62e691%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
...
<dependency>
<groupId>com.metamx</groupId>
<artifactId>tranquility_2.16</artifactId>
<version>0.2.1</version>
<exclusions>
<exclusion>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
<version>3.4.6</version>
</dependency>
...
...
Deepak
...</
Deepak
...[INFO] | 
final Integer numSent = Await.result(numSentFuture);
It got a timeout exception.
18557 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.beam.ClusteredBeam - Beams already created for identifier[druid:prod:overlord/expt_real] timestamp[2014-07-01T15:00:00.000+05:30], with sufficient partitions (target = 1, actual = 1)
18865 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.beam.ClusteredBeam - Adding beams for identifier[druid:prod:overlord/expt_real] timestamp[2014-07-01T15:00:00.000+05:30]: List(Map(timestamp -> 2014-07-01T15:00:00.000+05:30, partition -> 0, tasks -> Buffer(Map(id -> index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime, firehoseId -> expt_real-15-0000-0000))))
21134 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.common.scala.net.finagle.DiscoResolver - Updating instances for service[druid:firehose:expt_real-15-0000-0000] to Set()
21135 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] WARN finagle - Name resolution is pending
21136 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.finagle.FinagleRegistry - Created client for service: druid:firehose:expt_real-15-0000-0000
111269 [Hashed wheel timer #1] WARN com.metamx.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:prod:overlord/expt_real
{
"eventCount" : 1,
"timestamp" : "2014-07-01T15:00:00.000+05:30",
"beams" : "HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T15:00:00.000+05:30, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime/expt_real-15-0000-0000]))"
}
com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)
at com.twitter.finagle.NoStacktrace(Unknown Source)
111293 [Hashed wheel timer #1] INFO com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"alerts","timestamp":"2014-09-04T22:17:52.510+05:30","service":"tranquility","host":"localhost","severity":"anomaly","description":"Failed to propagate events: druid:prod:overlord/expt_real","data":{"exceptionType":"com.twitter.finagle.GlobalRequestTimeoutException","exceptionStackTrace":"com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n","timestamp":"2014-07-01T15:00:00.000+05:30","beams":"HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T15:00:00.000+05:30, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime/expt_real-15-0000-0000]))","eventCount":1,"exceptionMessage":"exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)"}}]
count query returned []
2) Killed the tranq client, RT task is still running from previous attempt. I submitted one event in both cases and i see the same exception
18557 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.beam.ClusteredBeam - Beams already created for identifier[druid:prod:overlord/expt_real] timestamp[2014-07-01T15:00:00.000+05:30], with sufficient partitions (target = 1, actual = 1)
18865 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.beam.ClusteredBeam - Adding beams for identifier[druid:prod:overlord/expt_real] timestamp[2014-07-01T15:00:00.000+05:30]: List(Map(timestamp -> 2014-07-01T15:00:00.000+05:30, partition -> 0, tasks -> Buffer(Map(id -> index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime, firehoseId -> expt_real-15-0000-0000))))
21134 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.common.scala.net.finagle.DiscoResolver - Updating instances for service[druid:firehose:expt_real-15-0000-0000] to Set()
21135 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] WARN finagle - Name resolution is pending
21136 [ClusteredBeam-ZkFuturePool-aa484fde-6b16-43d8-b10d-b842ced7f4a8] INFO com.metamx.tranquility.finagle.FinagleRegistry - Created client for service: druid:firehose:expt_real-15-0000-0000
111269 [Hashed wheel timer #1] WARN com.metamx.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:prod:overlord/expt_real
{
"eventCount" : 1,
"timestamp" : "2014-07-01T15:00:00.000+05:30",
"beams" : "HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T15:00:00.000+05:30, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime/expt_real-15-0000-0000]))"
}
com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)
at com.twitter.finagle.NoStacktrace(Unknown Source)
111293 [Hashed wheel timer #1] INFO com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"alerts","timestamp":"2014-09-04T22:17:52.510+05:30","service":"tranquility","host":"localhost","severity":"anomaly","description":"Failed to propagate events: druid:prod:overlord/expt_real","data":{"exceptionType":"com.twitter.finagle.GlobalRequestTimeoutException","exceptionStackTrace":"com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n","timestamp":"2014-07-01T15:00:00.000+05:30","beams":"HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T15:00:00.000+05:30, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T15:00:00.000+05:30_0_0_kddfgime/expt_real-15-0000-0000]))","eventCount":1,"exceptionMessage":"exceeded 1.minutes+30.seconds to druid:firehose:expt_real-15-0000-0000 while waiting for a response for the request, including retries (if applicable)"}}]
Deepak
...[INFO] |&
...
1)
Deepak
...<p
2014-09-05 04:24:42,546 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_realtime_expt_real_2014-07-01T03:00:00.000-07:00_0_0_gnfndggh 2014-09-05 04:24:42,547 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_realtime_expt_real_2014-07-01T03:00:00.000-07:00_0_0_gnfndggh]: LockListAction{} 2014-09-05 04:24:42,559 ERROR [task-runner-0] io.druid.curator.discovery.ServerDiscoverySelector - No server instance found 2014-09-05 04:24:42,560 WARN [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_realtime_expt_real_2014-07-01T03:00:00.000-07:00_0_0_gnfndggh] java.io.IOException: Failed to locate service uri at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:83) at io.druid.indexing.common.task.AbstractTask.getTaskLocks(AbstractTask.java:160) at io.druid.indexing.common.task.RealtimeIndexTask.run(RealtimeIndexTask.java:195) at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:219) at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:198) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: com.metamx.common.ISE: Cannot find instance of indexer to talk to! at io.druid.indexing.common.actions.RemoteTaskActionClient.getServiceUri(RemoteTaskActionClient.java:134) at io.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:80) ... 8 more 2014-09-05 04:24:42,562 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Will try again in [PT60S].
1)
Deepak
...[INFO]&nb
4009 [ClusteredBeam-ZkFuturePool-035edd5c-b8bd-45c6-b98e-4c77ed8bba54] WARN finagle - Name resolution is pending
4011 [ClusteredBeam-ZkFuturePool-035edd5c-b8bd-45c6-b98e-4c77ed8bba54] INFO com.metamx.tranquility.finagle.FinagleRegistry - Created client for service: druid:firehose:expt_real-03-0000-0000
94058 [Hashed wheel timer #1] WARN com.metamx.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:prod:overlord/expt_real
{
"eventCount" : 1,
"timestamp" : "2014-07-01T03:00:00.000-07:00",
"beams" : "HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T03:00:00.000-07:00, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T03:00:00.000-07:00_0_0_gnfndggh/expt_real-03-0000-0000]))"
}
com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-03-0000-0000 while waiting for a response for the request, including retries (if applicable)
at com.twitter.finagle.NoStacktrace(Unknown Source)
94085 [Hashed wheel timer #1] INFO com.metamx.emitter.core.LoggingEmitter - Event [{"feed":"alerts","timestamp":"2014-09-04T21:26:05.172-07:00","service":"tranquility","host":"localhost","severity":"anomaly","description":"Failed to propagate events: druid:prod:overlord/expt_real","data":{"exceptionType":"com.twitter.finagle.GlobalRequestTimeoutException","exceptionStackTrace":"com.twitter.finagle.GlobalRequestTimeoutException: exceeded 1.minutes+30.seconds to druid:firehose:expt_real-03-0000-0000 while waiting for a response for the request, including retries (if applicable)\n\tat com.twitter.finagle.NoStacktrace(Unknown Source)\n","timestamp":"2014-07-01T03:00:00.000-07:00","beams":"HashPartitionBeam(DruidBeam(timestamp = 2014-07-01T03:00:00.000-07:00, partition = 0, tasks = [index_realtime_expt_real_2014-07-01T03:00:00.000-07:00_0_0_gnfndggh/expt_real-03-0000-0000]))","eventCount":1,"exceptionMessage":"exceeded 1.minutes+30.seconds to druid:firehose:expt_real-03-0000-0000 while waiting for a response for the request, including retries (if applicable)"}}]
0
...
druid.selectors.indexing.serviceName=overlord
--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/12ad3a0a-6dbf-4fd4-b77b-01eb1d05fb94%40googlegroups.com.
druid.selectors.indexing.serviceName=druid/prod/overlord
...
druid.service=druid/prod/overlord
...
Exception in RT logs:
1)
Deepak
...[INFO] &
.tuning(ClusteredBeamTuning.create(Granularity.HOUR, new Period("PT0M"), new Period("PT60M"), 1, 1))
Here PT60M is the windowPeriod. PT2Y (year) format is not supported. This will cause your task to start and kill. Once the task is killed (or shutdown) druid will delete the logs for default settings. (this could have been avoided).
Regards,
deepak
...
...
--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/3b190417-5a56-49c3-b976-360ed9b8f848%40googlegroups.com.