Error on sender.send(obj) using Tranquility

[Marcelo Oikawa]

Hi, list.

I'm using this druid docker container[1] and I'm also trying to connect druid from a Java App built outside the container with Tranquility API.

The Java App is exactly like [2] and I customized the example.json [3] for wikipedia schema. But, unfortunately, I'm getting this error on druid console:

​

And the Java App has no response for sender.send(obj). What am I doing wrong? 

[1] https://hub.docker.com/r/druidio/example-cluster/

[2] https://github.com/druid-io/tranquility/blob/master/core/src/test/java/com/metamx/tranquility/example/JavaExample.java

[3] https://github.com/druid-io/tranquility/blob/master/docs/configuration.md

[Gian Merlino]

Hey Marcelo,

Whoa, this is weird, although I don't think it's related to Tranquility (it doesn't talk to the Druid Broker at all, which is what seems to be logging those messages). I wonder if something else is sending strange requests into your container

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CAD1mpAE91C%3DEEPKYVtFcE6pJGGSr-tupTdm1X9-B30MpFd_V0w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Marcelo Oikawa]

Hi Gian,

 

Whoa, this is weird, although I don't think it's related to Tranquility (it doesn't talk to the Druid Broker at all, which is what seems to be logging those messages).

Indeed, this message comes from HttpParser inside Jetty implementation and I'm trying to understand if it's related to OS details. My Java App is running on Windows and the druid docker container is on Ubuntu. 

I wonder if something else is sending strange requests into your container

I dont think so because my app is very simple and this message comes up just when I ran my Java app.

 

Gian

On Tue, Mar 8, 2016 at 6:00 AM, Marcelo Oikawa <marcelo...@webradar.com> wrote:

Hi, list.

I'm using this druid docker container[1] and I'm also trying to connect druid from a Java App built outside the container with Tranquility API.

The Java App is exactly like [2] and I customized the example.json [3] for wikipedia schema. But, unfortunately, I'm getting this error on druid console:

​

And the Java App has no response for sender.send(obj). What am I doing wrong? 

[1] https://hub.docker.com/r/druidio/example-cluster/

[2] https://github.com/druid-io/tranquility/blob/master/core/src/test/java/com/metamx/tranquility/example/JavaExample.java

[3] https://github.com/druid-io/tranquility/blob/master/docs/configuration.md

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CAD1mpAE91C%3DEEPKYVtFcE6pJGGSr-tupTdm1X9-B30MpFd_V0w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CACZNdYCMELkLr66jxNxDDgLr8GLJDdyPAHR-Uf_h7wRBPV483g%40mail.gmail.com.

[Marcelo Oikawa]

Hi Gian,

Whoa, this is weird, although I don't think it's related to Tranquility (it doesn't talk to the Druid Broker at all, which is what seems to be logging those messages).

You were right. I made a mistake setting the wrong port to broker instead of zookeeper. My bad. 

But, unfortunately, I'm still not insert data on Druid. I'm getting the error:

java.lang.IllegalStateException: Failed to save new beam for identifier[druid:overlord/wikipedia] timestamp[2016-03-09T00:00:00.000Z]

at com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:286)

at com.metamx.tranquility.beam.ClusteredBeam$$anonfun$2.applyOrElse(ClusteredBeam.scala:283)

at com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:924)

at com.twitter.util.Future$$anonfun$rescue$1.apply(Future.scala:922)

at com.twitter.util.Promise$Transformer.liftedTree1$1(Promise.scala:112)

at com.twitter.util.Promise$Transformer.k(Promise.scala:112)

at com.twitter.util.Promise$Transformer.apply(Promise.scala:122)

at com.twitter.util.Promise$Transformer.apply(Promise.scala:103)

at com.twitter.util.Promise$$anon$1.run(Promise.scala:366)

at com.twitter.concurrent.LocalScheduler$Activation.run(Scheduler.scala:178)

at com.twitter.concurrent.LocalScheduler$Activation.submit(Scheduler.scala:136)

at com.twitter.concurrent.LocalScheduler.submit(Scheduler.scala:207)

at com.twitter.concurrent.Scheduler$.submit(Scheduler.scala:92)

at com.twitter.util.Promise.runq(Promise.scala:350)

at com.twitter.util.Promise.updateIfEmpty(Promise.scala:721)

at com.twitter.util.ExecutorServiceFuturePool$$anon$2.run(FuturePool.scala:107)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

The JSON configuration file is:

{
  "dataSources":[
    {
      "spec": {
        "dataSchema": {
          "dataSource": "wikipedia",
          "parser": {
            "type": "string",
            "parseSpec": {
              "format": "json",
              "timestampSpec": {"column": "timestamp", "format": "auto"},
              "dimensionsSpec":{
                "dimensions": ["page", "language", "user", "unpatrolled", "newPage", "robot", "anonymous", "namespace", "continent", "country", "region", "city"]
              }
            }
          },
          "metricsSpec": [
            {"type": "count", "name": "count"},
            {"type": "doubleSum", "name": "added", "fieldName": "added"},
            {"type": "doubleSum", "name": "deleted", "fieldName": "deleted"},
            {"type": "doubleSum", "name": "delta", "fieldName": "delta"}
          ],
          "granularitySpec": {
            "type" : "uniform",
            "segmentGranularity": "DAY",
            "queryGranularity": "NONE",
            "intervals": ["2013-08-31/2013-09-01"]
          }
        },
        "tuningConfig": {
          "type" : "realtime",
          "windowPeriod" : "PT10M",
          "intermediatePersistPeriod" : "PT10M",
          "maxRowsInMemory" : "100000"
        }
      },
      "properties" : {
        "task.partitions" : "1",
        "task.replicants" : "1"
      }
    }
  ],
  "properties": {
    "zookeeper.connect": "192.168.99.100:2181",
    "druid.selectors.indexing.serviceName": "druid:overlord",
    "druid.discovery.curator.path": "/druid/discovery"
  }
}

Any thoughts are welcome.