Druid-0.12 with Tranquility

89 views
Skip to first unread message

Sai Chandu

unread,
Apr 8, 2018, 4:52:29 AM4/8/18
to Druid Development
Hi team,

           Iam trying to use tranquility with druid cluster 

          cluster is working fine im able to get coordinate console......

          everything is connected properly not showing any errors....

        but the problem is when im trying to send data through traanqulity it always shows {recived:1,sent:0}
tranqulity not able to create any task

im sending with proper timestamp datetime.utcnow().strftime("%Y-%m-%dT%H:%M:%SZ") 

and when tranqulity response with {recived:1,sent:0} not producing any logs in tranqulity 
 
this is my server.json

},
        "ioConfig" : {
          "type" : "realtime"
        },
        "tuningConfig" : {
          "type" : "realtime",
          "maxRowsInMemory" : "100000",
          "intermediatePersistPeriod" : "PT10S",
          "windowPeriod" : "PT10S"
        }
      },
      "properties" : {
        "task.partitions" : "1",
        "task.replicants" : "1"
      }
    }
  },
  "properties" : {
    "zookeeper.connect" : "zookeeper.ip",
    "druid.discovery.curator.path" : "/druid/discovery",
    "druid.selectors.indexing.serviceName" : "druid/overlord",
    "http.port" : "8200",
    "http.threads" : "8"
  }


common.runtime.properties
druid.zk.service.host=zookeeper.ip
druid.zk.paths.base=/druid

druid.selectors.indexing.serviceName=druid/overlord
druid.selectors.coordinator.serviceName=druid/coordinator

overlord.runtime.properies
druid.service=druid/overlord
druid.port=8090

coordinate.runtime.properties

druid.service=druid/coordinator
druid.port=8081

im not getting where im doing wrong can anyone help me?

Sai Chandu

unread,
Apr 8, 2018, 5:22:08 AM4/8/18
to Druid Development
forget to tel im using zookeeper-3.4.10 , tranqulity-0.8.0  and druid-0.12

Sai Chandu

unread,
Apr 8, 2018, 8:35:39 AM4/8/18
to Druid Development
tasks are creating with status sucess still im unable to find datasource in webpage

getting this error from traquility

.m.tranquility.beam.ClusteredBeam - Emitting alert: [anomaly] Failed to propagate events: druid:overlord/spyagent
{
  "eventCount" : 1,
  "timestamp" : "2018-04-08T12:29:00.000Z",
  "beams" : "MergingPartitioningBeam(DruidBeam(interval = 2018-04-08T12:29:00.000Z/2018-04-08T12:30:00.000Z, partition = 0, tasks = [index_realtime_spyagent_2018-04-08T12:29:00.000Z_0_0/spyagent-029-0000-0000]))"
}
com.twitter.finagle.NoBrokersAvailableException: No hosts are available for disco!firehose:druid:overlord:spyagent-029-0000-0000, Dtab.base=[], Dtab.local=[]
        at com.twitter.finagle.NoStacktrace(Unknown Source) ~[na:na]


task_log

Gian Merlino

unread,
Apr 9, 2018, 2:17:05 PM4/9/18
to druid-de...@googlegroups.com
Hi Sai,

Try checking out the tips under "No data is showing up in Druid, even though events seem to be successfully sent" on https://github.com/druid-io/tranquility/blob/master/docs/trouble.md. In particular please double check the windowPeriod and message format.

Btw, this would have been a better question for the user list: druid...@googlegroups.com

Gian

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/40738c7f-fddb-441a-bf9c-de2bb73c2d43%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages