Druid 0.12.0 release

266 views
Skip to first unread message

Jonathan Wei

unread,
Mar 8, 2018, 10:11:56 PM3/8/18
to druid...@googlegroups.com, druid-de...@googlegroups.com
We're excited to announce our latest release, Druid 0.12.0!

Druid 0.12.0 contains over a hundred performance improvements, stability improvements, and bug fixes from almost 40 contributors. This release adds major improvements to the Kafka indexing service.

Other major new features include:
- Prioritized task locking
- Improved automatic segment management
- Test stats post-aggregators
- Numeric quantiles sketch aggregator
- Basic auth extension
- Query request queuing improvements
- Parse batch support
- Various performance improvements
- Various improvements to Druid SQL

You can download the release here: http://druid.io/downloads.html


Documentation for this release is at: http://druid.io/docs/0.12.0/

Thanks to everyone who contributed!

Gian Merlino

unread,
Mar 9, 2018, 5:13:09 PM3/9/18
to druid...@googlegroups.com, druid-de...@googlegroups.com
Thanks Jon and everyone else who was a part of this release!

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/CAG0p_PE7j25nrg%2BNfx2d2af%3Dt08eVJOfLBVwd%2Bz%2B%3DwWXixjjsA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

shang...@bytedance.com

unread,
Mar 10, 2018, 10:57:22 PM3/10/18
to Druid Development
Hi, team:
I have a question, can I use druid-kafka-indexing-service in product? Is it production ready? 

在 2018年3月9日星期五 UTC+8上午11:11:56,Jonathan Wei写道:

Gian Merlino

unread,
Mar 13, 2018, 1:37:09 AM3/13/18
to druid-de...@googlegroups.com
There are plenty of people using it in production. It's still a relatively young feature but it is growing up quickly. I would say go for it.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/8d4d00f5-0802-4ab2-9441-4bdac281f31c%40googlegroups.com.

Sai Chandu

unread,
Mar 15, 2018, 7:31:55 AM3/15/18
to Druid Development
hi Jonathan,
       i enable basic-auth extension in druid it working really great, and running in cluster working fine..... problem is when im try to sned data with TRANQUILITY it shows error 
     Node:1
         -historical
         -middlemanagers
         -zookeeper
    Node:2
         -cordinate
         -overload
         -broker
         -tranquility

Note:- While posting data with Tranqulity im passing druid username and password too still it showing 401 unauthorized

where im doing worng can u please help me?

Tranquility Error:-

[finagle/netty3-1] ERROR com.metamx.common.scala.control$ - Non-retryable response for uri[/druid/indexer/v1/task] with conten
t: {"error":"Unauthorized request.","errorMessage":null,"errorClass":null,"host":"localhost"}
2018-03-15 11:11:53,198 [ClusteredBeam-ZkFuturePool-b4ff6652-c5ad-480a-9203-b3b146ac630f] ERROR c.m.tranquility.beam.ClusteredBeam - Failed to update 
cluster state: druid:overlord/spyagent
com.metamx.tranquility.druid.IndexServicePermanentException: Service[druid:overlord] call failed with status: 401 Unauthorized
        at com.metamx.tranquility.druid.IndexService$$anonfun$call$1$$anonfun$apply$17.apply(IndexService.scala:158) ~[io.druid.tranquility-core-0.8.0
.jar:0.8.0]
        at com.metamx.tranquility.druid.IndexService$$anonfun$call$1$$anonfun$apply$17.apply(IndexService.scala:132) ~[io.druid.tranquility-core-0.8.0
.jar:0.8.0]
        at com.twitter.util.Future$$anonfun$map$1$$anonfun$apply$6.apply(Future.scala:950) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Try$.apply(Try.scala:13) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Future$.apply(Future.scala:97) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Future$$anonfun$map$1.apply(Future.scala:950) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Future$$anonfun$map$1.apply(Future.scala:949) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Promise$Transformer.liftedTree1$1(Promise.scala:112) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Promise$Transformer.k(Promise.scala:112) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Promise$Transformer.apply(Promise.scala:122) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
        at com.twitter.util.Promise$Transformer.apply(Promise.scala:103) ~[com.twitter.util-core_2.11-6.30.0.jar:6.30.0]
this is my server.conf

"ioConfig" : {
          "type" : "realtime"
        },
        "tuningConfig" : {
          "type" : "realtime",
          "maxRowsInMemory" : "1000000",
          "intermediatePersistPeriod" : "PT10S",
          "windowPeriod" : "PT10S"
        }
      },
      "properties" : {
        "task.partitions" : "1",
        "task.replicants" : "1",
        "druidBeam.firehoseGracePeriod": "PT10S"
      }
    }
  },
  "properties" : {
    "zookeeper.connect" : "192.168.207.14",
    "druid.discovery.curator.path" : "/druid/discovery",
    "druid.selectors.indexing.serviceName" : "druid/overlord",
    "http.port" : "8200",
    "http.threads" : "9"
  }

Jonathan Wei

unread,
Mar 15, 2018, 4:57:13 PM3/15/18
to druid-de...@googlegroups.com
Hi Sai,

I don't think Tranquility was updated to support basic auth, so you'll have to disable auth for now if you wish to use Tranquility.

Thanks,
Jon

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.

Sohel Sarder

unread,
Apr 22, 2018, 2:06:46 AM4/22/18
to Druid Development
Hi Team,

Thanks for great work and improvements, I was trying to use druid version 0.12.0 and using extension kafka indexing services for loading data from kafka stream into druid. But this is not working for me. Here is the details of the issue can you please have a look into this. 


Thanks,
Sohel 
Reply all
Reply to author
Forward
0 new messages