Using Caravel with Druid and features question

[Imtiaz Ahmed]

Hi,

We are evaluating Caravel for use with our Druid datasources. Can someone point me to some tutorials regarding Druid use with Caravel?

Also the main features we are using with pivot right not are:

1. Druid Namespace Lookups
2. Post Aggregations
3. Sketch Aggregations
4. Passing filters to dashboards as query parameters

Are these supported in some way in Caravel?

Thanks,

Imtiaz

[Maxime Beauchemin]

Hi,

1. Lookups are not currently supported but it's on the roadmap.

2. Post aggregations are supported as of very recently, it's in the master branch but didn't make it in the latest PyPI release yet (next release some time next week)

3. This should not be a problem from my understanding though I haven't tested them

4. Roadmap, that's easy to add, as for the "explore view" and "standalone" view you can construct your own filters in URLs easily

Ultimately we want to offer a window into everything that Druid has to offer. The development pace on Caravel is about to accelerate as we get more hands on the projects internally at Airbnb and as the community gets more incentives to get involved.

Max

[Imtiaz Ahmed]

Thanks for the info Max. Any estimated timeframe for lookups?

Also, can you give me an example of how to use custom aggregations. I can't find any documentation regarding that.

 

imtiaz

[Maxime Beauchemin]

In the metrics' expression field for your datasource you can put json as defined by Druid. If you check the SUM or count distinct in the columns tab, it will create metrics on your behalf (you may have to hit the datasource's save button for that to happen), you can then explore them and replicate the patterns.

No timeline for lookups, probably would be counted in weeks. It's open source, so people in the community may build it before we get to it. We typically do lookups at ingest time so it's not a top priority for us.

Max