Skipping Empty Buckets feature

161 views
Skip to first unread message

Suhas

unread,
Apr 3, 2018, 7:36:12 AM4/3/18
to Druid Development
This is straight from the docs,
 
<GroupBy Example>
Note that all the empty buckets are discarded.

This could actually be a good thing. I think there should an option in context whether or not to skip empty buckets even in the group by queries. Personally, I found myself in situations where many queries I wanted to group by some dimensions and have a day's granularity, should've included all buckets in the result. I don't see why this is a bad idea?

Gian Merlino

unread,
Apr 3, 2018, 2:49:11 PM4/3/18
to druid-de...@googlegroups.com, d...@druid.apache.org
Hi Suhas,

How would you expect the results to come back if groupBy did _not_ skip empty time buckets, and one day was empty? Should all the dimensions be null?

Btw, since we are migrating the dev mailing list to Apache, please cross post this sort of thing with d...@druid.apache.org, or even only post to that list.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-development+unsubscribe@googlegroups.com.
To post to this group, send email to druid-development@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/12b81b6f-38f4-4725-9482-3acd1993ce85%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Suhas Sumukh V

unread,
Apr 12, 2018, 8:56:54 AM4/12/18
to druid-de...@googlegroups.com, d...@druid.apache.org
Good thing you asked, Gian. I don't expect it to traverse all buckets and find all groups, and set those group values to zero or null in every bucket. I know such a thing would destroy Druid's performance. I just want it to return null for the dimension and 0 for metrics, for that day.

{u'event': {u'metric1': 0,
            u'metric2': 0,
            u'dim': null},
            u'timestamp': u'2018-04-05T00:00:00.000Z',
            u'version': u'v1'}

--
Suhas

--
You received this message because you are subscribed to a topic in the Google Groups "Druid Development" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-development/VNMg8HKYVio/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-development+unsubscribe@googlegroups.com.

To post to this group, send email to druid-development@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages