0.9.2 groupby v2 can't merge result

Zhenyuan Gao

unread,

Jan 1, 2017, 1:48:47 AM1/1/17

to Druid User

Hi, I have update druid to 0.9.2 and config broker and historical with druid.processing.numMergeBuffers=2.

When I try groupByStrategy = v2, I found that result can't merge and groupByStrategy = v1 is work well.Could somebody help me? Thanks.

here is problem:

v1:

{
   "queryType":"groupBy",
   "dataSource":"attribution_model_v1_test",
   "granularity":"all",
   "dimensions":["source_type"],
   "aggregations":[
      {
         "type":"count",
         "name":"count"
      }
   ],
   "intervals":["2016-12-01T00:00:00+08:00/2017-01-01T00:00:00+08:00"],
   "context": {"groupByStrategy": "v1"}
}

result:

[ {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 32,
    "source_type" : "0"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 36,
    "source_type" : "1"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 24,
    "source_type" : "2"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 81,
    "source_type" : "3"
  }]

v2:

{
   "queryType":"groupBy",
   "dataSource":"attribution_model_v1_test",
   "granularity":"all",
   "dimensions":["source_type"],
   "aggregations":[
      {
         "type":"count",
         "name":"count"
      }
   ],
   "intervals":["2016-12-01T00:00:00+08:00/2017-01-01T00:00:00+08:00"],
   "context": {"groupByStrategy": "v2"}
}

result:

[ {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 28,
    "source_type" : "0"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 30,
    "source_type" : "1"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 24,
    "source_type" : "2"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 66,
    "source_type" : "3"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 1,
    "source_type" : "0"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 4,
    "source_type" : "3"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 3,
    "source_type" : "1"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 11,
    "source_type" : "3"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 3,
    "source_type" : "0"
  }
}, {
  "version" : "v1",
  "timestamp" : "2016-11-30T16:00:00.000Z",
  "event" : {
    "count" : 3,
    "source_type" : "1"
  }]

Zhenyuan Gao

unread,

Jan 2, 2017, 7:18:21 AM1/2/17

to Druid User

Is someone meet the same problem ?

在 2017年1月1日星期日 UTC+8下午2:48:47，Zhenyuan Gao写道：

Gian Merlino

unread,

Jan 2, 2017, 11:58:28 AM1/2/17

to druid...@googlegroups.com

Hey Zhenyuan,

Are you sure that all your brokers and data nodes (historical, middleManager, realtime) are running 0.9.2? And are you sending these queries to the broker?

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/26a614e3-7033-42c8-a798-17e8afb9a95d%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Zhenyuan Gao

unread,

Jan 2, 2017, 9:42:16 PM1/2/17

to Druid User

Oh, thanks. May be it has route to 0.9.1 nodes and cache the groupby results.I change the config and restart 0.9.2 nodes it works well.

在 2017年1月3日星期二 UTC+8上午12:58:28，Gian Merlino写道：

Gian

To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

Zhenyuan Gao

unread,

Jan 2, 2017, 10:06:08 PM1/2/17

to Druid User

BTW, update to 0.9.2 I meet compatibility problems (index task with hadoop), so I compiled the druid 0.9.2 with guice 3.0 (not 4.10). I want to know does guice with version 3.0 will bring some potential problems?

在 2017年1月3日星期二 UTC+8上午12:58:28，Gian Merlino写道：

Hey Zhenyuan,

Gian

To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

Gian Merlino

unread,

Jan 3, 2017, 1:55:16 PM1/3/17

to druid...@googlegroups.com

If it starts up okay for you, then it's probably fine… Guice is only used during startup.

Also take a look at http://druid.io/docs/latest/operations/other-hadoop.html for Hadoop compatibility problems. It has some tips that have worked for a lot of cases.

Gian

To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/14dd6b4d-6e45-4389-b622-69de3aba103a%40googlegroups.com.

Reply all

Reply to author

Forward