Kafka emitter is emiting all matrices (Druid 25.0.0)

39 views
Skip to first unread message

Mrugesh Kadia

unread,
Feb 28, 2023, 3:00:08 AM2/28/23
to Druid User
Hi,

We are using Kafka ingestion to insert data into druid. our segment granularity is 1 hour. we are getting future events and late events. so, we are having multiple segments for 1 hour (some time 100)

We are using kafka-emitter for matrices.
below matrices are generated for each segments:
  1. query/wait/time
  2. query/segmentAndCache/time
  3. query/segment/time
I want to disable those matrices.

I changed `druid.monitoring.monitors` configuration. but it is but working.

I kept only one value in it.
druid.monitoring.monitors=["org.apache.druid.java.util.metrics.JvmCpuMonitor"]

still it is emitting all matrices. I tested druid.monitoring.monitors into both configuration files, `runtime.properties` and `common.runtime.properties`

Thanks,
Mrugesh Kadia


Mrugesh Kadia

unread,
Feb 28, 2023, 3:01:39 AM2/28/23
to Druid User
I changed `druid.monitoring.monitors` configuration. but it is but working.

but it is not but working

Sergio Ferragut

unread,
Mar 14, 2023, 11:34:45 AM3/14/23
to Druid User
Query metrics are not configured through monitors, they are emitted when emission is turned on. 
But what emitter are you using? Some of the emitters have a whitelist of metrics to emit, like the graphite emitter here: https://druid.apache.org/docs/latest/development/extensions-contrib/graphite.html#white-list-based-converter 

Mrugesh Kadia

unread,
Mar 15, 2023, 2:48:38 AM3/15/23
to Druid User
we are using kafka emitter. is there any way to filter/disable some metrics?

Sergio Ferragut

unread,
Mar 27, 2023, 9:27:51 PM3/27/23
to Druid User
No. It does not seem to have that option.

Are you a java programmer?
It is an open source project and that sounds like something cool to add as an option to the extension.




Reply all
Reply to author
Forward
0 new messages