Kafka emitter is emiting all matrices (Druid 25.0.0)

32 views
Skip to first unread message

Mrugesh Kadia

unread,
Feb 28, 2023, 3:00:08 AMFeb 28
to Druid User
Hi,

We are using Kafka ingestion to insert data into druid. our segment granularity is 1 hour. we are getting future events and late events. so, we are having multiple segments for 1 hour (some time 100)

We are using kafka-emitter for matrices.
below matrices are generated for each segments:
  1. query/wait/time
  2. query/segmentAndCache/time
  3. query/segment/time
I want to disable those matrices.

I changed `druid.monitoring.monitors` configuration. but it is but working.

I kept only one value in it.
druid.monitoring.monitors=["org.apache.druid.java.util.metrics.JvmCpuMonitor"]

still it is emitting all matrices. I tested druid.monitoring.monitors into both configuration files, `runtime.properties` and `common.runtime.properties`

Thanks,
Mrugesh Kadia


Mrugesh Kadia

unread,
Feb 28, 2023, 3:01:39 AMFeb 28
to Druid User
I changed `druid.monitoring.monitors` configuration. but it is but working.

but it is not but working

Sergio Ferragut

unread,
Mar 14, 2023, 11:34:45 AMMar 14
to Druid User
Query metrics are not configured through monitors, they are emitted when emission is turned on. 
But what emitter are you using? Some of the emitters have a whitelist of metrics to emit, like the graphite emitter here: https://druid.apache.org/docs/latest/development/extensions-contrib/graphite.html#white-list-based-converter 

Mrugesh Kadia

unread,
Mar 15, 2023, 2:48:38 AMMar 15
to Druid User
we are using kafka emitter. is there any way to filter/disable some metrics?

Sergio Ferragut

unread,
Mar 27, 2023, 9:27:51 PMMar 27
to Druid User
No. It does not seem to have that option.

Are you a java programmer?
It is an open source project and that sounds like something cool to add as an option to the extension.




Reply all
Reply to author
Forward
0 new messages