List pending queries

[Adam Lloyd]

Hi all,

I am looking for a way to list any pending/running queries inside Druid. It seems that there may have been a way in the past (segment/scan/pending) but this looks to be old info as the endpoint is no longer listed i the API docs. 

Is there any way to do this currently?

Thanks,

A

[Itai Yaffe]

Hey Adam,

I believe you are referring to this thread (https://groups.google.com/g/druid-user/c/zuWn83moIIU) w.r.t segment/scan/pending, but in fact, this is a metric Druid emits (either from Historicals or real-time tasks), that shows the number of segments waiting to be scanned (in order to serve queries), see https://druid.apache.org/docs/latest/operations/metrics.html#historical and https://druid.apache.org/docs/latest/operations/metrics.html#real-time.

There is a way to see the number of queries that were executed/succeeded/failed/interrupted, if you include the QueryCountStatsMonitor (see https://druid.apache.org/docs/latest/operations/metrics.html#historical).

TBH, I'm not sure if there's a way to list the queries that are currently running.

      Itai

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/ee9c3c42-7237-40d1-a509-d07558da4ae1n%40googlegroups.com.

[Adam Lloyd]

Hi Itai,

Thanks for taking the time to reply.

That makes alot of sense. I think the QueryCountStatsmonitor may be something for me to try but I suspect it might not have the info I need. I'm basically trying to check that the correct queryId is being attached to the queries such that they can be cancelled using DELETE/:queryId. This is an issue because that endpoint returns 202 regardless of a valid query ID so, for all I know its doing nothing if the correct query IDs are not being associated with the quereies.

Adam

[Itai Yaffe]

I see.

So there are 2 partial solutions I can think of:

1. You can set the query ID yourself, on the query context ("sqlQueryId" for SQL queries, and perhaps "queryId" for native queries). That way, you know the query ID to use for the DELETE API.
2. I saw this (rather old) answer from Gian, saying that you can set a timeout on the query context, to cancel long queries (https://www.druidforum.org/t/how-to-use-query-cancellation/690).

Anyway, let's see if anyone else has a better answer for you.

Good luck, I hope you'll find what you need 🙂

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/e2bd0750-08d4-4828-890b-7943407dc3fbn%40googlegroups.com.

[Adam Lloyd]

I am setting the query ID on the query context (i think) but i'd like to know for sure if the code is useless or not that's cancelling it. 

Thanks again for all the input Itai