Reques failed with status code 500

[Gonçalo Fontes]

Hello, I am running a pipeline with Kafka - Druid - Superset and my Druid keeps getting the error "Request failed with status 500". Running the "Druid Doctor" I get the following error. 

[Guillaume Lhermenier]

Hi, 

Obvious question : 

Is druid.sql.enable set to true in your brokers configs ? 

Le jeu. 25 nov. 2021 à 12:29, Gonçalo Fontes <goncalosi...@gmail.com> a écrit :

Hello, I am running a pipeline with Kafka - Druid - Superset and my Druid keeps getting the error "Request failed with status 500". Running the "Druid Doctor" I get the following error. 

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/4dc74bc2-a26e-4eb2-b511-d44818f92cf2n%40googlegroups.com.

[Gonçalo Fontes]

Yes, i set druid.sql.enable=true in my env file, although I keep getting the error

[Guillaume Lhermenier]

Your cluster is running and datasource are created properly after Kafka ingestion, right ? 

Are you able to query the data through Druid UI ? 

If so, could you post your broker(s) logs after the Superset attempt ? 

 

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/fbdc4249-86b0-4fc6-b065-bbce62ead72cn%40googlegroups.com.

--

Guillaume

[alexander...@gmail.com]

Hi,

did you find a solution for this problem? After updating Druid to 0.21.1 we are running into exactly the same problem from time to time.
Our pipeline is similar ==> Kafka -> Druid -> Superset.
At some point (after Druid is running a few weeks) it is no longer possible to query Druid, also not from Druid UI.
The only solution is to restart the Broker. Druid Doctor shows the same error/information as the picture above and in the log file I find a lot of warnings:


2022-11-23T11:51:29,212 WARN [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Metadata refresh failed, trying again soon.
2022-11-23T11:51:40,920 WARN [sql[fe6ea269-7230-49d5-9526-d4d891f501b7]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [48a7516b-b5bc-460f-a2ed-4b1f6ea93a6d] (org.apache.druid.query.QueryTimeoutException: Sequence iterator timed out waiting for data)
2022-11-23T11:52:40,948 WARN [sql[66fc4266-e234-4847-850f-21d805ecfca9]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [77bbf87e-539f-4734-9d54-a9029a14a36a] (org.apache.druid.query.QueryTimeoutException: Sequence iterator timed out waiting for data)
2022-11-23T11:53:44,232 WARN [DruidSchema-Cache-0] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [af4ad2dd-b7ce-4e6a-81e6-a624e7aff613] (org.apache.druid.query.QueryTimeoutException: Sequence iterator timed out waiting for data)
2022-11-23T11:53:44,232 WARN [DruidSchema-Cache-0] org.apache.druid.sql.calcite.schema.DruidSchema - Metadata refresh failed, trying again soon.
2022-11-23T11:53:44,484 WARN [sql[f9623325-271f-4458-b201-6b3ed442d8e2]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [6d5274a5-1b39-459c-9cc6-bb553fd59b99] (org.apache.druid.query.QueryTimeoutException: Sequence iterator timed out waiting for data)
2022-11-23T11:53:44,488 WARN [sql[a7bca8bb-2dbc-4549-8f35-8ca4b7505739]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [20671bb8-f8c1-437b-9f63-f9bc79f64350] (org.apache.druid.query.QueryTimeoutException: Sequence iterator timed out waiting for data)

Druid is running with Kafka ingestion (supervisors) since several years without any problems...until out latest update.

regards,
Alex

[Paul Drage]

Following.