Unable to load data using Multi Stage Query's HDFS option for parquet file.

20 views
Skip to first unread message

Laxmikant Pandhare

unread,
May 13, 2024, 4:57:59 PMMay 13
to Druid User
Hi All,

I am facing errors while trying to load data from HDFS using MSQ(multi-stage-query). Same HDFS option for normal data load is working for parquet file.

Error message is:
Error submitting task: druidException / Invalid value for the field [inputFormat]. Reason: [Please make sure to load all the necessary extensions and jars with type 'parquet' on 'druid/broker' service. Could not resolve type id 'parquet' as a subtype of `org.apache.druid.data.input.InputFormat` known type ids = [csv, json, kafka, regex, tsv] at [Source: (String)"{"type":"parquet"}"; line: 1, column: 9]]

Any help or suggestion here please.

Note - I already added below extensions in the LoadList
druid.extensions.loadList=["druid-hdfs-storage","druid-parquet-extensions"]

Thank You,
Laxmikant

Laxmikant Pandhare

unread,
May 14, 2024, 2:38:07 PMMay 14
to Druid User
Hi All, 

Any suggestions for the above issue please.

Thank You

Reply all
Reply to author
Forward
0 new messages