Has anyone faced error in ingestion for a particular Datasource Name?

[Abhishek Singh]

Hi

I am using druid ingestion spec for native batch ingestion which is working for all the datasource (160+) except for one particular Data Source Name. If i use different Data Source Name for the same backend (parquet files) druid is able to ingest, the Data Source Name i have checked is not a reserved keyword in druid, it is "fact_doctor_summary_denorm". Could anyone please help me with what might be causing a particular data source name to not be successfuly ingested.

Thanks & regards,
Abhishek
 

[John Kowtko]

Hi Abhishek, 

If it was streaming ingestion then I might look at the druid_datasources table in the Meta DB to see if there were old records for datasources with that name.   For batch it's possible there are druid_pendingSegments records.

There may be other tables in there that I am unaware of, so I suggest check the rest of the schema as well.

Let us know what you find.

Thanks.  John

[Peter Marshall]

Is this coming in from S3? I believe that underscores are not valid in bucket names.

[Abhishek Singh]

Hi John, 

I checked for the druid_pendingSegments, there were no records for the datasource, will check and update for the others metadata.

Thanks & Regards,

Abhishek

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/a1d28093-2a85-4c62-8489-8e13f5e41b01n%40googlegroups.com.

[Abhishek Singh]

Hi Peter,

It is connected to Azure. Have tried clearing the data source from deep storage but the same issue persists.

Thanks & Regards,

Abhishek

--

You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/9e385501-17a9-4576-9fb4-18dd1ae20925n%40googlegroups.com.