Compaction Task Error

[Pika Chu]

Hello everyone,

Could you help with me this error when we running compaction task on Druid Cluster?

"errorMsg": "org.apache.druid.java.util.common.IAE: Asked to add buffers[2,248,707,015] larger than configured max[2,147,483,647]"

Thanks

[John Kowtko]

Hi Picka Chu,  

This usually means the job is trying to create a single column within the segment that exceeds 2GB in size.  

Usually the easiest way to remediate this is to reduce maxRowsPerSegment, and build smaller segments to stay under that limit.

Let us know if that works for you.

Thanks.  John

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/druid-user/afae60b1-a05a-49d3-a5ff-11d45d088fd3n%40googlegroups.com.

--

John Kowtko

Senior Customer Architect

john....@imply.io