Druid Not Enough Buffer Capacity

Posted by ChenRiang on October 10, 2021

When running a groupby query with huge aggregation process and follow by sub select query in SQL, I bump into following exception

Not enough capacity for even one row! Need[xx] but have[0]

Solution

Configure broker node with higher buffer size and number mergeBuffer will solve the exception.

1
2
druid.processing.buffer.sizeBytes=500MiB
druid.processing.numMergeBuffers=4