Load balance across the partitions

[sank...@gmail.com]

Hi All,

In one of the application we are using 32 partitions. Now we wanted to improve the application  by incrementing the number of partitions , But we see that load is not balanced across all the partitions. We have tried 35,33 partitions.

Please tell me how to balance the load across the partitions where number of partitions in not 2^N

[Sandesh Hegde]

If you are using Stateless partitioner & default stream codec, it uses Key based partitioning and hashcode of the tuple to decide the partition. One option is to use the custom stream codec and play with "getPartition", for more info on StreamCodec follow https://www.datatorrent.com/blog/get-know-streamcodecs/

Other option is to use the Custom partitioner and set the masks accordingly. You can watch this video for reference: https://www.youtube.com/watch?v=HCATB1zlLE4