Issue with Uneven Load Distribution Across TaskManagers in Flink

6 views
Skip to first unread message

Joice Jacob

unread,
Sep 9, 2025, 11:15:00 AM (10 days ago) Sep 9
to Nussknacker
Hi all,  

I’m facing an issue with load distribution in my Flink setup.  

- I have **2 TaskManagers** (TM1 and TM2).  
  - TM1: 5 slots  
  - TM2: 6 slots  
  - Total: 11 slots  
- Kafka cluster: **2 brokers**  
- I have configured the property `taskmanager.load-balance.mode`.  

Observations:
- When the job parallelism is 5, the slots are divided, and during load testing, the load is distributed equally across both TaskManagers.
- When the job parallelism is 10, the slots are divided, and during load testing, the load is distributed equally across both TaskManagers.  
- When the job parallelism is 8 (4 slots allocated to each TM), the load goes **only to one TaskManager** (either TM1 or TM2).  
- I also tried changing the slot configuration to make it **10 slots total (5 per TM)** and also **8 slots total (4 per TM)**, but with parallelism 8, the same issue persists—load is directed only to one TaskManager.  

Question:
Why is the load not being balanced across both TaskManagers when job parallelism is 8?  
Is there any configuration I might be missing?  

Thanks in advance for your help!
Reply all
Reply to author
Forward
0 new messages