Joice Jacob
unread,Sep 9, 2025, 11:15:00 AM (10 days ago) Sep 9Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Nussknacker
Hi all,
I’m facing an issue with load distribution in my Flink setup.
- I have **2 TaskManagers** (TM1 and TM2).
- TM1: 5 slots
- TM2: 6 slots
- Total: 11 slots
- Kafka cluster: **2 brokers**
- I have configured the property `taskmanager.load-balance.mode`.
Observations:
- When the job parallelism is 5, the slots are divided, and during load testing, the load is distributed equally across both TaskManagers.
- When the job parallelism is 10, the slots are divided, and during load testing, the load is distributed equally across both TaskManagers.
- When the job parallelism is 8 (4 slots allocated to each TM), the load goes **only to one TaskManager** (either TM1 or TM2).
- I also tried changing the slot configuration to make it **10 slots total (5 per TM)** and also **8 slots total (4 per TM)**, but with parallelism 8, the same issue persists—load is directed only to one TaskManager.
Question:
Why is the load not being balanced across both TaskManagers when job parallelism is 8?
Is there any configuration I might be missing?
Thanks in advance for your help!