Configuring num.io.threads, num.replica.fetchers and num.network.threads depending on the number of CPU cores

58 views
Skip to first unread message

Alex D

unread,
Oct 9, 2019, 4:40:10 AM10/9/19
to Confluent Platform
Hello everyone,

Are there any best practices to configure num.io.threads, num.replica.fetchers and num.network.threads depending on the number of CPU cores?
I've seen some configuring them using this formula:

num.io.threads(=CPU cores * 8/(3+8+1)) + num.replica.fetchers(=CPU cores * 1/(3+8+1)) + num.network.threads(=CPU cores * 3/(3+8+1)) = CPU cores
 
Example:
 CPU cores = 56
 num.io.threads(=56 * 8/(3+8+1)) + num.replica.fetchers(=56 * 1/(3+8+1)) + num.network.threads(=56 * 3/(3+8+1)) = 56
 where
   num.io.threads = 56 * 8/(3+8+1) = 37
   num.replica.fetchers=56 * 1/(3+8+1) = 5
   num.network.threads=56 * 3/(3+8+1) = 14
Reply all
Reply to author
Forward
0 new messages