Load balancing in multi server setup with single client connections for multiple RPC calls

78 views
Skip to first unread message

Manjunath Shetty H

unread,
Dec 12, 2017, 11:21:39 AM12/12/17
to grpc.io
Hi All,

As per i understand it is good practice to use single gRPC connection for multiple concurrent RPC calls. So in my setup (kubernetes) , i have multiple instances of the server. When i create a connection using grpc client, it will go through the default k8s load balancer and it will be connected to one logical IP. So my question is if i am using a single client connection , all the rpc call will go to same server even though i have a load balancer and multiple instances of server ?

Is my understanding is correct ? Does gRPC provides out of the box per-call load balancing ?

Thanks, Any help is appreciated

David Garcia Quintas

unread,
Dec 13, 2017, 7:08:18 PM12/13/17
to grpc.io
Hi

Yes, please refer to this doc for details, but the simplest form of load balancing you can do on the client without needing to configure anything else is Round Robin. Which language are you working with?  

Manjunath Shetty H

unread,
Jan 2, 2018, 5:05:18 AM1/2/18
to grpc.io
Thanks for your reply. I am working with multiple languages ( JS, Java, Go )
Reply all
Reply to author
Forward
0 new messages