GRPC load balancing & connection pooling (golang)

[pa...@theorangechef.com]

I was wondering if anyone put together a solution for load balancing w/ connection pooling for grpc-go? Does anyone have a solution for this? Are there plans on adding this feature to the framework? If so, is there an ETA for this feature?

Thanks,

Paul

[Qi Zhao]

We are actively working on this. Some generic design doc will be published first. And the initial work should be done by the end of this quarter.

--
You received this message because you are subscribed to the Google Groups "grpc.io" group.
To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+u...@googlegroups.com.
To post to this group, send email to grp...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/1b7eb200-f812-4fa3-9730-7b978eb1e425%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[chao...@grabtaxi.com]

Is the design doc available some where now?

[Johan Jian An Sim]

Any update on this, Qi Zhao?

[Qi Zhao]

should be out this Quarter if everything is under plan.

--

You received this message because you are subscribed to the Google Groups "grpc.io" group.

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+unsubscribe@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/9f1d7095-e6b1-44b4-8937-cee94788d845%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[Johan Sim]

Great. Any plan to reveal some doc before the actual implementation? So that we know what is coming and be prepared.

On Fri, 15 Jan 2016 at 10:39 Qi Zhao <zh...@google.com> wrote:

should be out this Quarter if everything is under plan.

On Thu, Jan 14, 2016 at 6:04 PM, Johan Jian An Sim <joha...@gmail.com> wrote:

Any update on this, Qi Zhao?

On Wednesday, 28 October 2015 03:09:24 UTC+8, Paul Pietkiewicz wrote:

I was wondering if anyone put together a solution for load balancing w/ connection pooling for grpc-go? Does anyone have a solution for this? Are there plans on adding this feature to the framework? If so, is there an ETA for this feature?

Thanks,

Paul

--
You received this message because you are subscribed to the Google Groups "grpc.io" group.

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+u...@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/9f1d7095-e6b1-44b4-8937-cee94788d845%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[Qi Zhao]

Yeah, publishing some doc would be the first step. Let me poke around to set up a timeline. :)

On Thu, Jan 14, 2016 at 6:42 PM, Johan Sim <joha...@gmail.com> wrote:

Great. Any plan to reveal some doc before the actual implementation? So that we know what is coming and be prepared.

On Fri, 15 Jan 2016 at 10:39 Qi Zhao <zh...@google.com> wrote:

should be out this Quarter if everything is under plan.

On Thu, Jan 14, 2016 at 6:04 PM, Johan Jian An Sim <joha...@gmail.com> wrote:

Any update on this, Qi Zhao?

On Wednesday, 28 October 2015 03:09:24 UTC+8, Paul Pietkiewicz wrote:

I was wondering if anyone put together a solution for load balancing w/ connection pooling for grpc-go? Does anyone have a solution for this? Are there plans on adding this feature to the framework? If so, is there an ETA for this feature?

Thanks,

Paul

--
You received this message because you are subscribed to the Google Groups "grpc.io" group.

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+unsubscribe@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/9f1d7095-e6b1-44b4-8937-cee94788d845%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

--

Thanks,

-Qi

[Johan Jian An Sim]

Nice. Was digging a little bit through the API just to see if there is anything that I can do now for this issue. Seems like Picker (https://godoc.org/google.golang.org/grpc#Picker) was already in the codebase for quite long and seems to be part of the solution. However, just curious how far away are we from the actual implementation?

On Friday, 15 January 2016 10:44:40 UTC+8, Qi Zhao wrote:

Yeah, publishing some doc would be the first step. Let me poke around to set up a timeline. :)

On Thu, Jan 14, 2016 at 6:42 PM, Johan Sim <joha...@gmail.com> wrote:

Great. Any plan to reveal some doc before the actual implementation? So that we know what is coming and be prepared.

On Fri, 15 Jan 2016 at 10:39 Qi Zhao <zh...@google.com> wrote:

should be out this Quarter if everything is under plan.

On Thu, Jan 14, 2016 at 6:04 PM, Johan Jian An Sim <joha...@gmail.com> wrote:

Any update on this, Qi Zhao?

On Wednesday, 28 October 2015 03:09:24 UTC+8, Paul Pietkiewicz wrote:

I was wondering if anyone put together a solution for load balancing w/ connection pooling for grpc-go? Does anyone have a solution for this? Are there plans on adding this feature to the framework? If so, is there an ETA for this feature?

Thanks,

Paul

--
You received this message because you are subscribed to the Google Groups "grpc.io" group.

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+u...@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/9f1d7095-e6b1-44b4-8937-cee94788d845%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

--

Thanks,

-Qi

[Qi Zhao]

On Monday, January 18, 2016 at 4:52:51 PM UTC-8, Johan Jian An Sim wrote:

Nice. Was digging a little bit through the API just to see if there is anything that I can do now for this issue. Seems like Picker (https://godoc.org/google.golang.org/grpc#Picker) was already in the codebase for quite long and seems to be part of the solution. However, just curious how far away are we from the actual implementation?

Yup, Picker is for this purpose -- we will have a load-balance picker impl. 

[Qi Zhao]

David (cc-ed) will publish the designdoc of load balancing on behalf of grpc team.

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+unsubscribe@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/fbe62912-9c37-4763-9bb6-cb2df2255a53%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[Jeff Hodges]

Any ETA on that doc? Just curious, not furious, since it's been a week or so. 

Helping a project that wants to move to gRPC but the Picker interface's warning of it being experimental raised some eyebrows. Just want a story to give them is all. Thanks!

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/fbe62912-9c37-4763-9bb6-cb2df2255a53%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[Qi Zhao]

On Fri, Jan 29, 2016 at 5:23 PM, Jeff Hodges <je...@somethingsimilar.com> wrote:

Any ETA on that doc? Just curious, not furious, since it's been a week or so. 

dgq@, any updates? 

Helping a project that wants to move to gRPC but the Picker interface's warning of it being experimental raised some eyebrows. Just want a story to give them is all. Thanks!

Picker has had some implementations. Once I have the load balance picker ready, we will be confident the API works pretty well and remove the experimental annotations. 

To unsubscribe from this group and stop receiving emails from it, send an email to grpc-io+unsubscribe@googlegroups.com.

To post to this group, send email to grp...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/3dba5483-6a55-4df8-ad2c-3dedf9e4ed5e%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[David Garcia Quintas]

Hi everyone,

Sorry, the ownership of the document writing task hadn't been properly assigned. It does seem it's indeed on my plate :) I'll have it ready by the end of the week and will ping this thread. Please don't hesitate to ping again if necessary :)

To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/3dba5483-6a55-4df8-ad2c-3dedf9e4ed5e%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,

-Qi

[ran...@yikyakapp.com]

Is there an eta for this yet or any info on how best to use picker etc?

[Qi Zhao]

working on it right now. should be done this quarter.

--

Thanks,

-Qi

[David Garcia Quintas]

Here it is: https://github.com/grpc/grpc/blob/master/doc/load-balancing.md

[prot...@gmail.com]

For what it's worth, we put our servers behind a load balancer (eg haproxy/aws elb) and do layer 3 (TCP-level) load-balancing. I'm not entirely sure what's the benefit of having this be in gRPC itself.

[zel...@gmail.com]

grpc creates long-lived connections: are you just directing the initial connection when doing load balancing, or terminating TLS, parsing the streams, and load balancing all the individual calls sent over the connection?

[prot...@gmail.com]

For our use case we have multiple clients (>500) with few servers (<5), so we load-balance on the initial connection level. I can see how using haproxy etc. could be problematic for the opposite use case (<5 clients, >500 servers). 

[prot...@gmail.com]

Hi David,

What load-balancers will be compatible with gRPC? Eg. HAProxy, nginx?

Based on the doc, It looks like the LB responsible for pushing updates to the client.

1. What is the API for doing this?

2. I don't know if the popular LBs out there can push out to other services. Eg. HAProxy can send out emails when a server goes down, but that's about it.

I'd recommend at least a polling mechanism of some sort for getting the server list, since HAProxy already has the following Layer 4 REST APIs: https://www.haproxy.com/doc/aloha/7.0/api/webbased.html#l4-servers

On Friday, February 19, 2016 at 3:34:24 PM UTC-5, David Garcia Quintas wrote:

[stev...@gmail.com]

There has been more discussion on load balancing in https://github.com/grpc/grpc-go/issues/239#issuecomment-204073940. In general, I'm more focused on the client-side case, as that can have much better security properties. Specifically, there may be a case for per-rpc routing, in addition to client-side endpoint injection, avoiding the need for crossing a load balancer.

I'm not sure if this helps, but I hope these commentary can advance the discussion.