Envoy as a gRPC lookaside load balancer?

110 views
Skip to first unread message

to...@ulfsparre.se

unread,
Sep 11, 2017, 8:08:26 AM9/11/17
to envoy-users
Hi,
now with the Envoy v2 HDS it seems like Envoy could also used as a gRPC lookaside load balancer, if it implemented that API.
It would be a nice middle ground to deploying Envoy everywhere in a mesh. 

Is there any plans for that and what is your thoughts around that?

Harvey Tuch

unread,
Sep 11, 2017, 10:03:14 AM9/11/17
to to...@ulfsparre.se, envoy-users, abere...@google.com
The plan is to definitely add this support, but there is no concrete implementation in-flight today. +Anna Berenberg who is driving this.

--
You received this message because you are subscribed to the Google Groups "envoy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to envoy-users...@googlegroups.com.
To post to this group, send email to envoy...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/envoy-users/bc933854-9b62-4f60-951e-eecb299042b1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Anna Berenberg

unread,
Sep 11, 2017, 11:48:02 AM9/11/17
to Harvey Tuch, to...@ulfsparre.se, envoy-users
I would like to go a bit different way. I want grpc LB APIs change (v2) to become Envoy APIs. grpc LB team at Google is working on comparison of both - I believe there should not be any major differences as when I designed EDS, I was looking at gRPC LB APIs. 

if we have grpc LB protocol support v2 Envoy APIs (CDS, EDS), then Envoy would become a control plane proxy/stats aggregator for grpc LB traffic.  

Thoughts?
Anna

On Mon, Sep 11, 2017 at 7:03 AM, Harvey Tuch <ht...@google.com> wrote:
The plan is to definitely add this support, but there is no concrete implementation in-flight today. +Anna Berenberg who is driving this.

On Mon, Sep 11, 2017 at 8:08 AM <to...@ulfsparre.se> wrote:
Hi,
now with the Envoy v2 HDS it seems like Envoy could also used as a gRPC lookaside load balancer, if it implemented that API.
It would be a nice middle ground to deploying Envoy everywhere in a mesh. 

Is there any plans for that and what is your thoughts around that?

--
You received this message because you are subscribed to the Google Groups "envoy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to envoy-users+unsubscribe@googlegroups.com.

Matt Klein

unread,
Sep 11, 2017, 2:52:33 PM9/11/17
to Anna Berenberg, Harvey Tuch, to...@ulfsparre.se, envoy-users
Anna,

I agree it would be optimal if gRPC could support the v2 APIs. I would be happy to sync up with the gRPC team whenever on this.

One thing that I think is important is our combined messaging on when people should use gRPC lookaside LB vs. just using Envoy as the direct LB for the gRPC client. This might even be on a per-RPC basis depending on configuration. It probably depends on perf needs, feature set of the gRPC library in question, etc.

Matt 


For more options, visit https://groups.google.com/d/optout.



--
Matt Klein
Software Engineer
mkl...@lyft.com

Anna Berenberg

unread,
Sep 11, 2017, 4:28:07 PM9/11/17
to Matt Klein, Abhishek Kumar, Bill Clarke, Harvey Tuch, to...@ulfsparre.se, envoy-users
yes sounds good. We will do due diligence in API comparison and will call a meeting 

manilogic

unread,
May 29, 2023, 12:52:22 PM5/29/23
to envoy-users
Hi

Reviving this old mail thread. Do we have the capability in Envoy to act as a lookaside LB? Please provide any examples indicating API/configurations.

To be clear, what I am looking for is Envoy to provide a service like Get-Suitable-Upstream-Endpoint, which will take a URL/service name as an input parameter, pass that thru a set of configured routes/clusters, apply load balancing to pick an endpoint and return that endpoint details as the output.

Mani

On Tuesday, September 12, 2017 at 1:58:07 AM UTC+5:30 Anna Berenberg wrote:
yes sounds good. We will do due diligence in API comparison and will call a meeting 
On Mon, Sep 11, 2017 at 11:52 AM, Matt Klein <mkl...@lyft.com> wrote:
Anna,

I agree it would be optimal if gRPC could support the v2 APIs. I would be happy to sync up with the gRPC team whenever on this.

One thing that I think is important is our combined messaging on when people should use gRPC lookaside LB vs. just using Envoy as the direct LB for the gRPC client. This might even be on a per-RPC basis depending on configuration. It probably depends on perf needs, feature set of the gRPC library in question, etc.

Matt 
On Mon, Sep 11, 2017 at 8:47 AM, 'Anna Berenberg' via envoy-users <envoy...@googlegroups.com> wrote:
I would like to go a bit different way. I want grpc LB APIs change (v2) to become Envoy APIs. grpc LB team at Google is working on comparison of both - I believe there should not be any major differences as when I designed EDS, I was looking at gRPC LB APIs. 

if we have grpc LB protocol support v2 Envoy APIs (CDS, EDS), then Envoy would become a control plane proxy/stats aggregator for grpc LB traffic.  

Thoughts?
Anna
On Mon, Sep 11, 2017 at 7:03 AM, Harvey Tuch <ht...@google.com> wrote:
The plan is to definitely add this support, but there is no concrete implementation in-flight today. +Anna Berenberg who is driving this.

On Mon, Sep 11, 2017 at 8:08 AM <to...@ulfsparre.se> wrote:
Hi,
now with the Envoy v2 HDS it seems like Envoy could also used as a gRPC lookaside load balancer, if it implemented that API.
It would be a nice middle ground to deploying Envoy everywhere in a mesh. 

Is there any plans for that and what is your thoughts around that?

--
You received this message because you are subscribed to the Google Groups "envoy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to envoy-users...@googlegroups.com.

To post to this group, send email to envoy...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/envoy-users/bc933854-9b62-4f60-951e-eecb299042b1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "envoy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to envoy-users...@googlegroups.com.

To post to this group, send email to envoy...@googlegroups.com.

Yan Avlasov

unread,
May 31, 2023, 10:22:21 AM5/31/23
to manilogic, envoy-users
You can achieve this with a custom HTTP filter that sends local reply with the selected host. You can see router filter obtains the host: https://github.com/envoyproxy/envoy/blob/26797819a34cc4461d8cf2c0019463ab4d04509f/source/common/router/router.cc#L591

Reply all
Reply to author
Forward
0 new messages