Envoy HTTP Retry Stories

[djo...@squarespace.com]

Hello All,

I'm curious if there has been anything written or published in a talk about Envoy's HTTP retry capabilities at scale. I'm especially curious about the various retry conditions that are available and what others have learned with these at scale. 

For instance, when retrying on 5xx responses, has that caused a "thundering herd" scenario and has the community learned how to mitigate such scenarios?

Thank you for any pointers!

[Daniel Hochman]

The main way that we mitigate a thundering herd scenario is with the retry circuit breaker. It will locally constrain the maximum number of outstanding retries. See maximum active retries.

Some other interesting reading:

http://blog.christianposta.com/microservices/02-microservices-patterns-with-envoy-proxy-part-ii-timeouts-and-retries/

https://istio.io/docs/concepts/traffic-management/handling-failures/

Daniel Hochman

Engineer

--
You received this message because you are subscribed to the Google Groups "envoy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to envoy-users...@googlegroups.com.
To post to this group, send email to envoy...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/envoy-users/591eade3-6222-4a09-b1f3-6c6745c1cf02%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.