Document shared with you: "[PUBLIC] Kubernetes LLM Inference Autoscaling Examples"

[Clayton Coleman (via Google Docs)]

Clayton Coleman shared a document Clayton Coleman (clayton...@google.com) has invited you to edit the following document: As discussed a few weeks ago, sharing my autoscaling LLM workloads exploration with wg-serving. This covers most of the use cases I'm aware of where we would want Kubernetes to improve (in combination with observability / custom autoscalers / model servers). [PUBLIC] Kubernetes LLM Inference Autoscaling Examples Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA 94043, USA You have received this email because clayton...@google.com shared a document with you from Google Docs.