OGX, formerly Llama Stack, provides an open-source API layer for building agentic AI applications on user-controlled infrastructure.
It exposes OpenAI-compatible APIs for chat completions, Responses, vector stores, files, tools, and retrieval-augmented generation, while supporting multiple model and infrastructure backends.
OGX is relevant to the Kubeflow community because it gives platform teams and ML application builders a consistent application-facing API on top of Kubernetes-native AI infrastructure.
We'd love to see you there!
Meeting Notes: https://docs.google.com/document/d/1Wdxt1xedAj7qF_Rjmxy1R0NRdfv7UWs-r2PItewxHpE/edit?tab=t.0#heading=h.8lwsahr6psyn
Ref issue: https://github.com/kubeflow/community/issues/978