Validate My Idea Please

[Surya]

After studying on the Agentic Sandbox , i had a question : 
 if we just simply use a Single Dockerized Container and expose an API endpoint to it , whenever a new request just hits the endpoint , it would run it in a sub-process of the docker container. 

by this - instead of spinning of multiple containers for each new requests , we can have a warmed pool of stationary containers connected to a load balancer which can run the process in any container and get the result.

talking about the control over the bare metal , we can use Kubernetes to orchestrate it.

please acknowledge me with the correctness & incorrectness of my idea !!!

Thanks,
Surya 

[Janet Kuo]

Hi Surya, 

Thanks for sharing your idea! Your proposal to use a warm pool of containers to avoid spinning up new containers for every request is a valid approach for improving latency. The agent-sandbox project implements a similar concept: the warmpool feature (part of extensions) for fast sandbox creation.

Please take a look at the examples here: https://github.com/kubernetes-sigs/agent-sandbox/tree/main/extensions/examples and let us know if you have any questions!

●●●●

Janet Kuo

--
You received this message because you are subscribed to the Google Groups "sig-apps" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sig-apps+u...@kubernetes.io.
To view this discussion visit https://groups.google.com/a/kubernetes.io/d/msgid/sig-apps/62c0e6de-3fdb-4e5f-9319-3fef91c233bcn%40kubernetes.io.