Groups keyboard shortcuts have been updated
Dismiss
See shortcuts

[ANNOUNCE] LeaderWorkerSet v0.4.0 Released!

7 views
Skip to first unread message

Rupeng Liu

unread,
Sep 14, 2024, 8:42:55 AM9/14/24
to wg-b...@kubernetes.io, kubernete...@googlegroups.com, kubernetes-s...@googlegroups.com
Hi everyone,

We just released Leaderworkerset v0.4.0! 
You could check the release here: Link. It is the release which included the below features:
  • Support specifying NetworkConfig 
  • Support leader elect for lws controller
  • Add group size as a container environment variable
  • Add an example for using llama.cpp to deploy a distributed inference service
  • Update the GPU multi-node inference using vLLM guide to serve Llama3.1-405b model
Thanks to everyone who worked on the repository for the release. Feel free to experiment or contribute to the repository: Link
Best regards
Rupeng Liu on behalf of the LeaderWorkerSet developers
Reply all
Reply to author
Forward
0 new messages