[RFC] Shardy:MPMD – an ergonomic and performant MLIR-based MPMD partitioning system

[Joel Wee]

Hi everyone,

We've just published an RFC on Shardy:MPMD, and would love comments.

RFC: https://github.com/openxla/shardy/blob/main/rfcs/2025-06-18-mpmd-rfc.md

Highlights from the RFC and colab:

• Shardy:MPMD is an MPMD partitioning system, aimed at enabling ergonomic and performant MPMD-partitioning while retaining single-device programming semantics.
  
• It comes with an experimental JAX API which compiles to a bunch of XLA programs, orchestrated by Pathways on Cloud.
  
  • See this read-only colab for an example with different pipeline schedules applied: https://github.com/openxla/shardy/blob/main/rfcs/2025-06-18-mpmd-rfc-read-only-colab.ipynb (not runnable yet, as we're working on releasing it).

Feel free to comment on https://github.com/openxla/shardy/issues/586 or the PR https://github.com/openxla/shardy/pull/583.

Let us know what you think! 

Best,

Joel

[Talaq alotaibi]

🪱🎓

source program

--
You received this message because you are subscribed to the Google Groups "OpenXLA Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openxla-discu...@openxla.org.
To view this discussion visit https://groups.google.com/a/openxla.org/d/msgid/openxla-discuss/45744ca8-3c02-4602-8b65-9ca55abbdc97n%40openxla.org.
For more options, visit https://groups.google.com/a/openxla.org/d/optout.