SME in IREE - status update

[Andrzej Warzyński]

Hello everyone,

We have reached a very important milestone for targeting Arm's Scalable Matrix Extension (SME) from IREE and I just wanted to share the good news with you :)

Basically, by passing `--iree-llvmcpu-target-cpu-features="+sve,+sme"` to iree-compile, you can compile a linalg.matmul Op to an SME binary. While there's no hardware available today (hopefully that will change soon), you can use an emulator to run it - it just works!  (*)

This is huge! While there's a lot of buzz around SME, it also presents some unique challenges when it comes to code generation  - two (!) "scalable" dimensions, virtual tile allocation, streaming mode enablement ... IREE and SME have always felt like a great match and now there's some runnable code to confirm that :)

Many thanks for all your support, engaging with our RFCs and all the code reviews!

Have a fantastic festive break,

- Andrzej
(on behalf of the Arm MLIR team)

(*) See e.g. https://qemu-project.gitlab.io/qemu/system/arm/cpu-features.html. Feel free to ping me if you'd like more help.

[Stella Laurenzo]

Wow, this is great! Thanks for sharing Andrzej! I of course saw all of the patches coming, but didn't have a clear picture how far we were from the finish line!

I love seeing ambitious technical projects bare fruit. Congratulations on the milestone. Let us know if there is any way we can smooth paths for you all.

As an aside, another team from arm got the aarch64 release build going and we just pushed our first wheels to pypi last week (and will keep doing so monthly). Now all we need is that pesky hardware :) I'm looking forward to seeing what this does when it gets out the door.

--
You received this message because you are subscribed to the Google Groups "iree-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to iree-discuss...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/iree-discuss/9df39605-8772-4d16-b03c-1241750fa324n%40googlegroups.com.

[Jacques Pienaar]

This is great news, thanks for update!

-- Jacques 

(A CI to help track some performance smoke tests would probably have been next on my wish list 😉)

To view this discussion on the web visit https://groups.google.com/d/msgid/iree-discuss/CAH8pnHbjyiwL1hRmbb%3D6%2BUDzZoCJbP_N0KZ3zf9Uz1GdJLrMNg%40mail.gmail.com.

[Diego Caballero]

Joining late to the party but I didn't want to miss the opportunity to congratulate ARM for the fantastic work done here both on IREE and MLIR! Thanks for bearing with me during the review process and discussions!

Diego

To view this discussion on the web visit https://groups.google.com/d/msgid/iree-discuss/CAM4W%2BYfp-2mFF_nFioA7RV8syrwHYRkXFX1kDEMD5-%2BurQBU%2BQ%40mail.gmail.com.