Hi Loki, want to contribute to on-device AI

[Sam Moustachir]

Hi Loki

I came across your profile and given your recent contributions, I think you might be interested in what my team and I are building. We're working on an open source Rust SDK that runs LLMs (as well as voice and vision) directly on-device. We're hitting ~40 tok/s on iPhones and Android, with bindings for Swift, Kotlin, Flutter and Unity.

If you're curious, here's the repo: https://github.com/xybrid-ai/xybrid

We're actively looking for contributors, so if on-device inference would be useful for anything you're building, happy to give you early access to the full toolkit.

Best,

Sam 

[Lil Don]

I would love that 

To unsubscribe from this group and stop receiving emails from it, send an email to dev+uns...@lance.org.