Multi-backend support: Apple Silicon / Mac (call for contributors + help fleshing out the details)

[Titus-von-Koeller]

Apple Silicon support is planned between Q4/2024 - Q2/2025: We're actively looking for contributors to implement this and help us flesh out a concrete plan as well as detailed list of requirements to fulfill by anyone interested in implementing a part.

We don't have enough resources to do this work ourselves, so we're dependent on community contributions.

Please introduce yourselves, which skills you bring to the table, which things you foresee need doing and feel free to constructively comment on each other. Let's see where things evolve from there!

---

If you're interested to work on this full-time leading the implementation (with mentoring) and enabling the community on this topic: Most likely, we'll soon have limited funding for this through the Mozilla foundation), please contact us by tagging @Titus-von-Koeller and @matthewdouglas in a Github discussion on our repo. This also applies if funding is no incentive for you, we're a community project!

Let's see from there, better to contact us even if you're unsure and we see if there's a way that works for everyone.

[markuskreitzer]

I'm happy to help!

[neal3000]

I might be able to help, depending on what kind of skills you need.

[WenheLI]

Happy to help! Want to see some detailed plans!

[bghira]

see the torchao repo for examples of 4bit/8bit MPS kernels