A tutorial for windows user install bitsandbytes and triton

[Titus-von-Koeller]

Scoodtone commented 3 days ago
Feature request
I, a Chinese developer, writed this tutorial to help others who use windows system and felt difficult to use install bitsandbytes and triton without linux virtual machine.

Motivation
It's not completely a new feature, but i can't find a zone to submit my tutorial. I sincerely wish that my tutorial can be helpful to somebody.

Your contribution
just a link to tutorial, so not completely a feature request and no need to submit contribution, haha.
I am sorry to submit this as 'feature request', but i sincerely wish someone can reply to me.
The link based GitHub Pages, it is:
https://scoodtone.github.io/2024/02/23/laptop3060-win11-4bit-7B-opensourceLLM-InternLM/

Hey @Scoodtone,

Thanks for submitting your tutorial for others to find and be useful to them! A good place for this would be

@younesbelkada What do you think about this? Can we add this tutorial or part of it somewhere? Are we aiming to provide docs in Chinese or can we just supply this as a single link. I wouldn't know where.

If we want to provide this or part of it as an official tutorial, we would have to make sure it's up to date with the Windows-related improvements @wkpark has made and we would have to have someone review it in Chinese.

[Titus-von-Koeller]

@scoodtone Just checking in, as we released official Windows support three weeks ago. I guess that changes things a bit.

What's your view, is a tutorial still needed and what should be exactly written in it? I'd be open to modify the existing docs or add a tutorial somewhere, also in English of course. But I'd be super happy to add a Chinese version as well. Maybe that's the first language other than English that we should support for BNB anyways..

Let me know what you think.