Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add feature: export (quantize) from Llama2.c format #496

Open
hafezmg48 opened this issue Mar 8, 2024 · 0 comments
Open

add feature: export (quantize) from Llama2.c format #496

hafezmg48 opened this issue Mar 8, 2024 · 0 comments

Comments

@hafezmg48
Copy link

Thanks a lot for your educational and informative project. I tried quantizing the already provided tinystories llama2.c format .bin files using the export.py, but as far as I understood it was not supported. On the export.py file llama.c is mentioned as supported input but apparently it is not. Is it possible to add this feature?
I am relatively new to all this so please don't mind if my point was incorrect. thanks again.

@hafezmg48 hafezmg48 changed the title add feature: export (quantize) from llama.c format add feature: export (quantize) from Llama2.c format Mar 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant