Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker slim image CPU only #24

Open
MoonDragon-MD opened this issue Jan 28, 2025 · 3 comments
Open

Docker slim image CPU only #24

MoonDragon-MD opened this issue Jan 28, 2025 · 3 comments

Comments

@MoonDragon-MD
Copy link

MoonDragon-MD commented Jan 28, 2025

Hi I managed to create a lightweight (CPU only) and performant image without errors,
I attach the files to replace (just change the txt to zip).

nllb_serve-CPU.txt

Then give from cmd:


docker build -t nllb-serve-cpu .
docker run -p 6060:6060 --name nllb-cpu-trad nllb-serve-cpu

You will see that it will create an image of only 1.62 GB (vs. 8.59 GB of the normal one with GPU+CPU)

I hope it can be useful for someone!
Greetings

@thammegowda
Copy link
Owner

Hi @MoonDragon-MD Thats very useful. Well done!
Could you please send pull request with Dockerfile added to this repo along with README updates
Thanks

@thammegowda
Copy link
Owner

Also, we can add link to your Firefox extension #25 in README

@MoonDragon-MD
Copy link
Author

MoonDragon-MD commented Jan 29, 2025

@thammegowda Thank you! i did the “Fork/pull” i hope i did it correctly
Edit:
I think it is appropriate to keep the Docker / Docker-slim versions separate.
So you might want to create a “Patch-slim” folder and indicate to replace the files for that version,
into README
so for normal we will have as I had indicated in this error
While for the slim is fine as I did on the fork/pull
The browser extension is good with both

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants