New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deepseek R1 671b 版本的cpu部署 #3105

Open

infiniteYuanyl opened this issue Jan 31, 2025 · 0 comments

infiniteYuanyl commented Jan 31, 2025

请问imdeploy支持在服务器上进行大模型的cpu部署吗？我目前下载了cpu版的pytorch，但是会报无法识别到cuda的错误。请问应该如何在cpu上进行部署？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment