Skip to content

Deepseek-v3 int4 weight only inference outputs garbage words with TP 8 on nvidia H20 GPU #121

Deepseek-v3 int4 weight only inference outputs garbage words with TP 8 on nvidia H20 GPU

Deepseek-v3 int4 weight only inference outputs garbage words with TP 8 on nvidia H20 GPU #121

Annotations

1 error and 1 warning

assign_issue

failed Jan 14, 2025 in 34s