Deepseek-v3 int4 weight only inference outputs garbage words with TP 8 on nvidia H20 GPU #121
Triggered via issue
January 14, 2025 14:35
nv-guomingz
Status
Failure
Total duration
1m 7s
Artifacts
–
Annotations
1 error and 1 warning
|
assign_issue
Process completed with exit code 1.
|
|
assign_issue
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|