Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bug: [CANN] inference running result is garbled in debug running model for LM models who's type is Q4_0 class #9979

Closed
leo-pony opened this issue Oct 21, 2024 · 0 comments · Fixed by #9970
Closed

Bug: [CANN] inference running result is garbled in debug running model for LM models who's type is Q4_0 class #9979

leo-pony opened this issue Oct 21, 2024 · 0 comments · Fixed by #9970
Assignees
@leo-pony
Labels
Ascend NPU issues specific to Ascend NPUs medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)

Comments

@leo-pony
Copy link
Contributor

What happened?

For CANN backend: inference running result is garbled in debug running model for LM models who's type is Q4_0 class

Name and Version

b3948

What operating system are you seeing the problem on?

No response

Relevant log output

No response
@leo-pony leo-pony added bug-unconfirmed medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable) labels Oct 21, 2024
@leo-pony leo-pony mentioned this issue Oct 21, 2024
Merged
4 tasks
@hipudding hipudding added Ascend NPU issues specific to Ascend NPUs and removed bug-unconfirmed labels Oct 21, 2024
@hipudding hipudding linked a pull request Oct 22, 2024 that will close this issue
[CANN] Adapt to dynamically loadable backends mechanism #9970
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@leo-pony leo-pony

Labels
Ascend NPU issues specific to Ascend NPUs medium severity Used to report medium severity bugs in llama.cpp (e.g. Malfunctioning Features but still useable)
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[CANN] Adapt to dynamically loadable backends mechanism leo-pony/llama.cpp
2 participants
@hipudding @leo-pony