You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I try to load the model, I encounter the following issue. There is a related issue, but it has not solved my problem.
NameError: name 'swap_mha_rope' is not defined"
Related versions are as follows: import torch, triton, flash_attn print(torch.__version__, torch.version.cuda, triton.__version__, flash_attn.__version__)
2.3.1+cu121 12.1 2.3.1 2.6.3
The text was updated successfully, but these errors were encountered:
When I try to load the model, I encounter the following issue. There is a related issue, but it has not solved my problem.
NameError: name 'swap_mha_rope' is not defined"
Related versions are as follows:
import torch, triton, flash_attn print(torch.__version__, torch.version.cuda, triton.__version__, flash_attn.__version__)
2.3.1+cu121 12.1 2.3.1 2.6.3
The text was updated successfully, but these errors were encountered: