Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: App crash using OpenRouter for models like Qwen-2.5 72b #4640

Closed
1 task done
enyst opened this issue Oct 30, 2024 · 0 comments · Fixed by #4641
Closed
1 task done

[Bug]: App crash using OpenRouter for models like Qwen-2.5 72b #4640

enyst opened this issue Oct 30, 2024 · 0 comments · Fixed by #4641
Labels
bug Something isn't working

Comments

@enyst
Copy link
Collaborator

enyst commented Oct 30, 2024

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Describe the bug and reproduction steps

If you choose an LLM like openrouter/qwen/qwen-2.5-72b-instruct, it fails with:

        ^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/enyst/repos/odie/openhands/llm/llm.py", line 87, in __init__
    self.model_info = litellm.get_model_info(self.config.model)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/enyst/repos/odie/.venv/lib/python3.12/site-packages/litellm/utils.py", line 4983, in get_model_info
    raise Exception(

ERROR:root:<class 'Exception'>: This model isn't mapped yet. model=openrouter/qwen/qwen-2.5-72b-instruct, custom_llm_provider=openrouter. Add it here - https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json.

Normally, this shouldn't crash, just not have model_info going forward.

OpenHands Installation

Development workflow

OpenHands Version

No response

Operating System

None

Logs, Errors, Screenshots, and Additional Context

No response

@enyst enyst added the bug Something isn't working label Oct 30, 2024
@enyst enyst mentioned this issue Oct 30, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant