Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pytest failure #234

Open
esnible opened this issue Dec 19, 2024 · 3 comments
Open

pytest failure #234

esnible opened this issue Dec 19, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@esnible
Copy link
Member

esnible commented Dec 19, 2024

Describe the bug
pytest tests outputs "1 failed, 180 passed, 2 warnings". There should be no failures.

To Reproduce
pytest tests

Expected behavior
No errors

Screenshots

FAILED tests/test_examples_run.py::test_valid_programs - AssertionError: Unexpected runtime error: ['examples/code/code-eval.pdl', 'examples/code/code-json.pdl', 'e...
============================= 1 failed, 180 passed, 2 warnings in 88.84s (0:01:28) =============================

Desktop (please complete the following information):

  • OS: MacOS 15.1.1
  • Version: pytest 8.3.4, Python 3.13.1; both from ~/.pyenv/shims directory.
@esnible esnible added the bug Something isn't working label Dec 19, 2024
@esnible
Copy link
Member Author

esnible commented Jan 13, 2025

@mandel This has gotten much worse. After 45 seconds I get "21 failed, 160 passed, 1 warning in 49.80s"

Many of the errors are syntax errors, e.g.

FAILED tests/test_type_checking.py::test_function_call - pdl.pdl_interpreter.PDLRuntimeError: Syntax error in ${ description='Define hello' spec=None defs={} assign='hello' contribute...

@vazirim
Copy link
Member

vazirim commented Jan 13, 2025

@esnible please try pip install . before pytest

@vazirim
Copy link
Member

vazirim commented Jan 13, 2025

Currently I am seeing some "unexpected runtime errors" for the tests/test_examples_run.py, which depends on what version of LiteLLM you are using. I am working on fixing this currently. But there shouldn't be any other errors at the moment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants