Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Eval] DiscoveryBench OpenHands Integration #7

Open
wants to merge 16 commits into
base: main
Choose a base branch
from
Open

[Eval] DiscoveryBench OpenHands Integration #7

wants to merge 16 commits into from

Commits on Oct 30, 2024

  1. init(eval): add baseline DiscoveryBench infer script 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7c9ccaa View commit details
    Browse the repository at this point in the history

  2. feat(eval): implement create_dataset function to clone and prepare da… 

    …taset

Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    da61d20 View commit details
    Browse the repository at this point in the history

  3. feat(eval): implement process_instance function 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    cfe39b6 View commit details
    Browse the repository at this point in the history

  4. feat(eval): initialize docker runtime with necessary python libraries 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    33071aa View commit details
    Browse the repository at this point in the history

  5. feat(eval): implement complete_runtime function 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a585cee View commit details
    Browse the repository at this point in the history

  6. feat(eval): add response parser for DiscoveryBench evaluation 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    98efba4 View commit details
    Browse the repository at this point in the history

  7. docs(eval): Add README for discoverybench

    @suranah
    suranah authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    8140aae View commit details
    Browse the repository at this point in the history

  8. docs(eval): Add README for DiscoveryBench eval utils

    @suranah
    suranah authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    477eb84 View commit details
    Browse the repository at this point in the history

  9. refactor(eval): integrate DiscoveryBench evaluation and update script… 

    …s for linting compliance

Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f1bf06c View commit details
    Browse the repository at this point in the history

  10. feat(eval): add run_infer.sh to execute inference 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    23a8027 View commit details
    Browse the repository at this point in the history

  11. feat(eval): add AgentConfig to disable function calling and enable ju… 

    …pyter and browsing delegate config

Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    0374351 View commit details
    Browse the repository at this point in the history

  12. chore(eval): set execute permission for run_infer.sh 

    Signed-off-by: Abhijeetsingh Meena <[email protected]>
    @Ethan0456
    Ethan0456 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7d35c51 View commit details
    Browse the repository at this point in the history

  13. docs(eval): update README to comply with linting rules

    @Ethan0456
    Ethan0456 authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7f3ab98 View commit details
    Browse the repository at this point in the history

  14. Increase share popup duration from 5s to 10s (All-Hands-AI#4625) 

    Co-authored-by: openhands <[email protected]>
    @tofarr @openhands-agent
    tofarr and openhands-agent authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    75ee54b View commit details
    Browse the repository at this point in the history

  15. Load GitHub users list at startup for improved authentication perform… 

    …ance (All-Hands-AI#4567)

Co-authored-by: openhands <[email protected]>
    @rbren @openhands-agent
    rbren and openhands-agent authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    e21abce View commit details
    Browse the repository at this point in the history

  16. Merge branch 'main' into test/discoverybench-openhands-integration

    @suranah
    suranah authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    adf0b87 View commit details
    Browse the repository at this point in the history