Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please provide some example command to run the evaluation #2

Open
cooleel opened this issue Aug 21, 2024 · 1 comment
Open

Please provide some example command to run the evaluation #2

cooleel opened this issue Aug 21, 2024 · 1 comment

Comments

@cooleel
Copy link

cooleel commented Aug 21, 2024

Thansk for the great work. It's very intersting.
Could you please provide some examples on running the evaluation? The code in VLMEvalkit folder seems incomplete.

And are you considering adding the evaluation dataset to VLMEvalkit?

@FanqingM
Copy link
Collaborator

Thank you, I think you should prepare the environment with the instruction of VLMEvalKit repo?
We already released the whold codes, if you have prepared the environment as VLMEvalKit, I think it would not have problems.

The VLMevalKit folder in this repo is merely same with the official VLMEvalKit, with some different codes with CogVLM
model. and the environment is same with the official VLMEvalKit.

For last question, yes, we will do this ASAP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants