Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run command issue #2027

Closed
Xi0131 opened this issue Jan 13, 2025 · 1 comment
Closed

Run command issue #2027

Xi0131 opened this issue Jan 13, 2025 · 1 comment

Comments

@Xi0131
Copy link

Xi0131 commented Jan 13, 2025

Hi, I noticed there might be an upcoming version of benchmark v5.0 from the documents' run commands, such as
https://docs.mlcommons.org/inference/benchmarks/language/bert/#__tabbed_1_1

I have used the run command but it will get stuck at certain file downloads with no progress (0%)
Is v5.0's version of the run command ready to be executed?

related issue: #2024

@arjunsuresh
Copy link
Contributor

Hi @Xi0131 v5.0 can be tested for reference implementation but not for others. Officially it'll be ready for reference implementation this Friday and for other implementations by April 2025.

@Xi0131 Xi0131 closed this as completed Jan 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants