New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can you release the scripts for evaluating the model on Big-Bench? #2

Open

WooKimm opened this issue Jun 7, 2023 · 2 comments

WooKimm commented Jun 7, 2023

How to calculate the accuracy of division while the gt is not "quotient R remainder" format in Big-Bench?

dachangganjun5 commented Nov 21, 2023

looking forward to the scripts on big bench

verazuo commented Mar 28, 2024

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment