Skip to content

Issues: haesleinhuepf/human-eval-bia

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

42 Open 19 Closed
42 Open 19 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

New test cases suggestions
#141 opened Oct 14, 2024 by rmassei
1
8
Different plot for comparing models
#140 opened Oct 14, 2024 by haesleinhuepf
1
7
Measure inference time
#136 opened Sep 25, 2024 by haesleinhuepf
Benchmarking o1-preview-2024-09-12
#135 opened Sep 12, 2024 by haesleinhuepf
3
[Fixing Test Cases] Label Images - When should 0 be considered a label?
#130 opened Sep 10, 2024 by ian-coccimiglio
1
2
New benchmark run from scratch
#128 opened Sep 9, 2024 by haesleinhuepf
[Fixing Test-Cases] Pandas/Numpy use different stdev estimators (mean_std_column)
#124 opened Sep 9, 2024 by ian-coccimiglio
1
2
[Fixing Test-Cases] Functions with image inputs but checking lists
#120 opened Sep 9, 2024 by ian-coccimiglio
1
Guarding against LLMs that would learn our repo "by heart"
#119 opened Sep 7, 2024 by tischi
1
Should we represent images using default numpy.asarray()?
#115 opened Sep 6, 2024 by ian-coccimiglio
2
2
Reference of test case failing with numpy 2.0.2
#114 opened Sep 6, 2024 by haesleinhuepf
grouping test cases and categorisation
#112 opened Sep 4, 2024 by pr4deepr
1
23
Remove small labels: Unclear prompt
#111 opened Sep 4, 2024 by tischi
@haesleinhuepf
6
Potential test case: Save voxel size in meta data help wanted Extra attention is needed
#109 opened Sep 3, 2024 by haesleinhuepf
model names with : cause issues in create_samples.ipynb
#102 opened Sep 1, 2024 by haesleinhuepf
1
test cases suggestions
#99 opened Aug 28, 2024 by pr4deepr
2
Are OME-Zarr tests in scope
#98 opened Aug 25, 2024 by jluethi
1
LLM's using this repo as training data
#89 opened Aug 7, 2024 by JoOkuma
6
Benchmark llama3.1 405b
#84 opened Jul 26, 2024 by haesleinhuepf
Improve how we ask the LLMs to perform a task
#79 opened Jul 10, 2024 by tischi
12
Evaluating LLMs capabilities relative to task-complexity
#77 opened Jul 8, 2024 by ian-coccimiglio
7
Check why rather basic test-cases are failing
#76 opened Jul 5, 2024 by haesleinhuepf
4
Report about system prompt in the paper
#75 opened Jul 5, 2024 by haesleinhuepf
2
Add test case: Save image according to ome-ngff standards
#73 opened Jul 5, 2024 by ClementCaporal
3
measure execution time of tests
#71 opened Jun 22, 2024 by haesleinhuepf
ProTip! Find all open issues with in progress development work with linked:pr.