New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE] log inference times #491

Open

neuronflow opened this issue Sep 28, 2023 · 1 comment

Labels

project: BraTS/FeTS topic: orchestration type: enhancement

neuronflow commented Sep 28, 2023 •

edited

Loading

Is your feature request related to a problem? Please describe.
We need to know the inference times of algorithms per exam.

Describe the solution you'd like
Medperf should log and return inference times in milliseconds.

Additional context
Email conversation with Hasan and Verena. Miccai challenge guidelines (attached)
BIAS_ReportingGuideline.pdf

neuronflow added the type: enhancement label

Author

neuronflow commented Sep 29, 2023

PS: ideally you can separate between timings:

medperf housekeeping
loading model weights
actual inference
computing metrics

Probably I missed some relevant points.

hasan7n added project: BraTS/FeTS topic: orchestration labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment