Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create another reference set of 50-100 labels #31

Open
ntatonetti opened this issue Nov 13, 2022 · 0 comments
Open

Create another reference set of 50-100 labels #31

ntatonetti opened this issue Nov 13, 2022 · 0 comments

Comments

@ntatonetti
Copy link
Member

Manually curate a new set of FDA labels (~50-100 should be sufficient) according to the same process that the Denmer-Fishman paper performed. Use this set to independently validate the performance metrics we got from the gold standard.

This can be broken down into two parts. First, someone needs to review the process in detail and come up with a strategy of how we'll do it. Then as a lab we can dedicate a couple of days to the manual annotation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant