Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add auxiliary confidence head #3

Open
jackboyla opened this issue Jun 20, 2024 · 3 comments
Open

Add auxiliary confidence head #3

jackboyla opened this issue Jun 20, 2024 · 3 comments

Comments

@jackboyla
Copy link
Owner

No description provided.

@chrishokamp
Copy link
Collaborator

Goal: At some point during training, we wish to introduce an additional confidence head, which will output model confidence that a given prediction is correct.

  • head can be trained on held-out or cross validation splits
  • head loss can optionally backprop into model parameters, or can be detached from model params, and use static model representation

current loss computation https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L242-L259
backprop: https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L242-L259

@chrishokamp
Copy link
Collaborator

Note multiple heads can be trained for sub-objectives, for example just for the prompt representation https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L64-L70
and encoding a prior probability that the trained model will succeed at predicting a given zero-shot relation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants