Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

If I set output_feature = False , Code don't work #64

Open
shaby3 opened this issue Apr 14, 2023 · 1 comment
Open

If I set output_feature = False , Code don't work #64

shaby3 opened this issue Apr 14, 2023 · 1 comment

Comments

@shaby3
Copy link

shaby3 commented Apr 14, 2023

I understood that LD is a technique that only uses logit, which is the head output, as the knowledge of the teacher instead of intermediate feature(e.g.neck output) . However, output_feature is set to True by default. If I try to use logit only by setting output_feature to False, the code don't work.

My question is, If LD sets output_feature to False, then logit mimicking, and if output_feature is set to True, does logit mimicking + feature imitation work?
And Can I get the performance in the paper if I delete the feature imitation part code and turn it around using logit only?
AP: 42.1 , AP50: 60.3 AP75: 45.6

@HikariTJU
Copy link
Owner

Just set loss_im=0 in config file will disable feature imitation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants