New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

教师助理策略 #56

Open

yuhua666 opened this issue Dec 5, 2022 · 1 comment

yuhua666 commented Dec 5, 2022

尊敬的博士，您好！
请问如果想实现教师助理策略进行蒸馏，A teach B，B teach C，我该怎么实现？
直接分两步蒸馏就可以完成吗，还是说要进行其他的处理？

Owner

HikariTJU commented Dec 5, 2022

b teach c的时候教师权重换成a teach b得到的权重文件，没有其他特殊的步骤了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment