Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BERT] Pre-trained checkpoint conversion script across frameworks #419

Open
nv-rborkar opened this issue Jan 19, 2021 · 1 comment
Open

[BERT] Pre-trained checkpoint conversion script across frameworks #419

nv-rborkar opened this issue Jan 19, 2021 · 1 comment
Assignees
@petermattson
Labels
AI There is an action item here. Next Meeting Item to be discussed in the next Working Group

Comments

@nv-rborkar
Copy link
Contributor

nv-rborkar commented Jan 19, 2021 •
edited
Loading

As per #317 , we would like all references that use pre-trained weights or start from a checkpoint to provide conversion scripts for use across different frameworks (Pytorch, TF, & other frameworks of choice for submission) to ensure submitters use the same pre-approved checkpoint.

AI Google (reference owner) for BERT
Example script & recipe in #391
@johntran-nv
Copy link
Contributor

@petermattson could you point this to the correct google person?

@johntran-nv johntran-nv added AI There is an action item here. Next Meeting Item to be discussed in the next Working Group labels Jan 20, 2021
@petermattson petermattson self-assigned this Mar 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@petermattson petermattson

Labels
AI There is an action item here. Next Meeting Item to be discussed in the next Working Group
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@johntran-nv @petermattson @nv-rborkar