Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

will you release a pretrained checkpoint of B/2 model? #45

Open
aaab8b opened this issue May 23, 2024 · 3 comments
Open

will you release a pretrained checkpoint of B/2 model? #45

aaab8b opened this issue May 23, 2024 · 3 comments

Comments

@aaab8b
Copy link

aaab8b commented May 23, 2024

Thanks for the wonderful work again and I still wants to do some experiments on the small models like B/2 or S/2 due to my limited resources. Will you guys release a pretrained checkpoint of B/2 model or S/2 model?

@gasvn
Copy link
Collaborator

gasvn commented May 23, 2024

Sorry I no longer have these checkpoints since I no longer have the access to the clusters used to train our model.

@aaab8b
Copy link
Author

aaab8b commented May 27, 2024

Sorry I no longer have these checkpoints since I no longer have the access to the clusters used to train our model.

I use the same 32x8 batchsize and check every single detail and cannot get the same fid result for training my s/2 and b/2 models. The performance drops about ~20 fid score on my s/2 model. And the only thing I'm not certain about is your dynamic ratio. the code its from 0.3 to 0.5. but in your paper it's 0.3 to 0.05. which is correct?

@gasvn
Copy link
Collaborator

gasvn commented May 27, 2024

The mask ratio is from 0.3 to 0.5. Did you check if you are using the cfg for testing?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants