Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem on T2M Evaluation with New Dataset #61

Open
voidffu opened this issue Sep 30, 2024 · 1 comment
Open

Problem on T2M Evaluation with New Dataset #61

voidffu opened this issue Sep 30, 2024 · 1 comment

Comments

@voidffu
Copy link

voidffu commented Sep 30, 2024

Dear author,

Many thanks to the great work. I have some confusion about how to perform t2m_eval with a new dataset. Specifically, in the _get_t2m_evaluator function, the model requires creating t2m_textencoder, t2m_moveencoder, and t2m_motionencoder, and loading the pretrained t2m_checkpoint for subsequent metric calculations.

Since my new dataset has a different motion feature dimension (nfeats), and I have used a different text_encoder during training, does this mean I cannot load the pretrained T2M checkpoint you provided in Google Drive? Would I need to customize and retrain the T2M model?

If retraining is necessary, would it be possible for you to release the relevant code for T2M training? This part wasn't detailed in the paper, and I am a bit confused. Your clarification would be a great help and I will appreciate it.

@Jatinkalal
Copy link

Jatinkalal commented Oct 25, 2024

Hey , what exactly is t2m_textencoder? Isn't the CLIP model used as the text encoder?
Iam figuring out what it is and will appreciate your help!.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants