Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does this method support multi-rgbd and/or dynamic scenes? #1

Open
edhyah opened this issue Mar 6, 2024 · 1 comment
Open

Does this method support multi-rgbd and/or dynamic scenes? #1

edhyah opened this issue Mar 6, 2024 · 1 comment

Comments

@edhyah
Copy link

edhyah commented Mar 6, 2024

Hello! Two questions:

  • Does this method support integrating multiple RGBD streams like FWD?
  • Does this support real-time synthesis of dynamic scenes, such as a person walking around?

Thank you!

@lorafib
Copy link
Contributor

lorafib commented Apr 9, 2024

Hey!

Two questions:

  • Does this method support integrating multiple RGBD streams like FWD?

If "multiple" means that you do not have to train for a specific stream, then yes, it should generalize quite well for different RGB sensors and scenes, given that the provided depth maps have good quality. If "multiple" means, multiple streams at once for one scene then it would work method-wise. Although sensor interface things are not provided in this code base and you would need to do this your self. If this did not answer your question: Do you have a link or something that shows the use case you're referring to for FWD?

  • Does this support real-time synthesis of dynamic scenes, such as a person walking around?

No, LiveNVS generally assumes a static scene. Small "outliers" might be filtered out by the image fusion process, but we do not actively model any dynamic scene parts.

Hope that helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants