Visual Effects
++ Using nerfies you can create fun visual effects. This Dolly zoom effect + would be impossible without nerfies since it would require going through a wall. +
+ +
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ Matting
+
+
+
+
+
+ + As a byproduct of our method, we can also solve the matting problem by ignoring + samples that fall outside of a bounding box during rendering. +
+ +
+
+
+
+
+
+
+
+ + + +
+ Animation
+ + +Interpolating states
+
+
+ + We can also animate the scene by interpolating the deformation latent codes of two input + frames. Use the slider here to linearly interpolate between the left frame and the right + frame. +
+
+
+
+ 
+
+
+ Start Frame
+
+
+
+ Loading...
+
+
+
+ 
+
+
+ End Frame
++ + + +
Re-rendering the input video
+
+
+ + Using Nerfies, you can re-render a video from a novel + viewpoint such as a stabilized camera by playing back the training deformations. +
+
+
+
+
+
+
+
+
+
+
+
+ Related Links
+ +
+
+ + There's a lot of excellent work that was introduced around the same time as ours. +
++ Progressive Encoding for Neural Optimization introduces an idea similar to our windowed position encoding for coarse-to-fine optimization. +
++ D-NeRF and NR-NeRF + both use deformation fields to model non-rigid scenes. +
++ Some works model videos with a NeRF by directly modulating the density, such as Video-NeRF, NSFF, and DyNeRF +
++ There are probably many more by the time you are reading this. Check out Frank Dellart's survey on recent NeRF papers, and Yen-Chen Lin's curated list of NeRF papers. +
+