Bullettime using phone footage, made possible with AI 🤳 collab with jperl
#ad made for nvidiacreators
What's interesting about this tech (NeRF) is you can make a video from any angle -
Any camera path you want. You're not limited to the camera paths you shot from 🤯
Our process:
1) Have everyone stay PERFECTLY still - any movements will cause blurry scans or artifacts
2) Take a video from as many angles as possible. You can use your phone for this
3) jperl used COLMAP to calculate camera positions
4) Then he fed that data into Instant-NGP to create a NeRF (it's like a 3D model, but volumetric)
5) He wrote custom code to bring it into Blender to get the camera movements
6) I made a few final finishing touches (speed ramps, vignetting and color grading)
While this process is still technically challenging today, I do think within a few years it will be as easy as pressing a button on an app on your phone. Already, the latest version we used (NVIDIA's Instant-NGP) is much faster than t...