Introducing NeRF! It’s a new AI technique that jperl and I used to get this shot. Btw this entire thing was shot with a phone 🤳 No drones were used to get this shot
Here's how -
jperl walked around me in circles a few times, pointing his phone at me. We fed the video into a program (Instant-NGP) which created a NeRF (Neural Radiance Field) out of the footage. It's kinda like a 3D model, but instead of creating mesh+textures it’s more like a point cloud that changes color depending on what angle you view it from. This creates beautiful surreal lighting effects - you can see how the light hits differently as we change camera angles.
With the NeRF, you're able to set any camera angle / camera path you want - you're not limited to the camera path you captured from. Which is how we were able to simulate "drone" shots even though we never even shot from above.
I think the most exciting thing happening in VFX right now is everything that's about to be possible with AI-powered video editi...
Not seeing views yet? Check back later!
Tags, Events, and Projects