# @karenxcheng on Instagram

- **Type:** Video
- **Original URL:** https://www.instagram.com/p/Cfb32WDJYen
- **Gondola URL:** https://gondola.cc/posts/16472572-karenxcheng-instagram
- **Thumbnail:** https://img.gondola.cc/tr:w-,h-,fo-auto/postThumbnails/a2039081e3.jpg
- **Posted:** 2022-06-30T16:12:47.000+00:00
- **Account Owner:** Karen X (@karenxcheng) — https://gondola.cc/karenxcheng

## Caption

Introducing NeRF! It’s a new AI technique that jperl and I used to get this shot. Btw this entire thing was shot with a phone 🤳 No drones were used to get this shot 

Here's how -
jperl walked around me in circles a few times, pointing his phone at me. We fed the video into a program (Instant-NGP) which created a NeRF (Neural Radiance Field) out of the footage. It's kinda like a 3D model, but instead of creating mesh+textures it’s more like a point cloud that changes color depending on what angle you view it from. This creates beautiful surreal lighting effects - you can see how the light hits differently as we change camera angles.

With the NeRF, you're able to set any camera angle / camera path you want - you're not limited to the camera path you captured from. Which is how we were able to simulate "drone" shots even though we never even shot from above.

I think the most exciting thing happening in VFX right now is everything that's about to be possible with AI-powered video editing. While this technique does require quite a bit of technical knowledge right now (the ability to write and debug code) I do believe that within a few short years, this will become as easy as pressing a button on an app on your phone.

Which means soon everyone and their grandma will be able to generate a video like this, simply from walking around and taking a casual phone video. Over the next few years, AI-powered video editing is gonna empower so many people to make Hollywood-level effects with their phone.

jperl and I did a lot of experimenting with this technique - we tested over 100 clips over the last few months and we're gonna share a few more of our favorites over the next month

Director karenxcheng
VFX jperl
AI nvidiacreators Instant-NGP NeRF
Hardware: We recommend an RTX 3090 or newer card

Read more about the research used behind this technique here:
https://nvlabs.github.io/instant-ngp/
Researchers: Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller

#photogrammetry #NeRF #neuralradiancefield #aiediting #artificialintelligence #nvidia

## Stats

- **Views:** 0
- **Likes:** 83,615
- **Shares:** 0
- **Comments:** 518

## Tags

neuralradiancefield, photogrammetry, nerf, artificialintelligence, aiediting, nvidia

---
Copyright (c) Gondola