Skip to Content

Jon Favreau Leaps into Virtual Reality

The man behind The Jungle Book and Iron Man is among the first Hollywood directors to explore the unique storytelling tools of VR.
March 8, 2017

Jon Favreau is the rare traditional filmmaker to push into virtual reality. After becoming one of the most successful directors in Hollywood with Elf and Iron Man, Favreau pushed the envelope of motion-capture digital filmmaking with last year's hit The Jungle Book. Now one of his latest projects is a brief, interactive 360-degree scene called "Gnomes & Goblins," currently available on the HTC Vive and soon for Oculus Rift. He shared his thoughts on storytelling in VR with Ty Burr.

How does a Hollywood moviemaker create a VR experience?

Every medium has an optimal way to tell a story. With film, you have a set of expectations developed around 100 years of people consuming that medium. You're using tools like the huge scale of the screen, the communal viewing experience. And you have lensing and editing to help guide and focus the attention of the audience on exactly what you want them to see.

None of which are available in VR.

No. Where people find themselves getting frustrated is when they try to impose those qualities on the new medium. They try to cut and paste a movie or television or a video game into VR. I think the best version of VR is immersive and takes full advantage of the presence that VR brings you. 

How do you create emotionally engaging experiences in virtual reality?

When film is at its best, you feel subjectively engaged; you feel like you're experiencing the story through the eyes of some proxy. If the movie is scary, your palms sweat. If it's sad, you cry. All of that comes from feeling that you're represented in the narrative. We get pulled into it; we lose ourselves in good storytelling. With VR, you have the same set of challenges, in that you want the audience to subjectively experience what you're presenting them. But if we can create an experiential progression, not necessarily using traditional narrative, we can engage the audience and have them feel that something's happening, something's changing, there's an arc to the experience.

Is the time right to explore this technology? Are audiences ready? Is Hollywood?

I know that as a storyteller this set of tools and the feelings I get from this medium are unique, and it's compelling for me even in the absence of any kind of model for success. It's very early days. We’re still figuring out where the camera goes, laying out the set and understanding where the light's coming from. If somebody tells the right story in the right way, it's going to create a tectonic shift. That's the way the film business has worked: people began to learn to tell stories using film, and then cinematic techniques and special effects and editing techniques all developed to help solve problems as people grew more ambitious in the stories they were trying to present to their audience.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.