Skip to Content

Virtual Reality Actually Feels Real When It Uses Physics

A small startup is trying to improve VR by simulating virtual characters’ bones and motions more realistically.

Virtual reality can be impressively immersive and realistic, but it’s still unusual to have experiences where you really, truly feel like you’re interacting with digital imagery—to the point where you have a ghostly sense of touching or poking something that, logically, you know isn’t there, though all the visuals point to the contrary.

I had one of those rare moments recently as I tried a demo made by a small startup called Midas Touch Games: while wearing an old Oculus developer headset that had a Leap Motion gesture controller attached to its front, I used stick-like virtual hands to play with an animated dog in a way that felt oddly true to life.

I could pet the dog, sure. But I could also tug at its ears or tail, lift the animal by its front legs, put my fingers in its mouth, and more. And every time I stroked, swatted at, or otherwise touched the dog with one or both hands, it responded with body movements that were much like what I’d expect from a real (albeit extremely patient) furry friend.

Midas Touch made this work by building software meant to properly mimic physics in virtual reality. In the case of the dog demo, for instance, it models the input device (my bare hands) as different bones that can collide with the dog. The dog, too, is modeled with 20 to 30 bones that have mass, shape, and friction, which can collide with my hands. When my hands move around, the software figures out how the two are striking each other and uses the force of that impact to figure out which muscles to tighten on the dog so it can keep its balance while I’m, say, pushing its legs.

The startup aims to license its technology to others who can add it to games and other VR applications and create digital images that you can push, ram into each other, and so on, in ways that simulate how these things happen in the real world. The company’s cofounder, CEO, and chief technology officer, Kevin He, thinks this characteristic is essential to making VR feel more lifelike and entrancing.

Evan Suma, a research assistant professor who studies virtual reality at the University of Southern California’s Institute for Creative Technologies, agrees, saying that Midas Touch Games is getting at one of the key things needed for VR to give a sense of presence: the illusion of plausibility.

Maintaining that illusion is “a game changer,” he says. “You’re no longer a spectator but a participant in the world.”

There is already some such software meant to simulate physics in two-dimensional video games, but He argues that’s focused more on simulating environments and reproducing how shapes like balls and triangles collide with each other in order to approximate things like explosions. He says his company concentrates on re-creating the bones, skeletons, and underlying structures of things that can walk or otherwise move, whether they’re virtual humans, dogs, robots, or cars, and simulating how they should get around and what should happen when a user pokes or prods them.

He hopes his company’s software finds uses beyond just games in VR. For instance, he thinks it could make it feel more natural to socialize with other people’s digital avatars in virtual environments—something that’s in its infancy as companies like AltspaceVR let users of headsets like Vive and the Oculus Rift connect with others.

He says the company will soon start letting some developers try out a beta version of part of its software, and he expects the rest to be released next year. The company is also planning to make VR games and put them online so anyone with a headset can try them out.

Keep Reading

Most Popular

Death and Jeff Bezos
Death and Jeff Bezos

Meet Altos Labs, Silicon Valley’s latest wild bet on living forever

Funders of a deep-pocketed new "rejuvenation" startup are said to include Jeff Bezos and Yuri Milner.

ai learning to multitask concept
ai learning to multitask concept

Meta’s new learning algorithm can teach AI to multi-task

The single technique for teaching neural networks multiple skills is a step towards general-purpose AI.

Professor Gang Chen of MIT
Professor Gang Chen of MIT

All charges against China Initiative defendant Gang Chen have been dismissed

MIT professor Gang Chen was one of the most prominent scientists charged under the China Initiative, a Justice Department effort meant to counter economic espionage and national security threats.

conceptual illustration showing various women's faces being scanned
conceptual illustration showing various women's faces being scanned

A horrifying new AI app swaps women into porn videos with a click

Deepfake researchers have long feared the day this would arrive.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.