Virtual Reality Actually Feels Real When It Uses Physics
Virtual reality can be impressively immersive and realistic, but it’s still unusual to have experiences where you really, truly feel like you’re interacting with digital imagery—to the point where you have a ghostly sense of touching or poking something that, logically, you know isn’t there, though all the visuals point to the contrary.
I had one of those rare moments recently as I tried a demo made by a small startup called Midas Touch Games: while wearing an old Oculus developer headset that had a Leap Motion gesture controller attached to its front, I used stick-like virtual hands to play with an animated dog in a way that felt oddly true to life.
I could pet the dog, sure. But I could also tug at its ears or tail, lift the animal by its front legs, put my fingers in its mouth, and more. And every time I stroked, swatted at, or otherwise touched the dog with one or both hands, it responded with body movements that were much like what I’d expect from a real (albeit extremely patient) furry friend.
Midas Touch made this work by building software meant to properly mimic physics in virtual reality. In the case of the dog demo, for instance, it models the input device (my bare hands) as different bones that can collide with the dog. The dog, too, is modeled with 20 to 30 bones that have mass, shape, and friction, which can collide with my hands. When my hands move around, the software figures out how the two are striking each other and uses the force of that impact to figure out which muscles to tighten on the dog so it can keep its balance while I’m, say, pushing its legs.
The startup aims to license its technology to others who can add it to games and other VR applications and create digital images that you can push, ram into each other, and so on, in ways that simulate how these things happen in the real world. The company’s cofounder, CEO, and chief technology officer, Kevin He, thinks this characteristic is essential to making VR feel more lifelike and entrancing.
Evan Suma, a research assistant professor who studies virtual reality at the University of Southern California’s Institute for Creative Technologies, agrees, saying that Midas Touch Games is getting at one of the key things needed for VR to give a sense of presence: the illusion of plausibility.
Maintaining that illusion is “a game changer,” he says. “You’re no longer a spectator but a participant in the world.”
There is already some such software meant to simulate physics in two-dimensional video games, but He argues that’s focused more on simulating environments and reproducing how shapes like balls and triangles collide with each other in order to approximate things like explosions. He says his company concentrates on re-creating the bones, skeletons, and underlying structures of things that can walk or otherwise move, whether they’re virtual humans, dogs, robots, or cars, and simulating how they should get around and what should happen when a user pokes or prods them.
He hopes his company’s software finds uses beyond just games in VR. For instance, he thinks it could make it feel more natural to socialize with other people’s digital avatars in virtual environments—something that’s in its infancy as companies like AltspaceVR let users of headsets like Vive and the Oculus Rift connect with others.
He says the company will soon start letting some developers try out a beta version of part of its software, and he expects the rest to be released next year. The company is also planning to make VR games and put them online so anyone with a headset can try them out.
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
Sam Altman invested $180 million into a company trying to delay death
Can anti-aging breakthroughs add 10 healthy years to the human life span? The CEO of OpenAI is paying to find out.
ChatGPT is about to revolutionize the economy. We need to decide what that looks like.
New large language models will transform many jobs. Whether they will lead to widespread prosperity or not is up to us.
GPT-4 is bigger and better than ChatGPT—but OpenAI won’t say why
We got a first look at the much-anticipated big new language model from OpenAI. But this time how it works is even more deeply under wraps.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.