Select your localized edition:

Close ×

More Ways to Connect

Discover one of our 28 local entrepreneurial communities »

Be the first to know as we launch in new countries and markets around the globe.

Interested in bringing MIT Technology Review to your local market?

MIT Technology ReviewMIT Technology Review - logo


Unsupported browser: Your browser does not meet modern web standards. See how it scores »

{ action.text }

Whatever the specific depth-sensing tactics of a given camera, Tombroff says, Softkinetic aims at being “a bridge between the end product and the hardware, which is the camera.” This means that the company’s software is built to work with the four major depth-sensing cameras on the market, including the ZCam from 3DV Systems, which was a finalist in the Best of CES awards given earlier this year at the Consumer Electronics Showcase in Las Vegas. With Softkinetic’s software, game designers can avoid retooling their applications to work with each of those cameras.

But Tombroff adds that interpreting data from different types of hardware isn’t the heaviest lifting that Softkinetic does. The software’s chief value, he says, is that it can “classify the scene so we know how to find the player and remove the rest, and reconstruct the person’s structure.” The first half of that task involves filtering out a great deal of noise from the signal. “We need to zoom in on the important thing, which, for video games, is you, the player, and not the person next to you sitting on the couch and making fun of you.” Secondly, the software creates a 3-D volume from the fuzzy cloud of points the camera detects and identifies body parts important to an application. So instead of interacting directly with the depth map produced by the camera, designers get information from Softkinetic’s software about which body parts are moving and how quickly. The company has also identified sets of gestures people commonly make when trying to control a program in a particular way.

Anind Dey, an assistant professor at the Human-Computer Interaction Institute, at Carnegie Mellon University, says that Softkinetic’s technology is particularly exciting because of the potential for full-body interaction. While he notes that all software of this type must mediate between doing too much for developers, which can stifle their creativity, and doing too little, which can leave them to reinvent the wheel, he is enthusiastic about its prospects. “If the technology works as they’re claiming it works,” says Dey, “I think it’s a really exciting thing for the field, and not just for gaming.” For example, Dey says, knowing a person’s body position could help with applications such as health-care monitoring in the home, or other applications in the field of ubiquitous computing.

Tombroff says that Softkinetic has built 12 or 15 sample games in-house and is now working with game developers to help them understand the technology and what they can do with it.

2 comments. Share your thoughts »

Credit: Softkinetic

Tagged: Computing, virtual reality, user interfaces, Nintendo Wii

Reprints and Permissions | Send feedback to the editor

From the Archives


Introducing MIT Technology Review Insider.

Already a Magazine subscriber?

You're automatically an Insider. It's easy to activate or upgrade your account.

Activate Your Account

Become an Insider

It's the new way to subscribe. Get even more of the tech news, research, and discoveries you crave.

Sign Up

Learn More

Find out why MIT Technology Review Insider is for you and explore your options.

Show Me