Select your localized edition:

Close ×

More Ways to Connect

Discover one of our 28 local entrepreneurial communities »

Be the first to know as we launch in new countries and markets around the globe.

Interested in bringing MIT Technology Review to your local market?

MIT Technology ReviewMIT Technology Review - logo


Unsupported browser: Your browser does not meet modern web standards. See how it scores »

{ action.text }

A new generation of tools will soon make it even easier to tinker with the Kinect, the $150 Microsoft device that lets people control video games by gesturing.

Since the Kinect’s release in November, Microsoft has sold upwards of 8 million units and perhaps inadvertently started a frenzy of hacking, as academics and hobbyists have adapted the sensors available in the Kinect for projects ranging from robotics to unorthodox displays. The Kinect is so popular for such projects because it offers an inexpensive way to set up gestural controls. Unlike the Nintendo Wii, the Kinect can “see” users’ gestures without requiring a remote or special clothing. And it’s designed to work with USB, the protocol that’s commonly used to connect devices to computers.

Hackers figured out how to communicate with the device just days after its release, but recently companies—including Microsoft—have given their activities more official support.

To work with the Kinect, the hacker has to be able to get information from the device—such as the depth map that the Kinect constructs to be able to “see” what’s going on in a room. The hacker also needs to be able to define what should be done with the information the device picks up—in other words, what gestures to recognize. Software is needed for both of these roles.  Last week, Microsoft announced that it will release a noncommercial-software development kit for Windows, to make it easy for academics and researchers to get deep into the Kinect. The kit will offer access to the device’s audio system, direct control of the main sensor, and system-wide application programming interfaces. The company plans to follow that with a commercial version of the kit.

PrimeSense, a company based in Tel Aviv, Israel, which provided some of the technology that Microsoft licensed for the Kinect, has also been supporting hackers. It sells the PrimeSensor Reference Design, a device that’s very similar to the Kinect, and offers open-source drivers for it.

Finally, SoftKinetic, a company based in Brussels, Belgium, which specializes in 3-D gesture-recognition software, will offer a free version of its middleware; this will be available for download in mid-March. This software can take depth-sensing input from any device, including the Kinect, and it can be used to program a device to respond to gestures.

Kinect hackers already rely a great deal on shared information. “I don’t believe I actually hacked the Kinect,” says one tinkerer, Jim Spadacinni. He is owner and creative director of Ideum, a company that develops interactive exhibits for science museums and other institutions. Spadacinni is also the principal investigator for Open Exhibits, a project funded by the National Science Foundation, which is aimed at developing free open-source software to help put together exhibits. He has recently been investigating the Kinect’s possibilities on this front.

1 comment. Share your thoughts »

Credit: Ideum
Video by Erica Naone, edited by Brittany Sauser

Tagged: Computing, hacking, Kinect, natural user interfaces, gesture interfaces, blur conference

Reprints and Permissions | Send feedback to the editor

From the Archives


Introducing MIT Technology Review Insider.

Already a Magazine subscriber?

You're automatically an Insider. It's easy to activate or upgrade your account.

Activate Your Account

Become an Insider

It's the new way to subscribe. Get even more of the tech news, research, and discoveries you crave.

Sign Up

Learn More

Find out why MIT Technology Review Insider is for you and explore your options.

Show Me