A new generation of tools will soon make it even easier to tinker with the Kinect, the $150 Microsoft device that lets people control video games by gesturing.
Since the Kinect’s release in November, Microsoft has sold upwards of 8 million units and perhaps inadvertently started a frenzy of hacking, as academics and hobbyists have adapted the sensors available in the Kinect for projects ranging from robotics to unorthodox displays. The Kinect is so popular for such projects because it offers an inexpensive way to set up gestural controls. Unlike the Nintendo Wii, the Kinect can “see” users’ gestures without requiring a remote or special clothing. And it’s designed to work with USB, the protocol that’s commonly used to connect devices to computers.
Hackers figured out how to communicate with the device just days after its release, but recently companies—including Microsoft—have given their activities more official support.
To work with the Kinect, the hacker has to be able to get information from the device—such as the depth map that the Kinect constructs to be able to “see” what’s going on in a room. The hacker also needs to be able to define what should be done with the information the device picks up—in other words, what gestures to recognize. Software is needed for both of these roles. Last week, Microsoft announced that it will release a noncommercial-software development kit for Windows, to make it easy for academics and researchers to get deep into the Kinect. The kit will offer access to the device’s audio system, direct control of the main sensor, and system-wide application programming interfaces. The company plans to follow that with a commercial version of the kit.
PrimeSense, a company based in Tel Aviv, Israel, which provided some of the technology that Microsoft licensed for the Kinect, has also been supporting hackers. It sells the PrimeSensor Reference Design, a device that’s very similar to the Kinect, and offers open-source drivers for it.
Finally, SoftKinetic, a company based in Brussels, Belgium, which specializes in 3-D gesture-recognition software, will offer a free version of its middleware; this will be available for download in mid-March. This software can take depth-sensing input from any device, including the Kinect, and it can be used to program a device to respond to gestures.
Kinect hackers already rely a great deal on shared information. “I don’t believe I actually hacked the Kinect,” says one tinkerer, Jim Spadacinni. He is owner and creative director of Ideum, a company that develops interactive exhibits for science museums and other institutions. Spadacinni is also the principal investigator for Open Exhibits, a project funded by the National Science Foundation, which is aimed at developing free open-source software to help put together exhibits. He has recently been investigating the Kinect’s possibilities on this front.