Skip to Content

Dancing Chairs and 3-D Puppets Will Make Kids Love the Kinect

Playtime is about to get an upgrade.
October 11, 2012

Microsoft’s Kinect is well loved by the gaming community and is being taken apart and put back together in labs all around the world. But two Kinect hacks I saw this week tell me the device will become a favorite of a much younger crowd.

Take the KinEtre, a 3-D animator that lets you control virtual objects on a screen with your body. All that moving furniture you may remember watching in Beauty and the Beast? KinEtre lets you create your own virtual world of hopping chairs and dancing brooms, Microsoft researcher Jiawen Chen explained, using the magical depth-sensitive camera on a Kinect and the KinectFusion real-time 3-D constructor.

Say you want to play a chair, as the researchers did in this demo video. The first step is to scan that candidate object, which KinEtre understands as a mesh skeleton frame. Now, the Kinect already has the ability to watch your body move. As the video shows, with a single word (“Possess”), the system superimposes your virtual skeleton with the back legs of the virtual chair, animating the chair according to the movement it detects as you jump and bend and kick in front of the camera.

The delightful part is that KinEtre recognizes animation cues from more than just one person. Chen joined his colleague on screen and they proceeded to animate a virtual horse, having “possessed” two legs each. Chen said that the most obvious application for KinEtre would be in gaming—to create avatars that are truer to reality. It would also be an easy way to introduce computer graphics into home movies, and a quick way to throw together a 3-D animation using a cast of real people—say, at the family gathering at Thanksgiving.

The 3-D puppet project out of the Visualization Labs at UC Berkeley is also likely to win big points from kids, but parental guidance is advised. Like the KinEtre creators, they specialize in 3-D animation for folks who aren’t CG whizzes. A puppet is scanned into the system (captured using ReconstructMe software). The puppet is recognized when it wanders into the field of the camera’s vision, and the software has the ability to ignore the puppeteer’s hand. The puppets are identified, their orientation and position detected, and their images rendered in a virtual storyland, all in real time.

A few perks: the system allows you to change the position of the “camera” looking on the scene you created, and also allows light to be turned up and turned down. For anyone interested in a hands-on experience, the team recently made the source code for their setup available for free.

Keep Reading

Most Popular

transplant surgery
transplant surgery

The gene-edited pig heart given to a dying patient was infected with a pig virus

The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.

Muhammad bin Salman funds anti-aging research
Muhammad bin Salman funds anti-aging research

Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging

The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.

Yann LeCun
Yann LeCun

Yann LeCun has a bold new vision for the future of AI

One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.