Skip to Content

Can Kinect Help Detect Autism?

And if so, is there anything it can’t do?
May 11, 2012

At the University of Minnesota’s Institute of Child Development in Minneapolis, Microsoft’s Kinect is being put to a novel use: detecting autism. New Scientist reports that researchers have equipped a nursery with five Kinect cameras, which, together with computer vision algorithms that can detect unusual behavior, may be able to speed the diagnosis of autism.

How exactly does the system work? The Kinects can ID individual children based on their shape and clothing. Monitoring these children, the Kinects feed their data to a series of PCs with software that can track the kids’ activity levels, comparing them against an average. If a given child is either more or less active than average, he or she might have autism. Then again, he or she might just be tired, or hyper, which is why at that point an old-fashioned human doctor will have to weigh in on the matter.

“The idea is not that we are going to replace the diagnosis, but we are going to bring diagnosis to everybody,” one of the researchers, Guillermo Sapiro, told New Scientist. “The same way a good teacher flags a problem child, the system will do automatic flagging and say, ‘Hey, this kid needs to see an expert’.”

This is one of the extreme instances of what Microsoft has termed “the Kinect Effect,” the tendency of people outside of Redmond to come up with novel uses for a technology originally intended simply for gaming. (It was an effect documented well before Microsoft decided to condone and, smartly, co-opt it.) Sapiro and colleagues will present their system at the forthcoming IEEE International Conference on Robotics and Automation in St. Paul.

Sapiro et al. hope to bring their novel use of the Kinect even further, perhaps automating some of what Sapiro calls the “very difficult and expert analysis that a psychiatrist would do.” Sapiro’s team has already developed computer-vision algorithms that can detect more subtle indicators of autism spectrum disorders, like a child’s ability to follow an object with his eyes. Perhaps some day, a Kinect-powered video game could both entertain a child while testing him for a disorder.

New Scientist doesn’t make clear whether Sapiro’s projects have official Microsoft approval, but Microsoft has endorsed at least one other project in which Kinect is used to treat children with autism, as evidenced by this video from last year.

BBDO and Autism Speaks also used Kinect for a bit of autism-related advocacy. In an effort to raise awareness about the challenges of parenting a child with autism, BBDO built an interactive Kinect-powered installation featuring a virtual girl who simply refused to look users in the eye.

I’m unsure whether the proliferation of autism-related Kinect hacks says something profound about the nature of motion-sensing its connection to autism spectrum disorders, or whether it’s simply an indication of the ways in which Kinect hacks increasingly touch on every aspect of modern life. After all, autism certainly isn’t the only medical condition people have tried to ameliorate, detect, or treat with Microsoft’s transformative technology.

Keep Reading

Most Popular

This new data poisoning tool lets artists fight back against generative AI

The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models. 

Rogue superintelligence and merging with machines: Inside the mind of OpenAI’s chief scientist

An exclusive conversation with Ilya Sutskever on his fears for the future of AI and why they’ve made him change the focus of his life’s work.

Data analytics reveal real business value

Sophisticated analytics tools mine insights from data, optimizing operational processes across the enterprise.

Driving companywide efficiencies with AI

Advanced AI and ML capabilities revolutionize how administrative and operations tasks are done.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.