Help for Autism

A new device teaches the interpretation of facial cues

You know the looks–the stare that says “I’m bored” or the smile that means “Keep talking.” But many people with autism struggle to read the silent cues that tell us how to behave in conversation. Those who miss such cues may act inappropriately–for instance, droning on when it’s time to stop talking, says Rana el Kaliouby, a postdoctoral associate at MIT’s Media Lab. With colleagues Alea Teeters, a grad student, and Professor Rosalind Picard, el Kaliouby is developing a teaching tool to help.

Rana el Kaliouby and her camera. (Courtesy of Rana el Kaliouby)

The prototype of the ESP, or emotional­-­social intelligence prosthesis, consists of a small neck-mounted camera and a belt-mounted computer. Autistic people could use the device to learn about faces by watching themselves.

During conversation, the “self-cam” films the wearer’s face. The computer analyzes eye, eyebrow, mouth, and head movements and infers what they mean. It then produces a graph indicating when the wearer appears to be concentrating, thinking, agreeing, disagreeing, or expressing interest or confusion. The user can download the videos and watch them alongside the graphs.

Recording others’ faces may also be helpful, says el Kaliouby, but uninvited cameras violate others’ privacy. She says that though it is an open question whether people with autism make the same kinds of facial expressions that others do, they may learn the relationship between faces and emotions best by starting with their own. Those who feel anxious when looking at faces may feel most comfortable watching themselves. Parents and friends can also wear self-cams and offer their videos for viewing. Future versions of the system may use two self-cams, each communicating wirelessly with the other, to provide real-time instruction. One person’s ESP might send a message–“She’s losing interest”–to another person’s, which could alert its wearer with, say, a message whispered through an earphone.

The team is now testing whether its device helps high-functioning teens with autism improve their social skills over time.

The latest Insider Conversation is live! Listen to the story behind the story.

Subscribe today
Already a Premium subscriber? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

Want more award-winning journalism? Subscribe to Insider Premium.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look: exclusive early access to important stories, before they’re available to anyone else

    Insider Conversations: listen in on in-depth calls between our editors and today’s thought leaders

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.