Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Intelligent Machines

Digital Summit: First Emotion-Reading Apps for Kids with Autism

Software meant to help people interpret emotions will soon be available in several apps.

People with autism have difficulty reading the emotions of people around them.

The first mobile apps that use emotion-reading software to help kids with autism are nearing release, a startup reported today at the MIT Technology Review Digital Summit in San Francisco.

Rana el Ktk
Emo-app: Rana el Kaliouby says the first apps that use facial emotion-reading software are coming soon.

One of the apps is a game that challenges kids to match a face to the emotion it is projecting, said Rana el Kaliouby (see “Innovators Under 35: Rana el Kaliouby”), chief science officer of Affectiva, which is based in Waltham, Massachusetts. Another will allow people to submit face pictures, such as “selfies,” and get a readout on the mood of the person in the photo. This could be used to for social sharing of people’s moods in different locations. A third, intended for anyone, would allow people to make music with facial expressions: raise or lower eyebrows to make a tone rise or fall, or smile or frown to make music that sounds happy or sad.

Affectiva grew out of emotion-detecting research at MIT’s Media Lab. The company’s software, called Affdex, analyzes images of faces to detect features such as smiles, frowns, raised eyebrows, furrowed brows, and smirks. Though the early academic research focused on applications such as helping people with autism, so far the technology has been used commercially to help marketers understand whether ads are effective (see “Startup Gets Computers to Read Faces, Seeks Purpose Beyond Ads”).

Then, last year, the company released the software to app writers for iOS, the operating system used in iPhones and iPads. And now the first apps are coming, said el Kaliouby. “Autistic kids have trouble reading and understanding social and emotional cues,” she said. “Just as people with hearing problems benefit from a hearing aid, people with social and emotional problems can benefit from systems that help them understand emotions. We started out with research on autism, and we went out and did this commercial stuff.”  But now, she says, others “can take it and apply it back to autism again.”

The advertising work helped make the software more accurate by “training” it, she added. After three years analyzing faces seen on webcams, Affectiva’s database now holds more than a billion facial expressions. 

Want to go ad free? No ad blockers needed.

Become an Insider
Already an Insider? Log in.
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    Print + Digital Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

    Technology Review PDF magazine archive, including articles, images, and covers dating back to 1899

    10% Discount to MIT Technology Review events and MIT Press

    Ad-free website experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Print Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.