Christopher Mims

A View from Christopher Mims

Software Better at Detecting Frustration Than Humans

And it’s not because subjects have been trained to “smize”.

  • May 24, 2012

Did you know that you smile when you’re frustrated? Starting at 1:20 in the video below, witness a behavior that you may find novel – and doubly so because you’re a human being who is exquisitely tuned to reading the emotional expressions of others.

M. Ehsan Hoque of the MIT Media Lab (right) demonstrates the “frustration smile”

By training a feature-detecting algorithm to decompose subjects’ facial expressions into individual “action units,” M. Ehsan Hoque of the MIT Media Lab discovered not only that smiling is quite common when test subjects are frustrated, but also that software is better than humans at differentiating frustration smiles from happiness smiles.

“For frustrated smiles, humans performed below chance, whereas the algorithm did better than 90 percent,” says Hoque.

Subjects’ frustration smiles included activation of the groups of facial muscles known as action unit 12, or raising of the corners of the lips, as well as action unit 6, in which cheeks are raised.

No word on whether or not the smile detector can differentiate between real smiles and Tyra Banks’ patented “Smize.”

Become an MIT Technology Review Insider for in-depth analysis and unparalleled perspective.
Subscribe today

Uh oh–you've read all five of your free articles for this month.

Insider Premium

$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.

  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look. Exclusive early access to stories.

    Insider Conversations. Join in and ask questions as our editors talk to innovators from around the world.

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

You've read of free articles this month.