Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Read My Lips

Computers that observe facial expressions could personalize online communications, make video games more interactive, and read lips to help recognize speech. But facial expressions change so quickly and unpredictably that computers have trouble keeping up. At Tsinghua University in Beijing, China, computer scientist Guangyou Xu has developed software that takes video of a person’s face and traces an accurate outline of the lips from frame to frame. Xu first trained a computer to draw the 2-D outline of a goldfish swimming back and forth in a bowl; from this, he developed an algorithm that represents the complex motion of lips using just a few mathematical parameters. That enables the computer to learn the lips’ typical range of movement, so it can distinguish them from other features, like teeth, more accurately than current techniques. Xu is in discussions with companies to commercialize the software, which could be used to make video games and online chat rooms more vivid and, eventually, to analyze surveillance video.

Want more award-winning journalism? Subscribe to Insider Basic.
  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Print Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.