Skip to Content

Computers that observe facial expressions could personalize online communications, make video games more interactive, and read lips to help recognize speech. But facial expressions change so quickly and unpredictably that computers have trouble keeping up. At Tsinghua University in Beijing, China, computer scientist Guangyou Xu has developed software that takes video of a person’s face and traces an accurate outline of the lips from frame to frame. Xu first trained a computer to draw the 2-D outline of a goldfish swimming back and forth in a bowl; from this, he developed an algorithm that represents the complex motion of lips using just a few mathematical parameters. That enables the computer to learn the lips’ typical range of movement, so it can distinguish them from other features, like teeth, more accurately than current techniques. Xu is in discussions with companies to commercialize the software, which could be used to make video games and online chat rooms more vivid and, eventually, to analyze surveillance video.

Keep Reading

Most Popular

AV2.0 autonomous vehicles adapt to unknown road conditions concept
AV2.0 autonomous vehicles adapt to unknown road conditions concept

The big new idea for making self-driving cars that can go anywhere

The mainstream approach to driverless cars is slow and difficult. These startups think going all-in on AI will get there faster.

biomass with Charm mobile unit in background
biomass with Charm mobile unit in background

Inside Charm Industrial’s big bet on corn stalks for carbon removal

The startup used plant matter and bio-oil to sequester thousands of tons of carbon. The question now is how reliable, scalable, and economical this approach will prove.

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

AGI is just chatter for now concept
AGI is just chatter for now concept

The hype around DeepMind’s new AI model misses what’s actually cool about it

Some worry that the chatter about these tools is doing the whole field a disservice.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.