Skip to Content

Software Reconstructs Famous Faces from Still Images, Captures Their Unique Mannerisms

A University of Washington team has developed virtual “Face/Off” software that lets them animate Barack Obama’s face with George W. Bush’s mannerisms, and other surreal tricks.
December 8, 2015

Today’s nightmare fodder: the disembodied faces of nine different politicians and celebrities—including Barack Obama—all in sync with the expressive quirks of former president George W. Bush. It’s as though Bush put on nine different photorealistic masks, and the effect is surreal. (The segment in question begins at 1:30 in the video.)

This video was created by a team of researchers from the University of Washington who wanted to answer the question “What makes Tom Hanks look like Tom Hanks?” To do so, they developed machine-learning algorithms that mine the Internet for images of a person and use them to create a three-dimensional reconstruction of that person’s face that captures not only features but also unique expressions and mannerisms.

They can sync one face’s “persona” to one of the re-created faces, as with the example mapping Bush’s mannerisms onto Obama’s face. But their software works in the other direction as well: to map the “performance” of one person onto another’s face while preserving the second face’s persona. As explained by coauthor and professor of computer science Steven Seitz in a press release: “How do you map one person’s performance onto someone else’s face without losing their identity? […] We’ve shown you can have George Bush’s expressions and mouth and movements, but it still looks like George Clooney.”

The team has high hopes for using the technology. What if you could build three-dimensional reconstructions of deceased loved ones to use with the incoming wave of virtual-reality technology; reconstructions that capture the gestalt of the person in question?

To me, they have a ways to go—those videos are uncanny but not quite convincing. Yet it’s an undeniably fascinating proof-of-concept. The press release makes no mention of potential applications in history or archaeology—but wouldn’t it be amazing if we could use the historical record not just to create a three-dimensional image of Abraham Lincoln but one that also captured some of his persona as well?

The team will present its latest findings at the International Conference on Computer Vision in Chile on December 16.

Keep Reading

Most Popular

open sourcing language models concept
open sourcing language models concept

Meta has built a massive new language AI—and it’s giving it away for free

Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3

transplant surgery
transplant surgery

The gene-edited pig heart given to a dying patient was infected with a pig virus

The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.

Muhammad bin Salman funds anti-aging research
Muhammad bin Salman funds anti-aging research

Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging

The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.

Yann LeCun
Yann LeCun

Yann LeCun has a bold new vision for the future of AI

One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.