ZAO, a viral Chinese app that uses AI to face-swap users and famous actors, is now embroiled in a major privacy controversy.
The news: On Friday, a new app released by Momo, a social-media developer, instantly went viral on Chinese social media. It allows users to upload a single portrait and, within seconds, see their face superimposed onto actors in iconic movie scenes. By Sunday, it had become the most downloaded free entertainment app in China’s Apple Store.
AI fakery: It’s the latest—and perhaps most impressive—application of generative adversarial networks, or GANs, the AI algorithms behind deepfakes. While GANs have been used for face-editing and face-swapping before (increasingly so in Hollywood films), ZAO’s use of a single photo, coupled with the speed and seamlessness of its swap, demonstrates how far the state of the art in media fakery has advanced.
The controversy: Within hours of its release, ZAO began to spark privacy concerns, specifically over a clause in the user agreement that gave developers the right to use all uploaded photos for free in perpetuity. It also allowed them to transfer that right to any third party without user permission. Legal experts in China said that wasn’t legal, and by Saturday, the app’s developer had caved under pressure and removed the clause. WeChat, China’s top social-networking app, also banned any sharing of footage or photos from ZAO.
Déjà vu: The episode replayed a similar controversy over FaceApp, a photo-editing app that went viral in July. The app also used GANs to retouch people’s portraits and had amassed over 150 million photos of faces since its launch. ZAO received a much quicker and sharper backlash, but it too had likely already been used by millions of users by the time it revised its policy. On one hand, the frequency of such incidents shows how easily a user’s personal data can now be co-opted and repurposed beyond his or her control. On the other, it shows that people have also become more sensitive to privacy and are less willing to give it up without a fight.
To have more stories like this delivered directly to your inbox, sign up for our Webby-nominated AI newsletter The Algorithm. It's free.
DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.
“This is a profound moment in the history of technology,” says Mustafa Suleyman.
Deepfakes of Chinese influencers are livestreaming 24/7
With just a few minutes of sample video and $1,000, brands never have to stop selling their products.
AI hype is built on high test scores. Those tests are flawed.
With hopes and fears about the technology running wild, it's time to agree on what it can and can't do.
You need to talk to your kid about AI. Here are 6 things you should say.
As children start back at school this week, it’s not just ChatGPT you need to be thinking about.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.