Skip to Content
Artificial intelligence

Facebook says it’s going to use machine learning to catch revenge porn

March 15, 2019

That Facebook thinks it can tackle the problem in this way shows how just powerful its ability to identify people with AI has become.

The news: Facebook announced today that it will use machine learning to detect and block nude or near-nude images and videos that have been shared without permission—before they have even been reported. Revenge porn (the sharing of sexual videos of someone, usually a past partner, without consent) has become a serious problem, with devastating consequences for victims. Facebook also says it will overhaul the process by which victims can report unapproved images. 

Face time: Facebook didn't say exactly what sort of machine learning it was going to use, but it has an almost unparalleled ability to identify people in images, thanks to a vast corpus of labeled training data supplied by its own users.

Training sets: Although many users are unaware, social-media photos are widely used to train machine-learning algorithms. The state-of-art programs are often now better than humans at recognizing people in snaps.

Coming threat: New detection technology could become especially important as it becomes ever easier to generate convincing-looking fake video with AI. The rise of easy-to-use face-swapping software has already led to a proliferation of fake celebrity porn and other weird video mashups.

Silver bullets: The Facebook effort is a worthwhile use of machine learning, but AI is no silver bullet for dealing with harassment, abuse, or fake news on social media (regardless of what Mark Zuckerberg might tell Congress). Humans will always find ways to outwit the best algorithms. Besides that, the problem sadly extends far beyond the walls of Facebook.

Sign up here to our daily newsletter The Download to get your dose of the latest must-read news from the world of emerging tech.

Deep Dive

Artificial intelligence

chasm concept
chasm concept

Artificial intelligence is creating a new colonial world order

An MIT Technology Review series investigates how AI is enriching a powerful few by dispossessing communities that have been dispossessed before.

open sourcing language models concept
open sourcing language models concept

Meta has built a massive new language AI—and it’s giving it away for free

Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3

spaceman on a horse generated by DALL-E
spaceman on a horse generated by DALL-E

This horse-riding astronaut is a milestone in AI’s journey to make sense of the world

OpenAI’s latest picture-making AI is amazing—but raises questions about what we mean by intelligence.

labor exploitation concept
labor exploitation concept

How the AI industry profits from catastrophe

As the demand for data labeling exploded, an economic catastrophe turned Venezuela into ground zero for a new model of labor exploitation.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.