Skip to Content
Policy

Logan Paul’s Video Is a Cautionary Tale for Platforms That Hope AI Will Save Them from Offensive Content

January 3, 2018

YouTube star Logan Paul (if you’re not familiar, he has 15 million subscribers) uploaded a video on the platform over the weekend in which he appeared to make jokes in front of a body hanging from a tree during a visit to forest in Japan where people have been known to commit suicide. The footage amassed over six million views before Paul took it down.

Why it matters: Paul’s video was not caught by any of YouTube’s software or human filters, making it a prime example of content that should never have been allowed into wide distribution but that nonetheless eluded state-of-the-art artificial-intelligence systems. “What is obscene is having shown and been disrespectful about the body of a suicide victim,” Tarleton Gillespie, principal researcher at Microsoft Research, told Buzzfeed. “This is the kind of contextual and ethical subtlety that automated tools are likely never to be able to approximate.”

Going forward: The incident shows that despite efforts by Facebook and YouTube to use AI to fight objectionable content, the content moderation issue isn’t going to be solved by applying a bit of software.

Deep Dive

Policy

Is there anything more fascinating than a hidden world?

Some hidden worlds--whether in space, deep in the ocean, or in the form of waves or microbes--remain stubbornly unseen. Here's how technology is being used to reveal them.

A brief, weird history of brainwashing

L. Ron Hubbard, Operation Midnight Climax, and stochastic terrorism—the race for mind control changed America forever.

Africa’s push to regulate AI starts now        

AI is expanding across the continent and new policies are taking shape. But poor digital infrastructure and regulatory bottlenecks could slow adoption.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.