Skip to Content

Perceptive Algorithms Are Battling to Spot More of the Web’s Toxic Content

December 20, 2017

A new competition could help clean up the Internet. Kaggle, a site that lets organizations run data science competitions, just revealed its latest project, which asks competitors to build AIs that spot toxic comments.

Competitors are asked to build a system that can tackle “different types of of toxicity like threats, obscenity, insults, and identity-based hate.” Backing the competition is Jigsaw, a part of Alphabet, which runs a research initiative called Conversation AI to improve online discourse. To win the $35,000 prize on Kaggle, an entry will have to beat the results of a system built by Jigsaw, called Perspective API. Since it launched on Tuesday, 199 teams have joined the competition.

The Internet certainly could do with more, and better, tools to clean up threats and hate speech. Facebook, YouTube, and Twitter have all struggled to police such content in the past, and most big tech firms insist that AI can help them clean it up in the future. But none of them have yet nailed it, and governments are unhappy about failures to get hate speech taken down quickly.

Big tech firms are trying, though. Facebook launched a tool called Deeptext in 2016 to detect sentiment in comments in order to root out inappropriate content. It takes down about 66,000 comments a week but still has thousands of people monitoring feeds. Twitter, meanwhile, announced this week that it will be banning accounts that send threatening tweets and messages.

Perhaps the Kaggle competition will help finally crack the problem.

Deep Dive


Our best illustrations of 2022

Our artists’ thought-provoking, playful creations bring our stories to life, often saying more with an image than words ever could.

How CRISPR is making farmed animals bigger, stronger, and healthier

These gene-edited fish, pigs, and other animals could soon be on the menu.

The Download: the Saudi sci-fi megacity, and sleeping babies’ brains

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. These exclusive satellite images show Saudi Arabia’s sci-fi megacity is well underway In early 2021, Crown Prince Mohammed bin Salman of Saudi Arabia announced The Line: a “civilizational revolution” that would house up…

10 Breakthrough Technologies 2023

Every year, we pick the 10 technologies that matter the most right now. We look for advances that will have a big impact on our lives and break down why they matter.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.