How Facebook uses machine learning to fight ISIS and Al-Qaeda propaganda
Facebook claims to have proactively found and removed 99% of terrorist-related content on the site for the past three quarters. It’s given some insight into its processes in a blog post.
Some statistics: First it’s important to note that when it says “terrorism,” Facebook is referring only to ISIS and Al-Qaeda. On average, the firms claims it now removes terrorist content less than two minutes after it’s posted, versus the average of 14 hours it took earlier this year. Facebook took action on 9.4 million pieces of content in Q2 2018, a figure that declined to 3 million in Q3 2018, thanks to its efforts the quarter before, it said.
Detection systems: Facebook has launched a new machine-learning tool that assesses whether posts signal support for ISIS or Al-Qaeda. It produces a score indicating how likely it is that it violates their counterterrorism policies, with the ones that receive higher scores passed to its human reviewers to assess. For the highest-scored cases, posts are removed automatically. In the “rare instances” employees find the possibility of imminent harm, Facebook immediately informs law enforcement, it said.
Release the bots: Clearly, Facebook is keen to look tough on terrorism. And as always, it is relying almost exclusively on algorithms to do that. That makes a lot of sense from its point of view, as humans could never scan that much information that quickly (and they’re expensive). But it is yet another reminder of Facebook’s role as judge, jury, and executioner on the information it lets us see.
Keep Reading
Most Popular
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
How Rust went from a side project to the world’s most-loved programming language
For decades, coders wrote critical systems in C and C++. Now they turn to Rust.
Design thinking was supposed to fix the world. Where did it go wrong?
An approach that promised to democratize design may have done the opposite.
Sam Altman invested $180 million into a company trying to delay death
Can anti-aging breakthroughs add 10 healthy years to the human life span? The CEO of OpenAI is paying to find out.
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.