Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Connectivity

Facebook Is Enlisting Human Experts and AI to Fight Terrorism

Technology alone won’t defeat the social network’s problems with extremist content.

Heightened security was put in place on the streets of New York City after London's recent terror attacks.

Following recent terror attacks, politicians criticized social networks for providing safe spaces for extremism. Now Facebook has announced that it’s developing AI and employing a team of 150 experts in order to become "a hostile place for terrorists."

Mark Zuckerberg has explained that, in his utopian vision of the future, many of the problems that his social network faces—among them violent content, child abuse, fake news, and extremism—will be eased by the development of artificial intelligence. Powerful algorithms, the theory goes, could sniff out offensive content and rogue users to shut the problems down.

But to date his vision has yet to materialize. Instead, fake news is being fact-checked by third parties and thousands of people are employed to sift through potentially offensive content. That's all for the good, but it's not the automated solution that Zuck promises.

Now, though, Facebook has described how it’s at least making use of artificial intelligence to attenuate the successes of extremist recruitment and propaganda. In an announcement, Monika Bickert, the company’s director of global policy management, and Brian Fishman, its counterterrorism policy manager, explain that the social network’s use of AI against terrorism is “fairly recent,” but argue that it’s already having an effect.

It even gives some concrete examples of what it’s doing:

  • using image recognition to identify previously removed content so that it never makes a reappearance
  • analyzing text to understand language associated with terrorism and spot propaganda
  • measuring social ties between regular and rogue users to identify recruitment activities
  • and monitoring how repeat offenders create new accounts to shut them down sooner

The big question is, of course, whether any of this will work. Other experiments using AI to solve knotty social issues online—such as Google’s bid to stamp out hate speech—haven’t come to much. A large factor is the fact that humans still often find ways to outsmart even the cleverest of AIs: in Google's case, by subverting language so that AI doesn’t identify the true meaning of a statement, for instance.

Facebook knows that to be a problem. Indeed, it says that “this work is never finished because it is adversarial, and the terrorists are continuously evolving their methods, too.”

That may be why it’s admitting that technology alone is not enough. The company has also built a team of 150 counterterrorism experts—including former academics, prosecutors, and law enforcement agents—to help contextualize content and spot real-world problems that might require intervention. It also confesses to the fact that it’s not an island, so it will continue to work with other social networks and governments to crack the problem.

By combining human insight with AI grunt work, Facebook is of course maximizing its odds of success in stamping out a problem that has plagued it for years. But only time will tell if together they’re smart enough to outwit the extremists.

(Read more: Facebook, “If Only AI Could Save Us from Ourselves,”  “Fighting ISIS Online,” “Theresa May Wants to End 'Safe Spaces' for Terrorists on the Internet. What Does That Even Mean?”)

Hear more about social networks at EmTech MIT 2017.

Register now
Heightened security was put in place on the streets of New York City after London's recent terror attacks.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.