Critics are condemning Facebook for not taking down a video of House Speaker Nancy Pelosi that was slowed to make her seem drunk. But some experts argue that removing the video might have set a precedent that would actually cause more harm.
The video makes Pelosi look strange, but it’s not a “deepfake”—it doesn’t falsely show her saying anything she didn’t actually say. It’s an example of what MIT Media Lab researcher Hossein Derakhshan calls “malinformation,” or basically true information that has been subtly manipulated to harm someone.
And while Derakhshan thinks it might have been okay to take down a faked video that showed Pelosi making a racial slur, for example, he argues that it’s too much to expect platforms to police malinformation. “Usually when people do these manipulations, I don’t think it’s illegal,” he says. “So there’s no ground for removing them or requesting them to be taken off these platforms.”
It’s easy to imagine creating a rule like “Take down false examples of hate speech,” but far harder to come up with a rule that requires taking down the Pelosi video but not other forms of mockery, satire, or dissent.
Political mockery, after all, often uses information out of context and comes with intent to harm. An overly broad rule could backfire in authoritarian countries, according to Alexios Mantzarlis, a fellow at TED studying misinformation, who previously helped launch Facebook’s partnerships with fact-checkers.
“My position here is that that this does not seem to cause someone real-life harm, and that once we start taking things down, the precedent might be slippery, especially [for] politicians,” he says. It’s not hard to imagine Facebook being pressured into taking down a video making fun of someone like Brazil’s Jair Bolsonaro, or Donald Trump.
That doesn’t mean that there’s never a reason to take down videos (Mantzarlis says he’s not a free speech absolutist)— just that there are nuances when it comes to the types of manipulation, the potential for harm, and what platforms should do.
In any case, “leave it up” or “take it down” are not the only options. The platform did flag the video with warnings from fact-checking organizations, but Mantzarlis tweeted four other ways Facebook could have taken action more effectively.
For instance, the the video could have been flagged more quickly, or more prominently—unless you try to share the video, you see only a subtle warning that its authenticity is in doubt. Facebook could also, Mantzarlis, suggests, invite users who shared the video to unshare or unlike, and then share the data with researchers trying to understand what works in fighting the spread of manipulated media.
“This is the largest real-life experiment in combating digital misinformation in history,” he says, “and so the wealth of knowledge that this could generate and provide to researchers and other practitioners fighting misinformation would be really extraordinary.”
Derakhshan agrees that it’s important to label videos that have been fabricated in some way, but he suggests that the best solution is nurturing media literacy. As we deal more and more with images, it’s important to teach people to be skeptical of videos, in the same way it’s now common to wonder if an image has been Photoshopped. “Everybody should always think about the possibility of facing fabricated video,” he says.
How the Supreme Court ruling on Section 230 could end Reddit as we know it
As tech companies scramble in anticipation of a major ruling, some experts say community moderation online could be on the chopping block.
2022’s seismic shift in US tech policy will change how we innovate
Three bills investing hundreds of billions into technological development could change the way we think about government’s role in growing prosperity.
Mass-market military drones: 10 Breakthrough Technologies 2023
Turkish-made aircraft like the TB2 have dramatically expanded the role of drones in warfare.
We’re witnessing the brain death of Twitter
An analysis of Musk’s tweets shows him at the center of conversations once kept on the fringes of Twitter.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.