Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Intelligent Machines

Prediction Models Gone Wild: Why Election Forecasts and Polls Were So Wrong

The polls had Clinton ahead, the real-time data said she’d walk it—here’s what they missed.

If you tuned in to Vice News Tuesday afternoon or checked out election coverage on Slate, you’d have thought Hillary Clinton was all but assured of becoming America’s first female president.

In a first, both outlets were carrying real-time data streaming in from a startup called VoteCastr, which bills itself as giving America an unprecedented glimpse of “the game as it unfolds.” VoteCastr’s last predictions, made around 9 p.m. Tuesday evening, had Clinton up in Pennsylvania, Ohio, Florida, Wisconsin, and Iowa—all of which Donald Trump ended up winning on his way to becoming president-elect.

To be sure, VoteCastr wasn’t alone. Many election forecasts based on polling, demographics, and historical data, were similarly wide of the mark. The New York Times’ Upshot model, for example, gave Clinton around an 85 percent chance of winning, while the vaunted data-driven forecasting site FiveThirtyEight gave her a 72 percent chance.

This is at least partly explained by the fact that the polls the forecasts were based on were either way off or at least were making the most of their margin of error (though if Clinton ends up winning the popular vote, as it looks like she might, you could argue that the polls got it right—they just picked the wrong winner). An underappreciation of how powerful white, working-class voters are in this country may have also contributed, as could people simply not giving honest responses when asked who they supported. This is something that the Clinton campaign, which figured her Midwest “firewall” of states were all safe, got wrong. The data team working with the Trump campaign gave him a one-in-five chance of winning.

But VoteCastr’s failure—to say nothing of its rickety technical performance throughout election day—is unique because of the claims it made. The company, which has data gurus on staff who worked on the George W. Bush and Obama campaigns, gave the impression that by paying ultra-close attention to early voting results, voters’ identities, and exit polling they could somehow derive a real-time look at the election that wasn’t available before. It was meant to be the new cutting edge in data-driven election products.

Instead, it showed itself to be a flawed, incomplete means of election-tracking—a lot like the other products out there, as it turns out.

(Read more: Politico, FiveThirtyEight, The New York Times, Bloomberg)

The latest Insider Conversation is live! Listen to the story behind the story.

Subscribe today
Already a Premium subscriber? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Basic.
  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.