Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Data Dystopia

Facebook’s power over our social lives comes with great ­responsibility.

Dystopias in the 20th century came mostly in two flavors: the imposing surveillance state, as depicted in Orwell’s 1984, and the stupefying pleasure dome, as in Huxley’s Brave New World. What if these were not separate nightmares? The real threat could be surveillance in the service of seduction rather than punishment.

Facebook is so successful because it helps us fulfill the urge to remain connected to one another. That urge has led about a billion of us to provide a single company with imprints of a sizable part of our social lives (see “What Facebook Knows”).

This story is part of our July/August 2012 Issue
See the rest of the issue
Subscribe

As a social scientist, I’m terribly excited by this data trove, because it’s a great resource for studying the human animal. Emerging “big data” sources—Facebook is one of the best—have the potential to contribute to our understanding of society. But this information has uses that go beyond targeting ads. Though the prospect doesn’t seem to faze Facebook users so far, it could be used to target civic, political, and social messaging in ways that are unhealthy for democracy.

Political campaigns, for example, now encourage voters to connect with their Facebook apps or pages, which can access in-depth data about not just a person but his or her social networks and interactions. This creates opportunities for profiling at unprecedented precision and scale. I am waiting for the first wave of vicious negative political campaigning on Facebook. (Most of us might not even notice it, since it could be narrowly targeted to a receptive niche, or even to individuals.)

The way Facebook uses its collected data can influence our social interactions. Facebook’s news feed does not show all updates, or even the most recent, but rather what Facebook thinks will make you click or comment. News-feed algorithms create spirals of reinforcement for certain behaviors. The details are secret, but reverse-engineering shows that Facebook thinks photos generate more engagement than text; updates with them are featured more prominently, leading to even more engagement. Even without explicit instruction, people will undoubtedly pick up on these cues and start posting ever more photos. In other ways, too, Facebook may be guiding how we socialize. Perhaps cheery posts get more prominence. Perhaps we will one day learn of a suicide following a brief, cryptic status update that no one responded to because Facebook downgraded it on people’s news feed upon judging it not to be the kind of post that generates clicks.

I do not claim there are easy answers to the questions Facebook raises. Any algorithm for the news feed would have its downside. But the questions are important because Facebook occupies an important civic niche. Decisions about how it uses its hoard of data, what it makes public, and how much access it gives political and corporate campaigns will affect us all. We need to be talking not just about the potential of this awesome data store but about the power the company has and the ethics it upholds.

Zeynep Tufekci is an assistant professor at the University of North Carolina and a fellow at the Berkman Center for Internet and Society at Harvard.

Get stories like this before anyone else with First Look.

Subscribe today
Already a Premium subscriber? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.