Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Will Knight

A View from Will Knight

Twitter’s Success Offers Hope for Crafty Human Brainpower

The way humans assist Twitter’s search and advertising algorithms shows that machines still need a helping hand in some important areas.

  • November 7, 2013

Twitter’s listing on the NYSE arguably reflects renewed faith in human traders after Facebook’s error-strewn debut on the more heavily computerized NASDAQ in May 2012. But there’s another, more subtle, reason why Twitter’s success should warm the hearts of those of us who still exist in meat-space: Twitter’s search and advertising system relies on human computers as well as Big Data algorithms.

Human help: The original Mechanical Turk

Here’s how that works. When there’s a sudden surge in activity related to a new word or phrase, Twitter’s software collect those strings so that they can be searched for, or matched with ads, but it also automatically feeds them to humans workers to attach appropriate meaning. These workers are employed via Amazon’s Mechanical Turk, a crowdsourcing platform that allows hard-to-compute tasks to be divided up and allocated to humans (the service was named after the chess-playing “automaton” pictured above, which defeated its opponents not using ingenious engineering but thanks to a skilled human player concealed beneath the chess board).

Twitter requires human help because new information often emerges rapidly, and the meaning of that information may be complex, convoluted, and entangled in real-world context. A great example is the phrase #bindersfullofwomen, which gained momentum during the second presidential debate last July. Algorithms that might normally help you find relevant tweets—or might automatically serve relevant advertisements—by looking for clearly relevant strings such as “#Obama,” “#Romney,” “#PresidentialDebate,” simply cannot make sense of this kind of information. Algorithms might match tweets referencing #bindersfullofwomen to ads for Staples of Office Depot, but humans who just watched the debate should know better.

This trend may turn out to be an important in other areas, especially since some experts predict that increased automation will destroy many more jobs than it creates in certain sectos (see “How Technology is Destroying Jobs”).

It’s a trend that I first became aware of in robotics, where some researchers have found that combining human workers abilities with those of robots can be more efficient than using either humans or robots alone (see “Smart Robots Can Now Work Right Next to Auto Workers” and “This Robot Could Transform Manufacturing”).

How human abilities could be merged with information technologies is an even more fascinating to consider. And it’s an idea that actually stretches back for decades, gaining prominence through a paper called “Man-Machine Computer Symbiosis”, published by J. C. R. Licklider. It’s also the subject of a new book by the technology journalist Clive Thompson, “Smarter Than You Think”. For some thoughtful perspective, check out this article in The New York Review of Books by chess legend Garry Kasparov, in which he describes so-called Advanced Chess, where games are held between humans and computer programs working together.

The big question is, will more sophisticated, lucrative, and rewarding, ways of combining human and machine intelligence emerge? If they do, then Twitters hidden army of human helpers could perhaps point to a valuable long-term technological trend.

Learn from the humans leading the way in Connectivity at EmTech Next. Register Today!
June 11-12, 2019
Cambridge, MA

Register now
More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe to MIT Technology Review.
  • Print + All Access Digital {! insider.prices.print_digital !}* Best Value

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivery each weekday to your inbox

    The MIT Technology Review App

  • All Access Digital {! insider.prices.digital !}*

    {! insider.display.menuOptionsLabel !}

    The digital magazine, plus unlimited site access, our online archive, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    Digital magazine (6 bi-monthly issues)

    Access to entire PDF magazine archive dating back to 1899

    The Download: newsletter delivery each weekday to your inbox

  • Print Subscription {! insider.prices.print_only !}*

    {! insider.display.menuOptionsLabel !}

    Six print issues per year plus The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Print magazine (6 bi-monthly issues)

    The Download: newsletter delivery each weekday to your inbox

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.