Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Christopher Mims

A View from Christopher Mims

How Six Degrees of Kevin Bacon Unearthed Lost Photos From American Graffiti

A combination of crowdsourcing and machine intelligence just found a lost treasure in the Magnum Photo archive, a technique that could have wide application

  • June 20, 2011

Magnum Photos, possibly the most famous and valuable photographer-owned collection on the planet, knew it had “lost” images from the set of American Graffiti, George Lucas’s first film. It also knew that the way to find them was to get humans to start tagging every image in their archive. Problem is, they couldn’t trust the Amazon Mechanical Turkers to whom they were crowdsourcing the tagging of their archives to be able to recognize images from the set of that movie.

One of the “lost” images from American Graffiti, as featured in a piece from the latest issue of WIRED

That’s where a machine with a pre-programmed (by humans) “semantic graph” comes in, says Panos Ipeirotis, a professor at NYU. Much like IBM’s Jeopardy-winning software Watson, this system had a map of the relationships between different phrases. It’s a bit like the game six degrees of Kevin Bacon, in which players try to leap from one actor to Kevin Bacon by tracing the links between them in the form of movies in which actors have both appeared.

At the intersection of the tags for the actors that appeared in the photographs being processed by crowdsourced human labor was American Graffiti. It was the only movie in which all of these actors had appeared, so it sat at the center of the semantic map connecting them.

In other words, humans plus machines accomplished something that neither could have accomplished on their own for a reasonable cost.

Many, many media companies have large volumes of material which is inadequately tagged with metadata, if it’s even tagged at all. The solution that Tagasauris applied to the Magnum photo archive could probably help unlock treasures in the archives of any company with a sufficiently deep archive.

The latest Insider Conversation is live! Listen to the story behind the story.

Subscribe today
Already a Premium subscriber? Log in.
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Online Only.
  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.