Web

Pennies for Web Jobs

Amazon wants to employ people to do menial Web tasks that computers can't handle.

  • Wednesday, March 8, 2006
  • By Sam Williams

Speaking to a room filled with Internet developers at the O'Reilly Emerging Technology Conference in San Diego this week, Luis Felipe Cabrera, Amazon's vice president of software development, outlined a project to harness human intelligence for tasks that computers can't handle well, such as recognizing objects in images.

The backbone of the plan is a Web-services platform called Mechanical Turk. It uses an auction-style system to farm out complex tasks -- complex for a computer, that is -- such as recognizing the difference between a human face and a nearby bush, or accurately transcribing an audio recording. Cabrera likes to call the platform "artificial artificial intelligence" -- it's computers asking humans to do tasks, rather than the other way around.

Advertisement

To illustrate the idea, Cabrera cited a test in which A9.com, Amazon's search engine, asked average users to fulfill "human intelligence tasks" (HITs) -- jobs that computers are notoriously bad at doing, such as picking out one building or business within a photograph of a city block in order to highlight that part of the image in association with a business address.

Not only did participants supply the necessary answers, but they did so "outstandingly fast," according to Cabrera, allowing Amazon to use the photographs in its search results. "This is the tip of the iceberg, but you can see how it enables 'massively parallel' human computing," he said.

Of course, there's a keen irony in all this. At a conference-cum-show dedicated to technology-based solutions, Amazon's Mechanical Turk is an allusion to the famous exhibit in the 1760s, by Hungarian showman Wolfgang von Kempelen, in which a chess-playing automaton, known as The Mechanical Turk, was dressed like a Turkish pasha. It wowed royal audiences -- and even won a few notable chess battles. And it was a complete fake. Von Kempelen, a century before P.T. Barnum, had simply hidden an undersized chess master within the machine, along with pulleys, gears, and other faux-mechanical props.

While Amazon's use of the name might suggest a betrayal of the concept of artificial intelligence (AI), it's actually the latest in string of experiments dealing with the complementary nature of machine and human intelligence.

Two of the best-known AI applications are Google's PageRank algorithm, which counts each human-initiated inbound link to a site as a "vote" for that site's content quality, and Amazon's recommendation system, which uses algorithms to seek out patterns in customer purchase data to market books and other products to customers whose purchase decisions fit the same pattern.

A more recent example is exemplified by sites like Flickr and del.icio.us, which use human-supplied keywords, or tags, to summarize complex information, such as the thematic content of a photographic image or the functional purpose of a website.

But, unlike this methodology, which depends on users generating information without any compensation, Amazon's Mechanical Turk will pony up cash to anyone willing to complete the tasks they want to farm out. Most of the tasks ask people to do little more than, say, match the address and owner in a real-estate title listing or indicate that a photograph is a man or woman -- and they earn mere pennies for each one.

Print

Close Comments

To comment, please sign in or register

Forgot my password

Guest (Louis Chua)

  • 2169 Days Ago
  • 03/08/2006

Matrix, The Pre-quel

This is how it all starts...
Humans being harvested to do "massively parallel human processing". Way cool.

Reply

Guest (Richard Tedrow)

  • 2169 Days Ago
  • 03/08/2006

Pennies for Web Jobs

Required reading for [1] those who ever wondered how the machines might take over and [2] for all who think linquistic spinisms are limited to the present administration and Madison Ave.

Reply

Guest (Bill)

  • 2169 Days Ago
  • 03/08/2006

Pennies for Web Jobs

This is reminiscent of Kurt Vonnegut's classic "Player Piano".  He was an apocalyptic visionary.

Reply

Guest (Mr Ludd)

  • 2152 Days Ago
  • 03/25/2006

Humans aren't worth much

You would think having a neural cortex a computer and a connection to the internet would be worth more than pennies an hour. This is the begining of digial slavery and worse than the McJobs of the new service economy. I urge people to sign up at Mturk.com and give lousy answers.  If enough people do this we can kill the idea in it's infancy.

Reply

Guest (lester smith)

  • 2169 Days Ago
  • 03/08/2006

Pennies for Web Jobs

I would like more information and I am intrested in participating. Please send information to: lesnsmith@yahoo.com or Lester N. Smith p.o. Box 132,Borden,Ind.47106 .Thanks,Les N 

Reply

Guest (Gabe)

  • 2169 Days Ago
  • 03/08/2006

who will participate?

...if they only pay you pennies, why the hell would you do it?...perhaps people from the 3rd world will do these jobs, when they finally receive their $100 laptops from MIT :) It is going to be cyberslavery.

Reply

Guest (Kempelen:))

  • 2169 Days Ago
  • 03/08/2006

correct spelling

the showman's name is misspelled in the article. it is not Kemepelen - it's Kempelen.

Reply

Advertisement

Guest (abinesh)

  • 2167 Days Ago
  • 03/10/2006

more information please

I would like more information and I am interested in participating. Please send information to:
abinesh_td@yahoo.co.uk

Reply

Guest (John Woodward)

  • 2165 Days Ago
  • 03/12/2006

piss poor interface - infancy

On a lark, I did give it a try.

Simple human task of locating and reading a 5 digit number ink stamped onto some sort of tax form.

I expected to be able to do dozens per minute, if not 1 per second.

Unfortunately, the interface provide was incredibly akward and cumbersome, making 1 per minute a more realistic rate.

At 1¢ per number, 60¢ / hour probably isn't going to get many takers.

With a real, tuned interface, +/- $10 / hour might not be a bad pay rate for high school kids.

Seemed more like a perserverance contest, rather than a bona fide "human intelligence task".

I received no response from my email pointing out the crushing interface deficiencies.

Seems they got the task done, despite the 1¢ per piece rate and abominable inteface.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Videos

A Social-Media Decoder

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Google

Silver Spring Networks

First Solar

Twitter

More

Advertisement

Facebook

Advertisement