Technology Review - Published By MIT
Advertisement

Crowd-Sourcing the World

Continued from page 1

By Kate Greene

Wednesday, January 21, 2009

smaller text tool iconmedium text tool iconlarger text tool icon

Users would be paid either in credit to their mobile accounts or in cash, as facilitated by a service called mPesa, which allows people to send and receive currency via cell phones and use their phones to claim money at mPesa agents and post offices, says Eagle.

One technical issue that he has considered is quality control. Eagle says that he and his colleagues are developing machine-learning algorithms that can determine the accuracy of different workers' responses. Essentially, identical tasks are off-loaded to a number of workers, and if a high percentage of those come back with a particular response, then it can be assumed to be the most accurate, within a certain level of statistical confidence. Also, if a person consistently responds correctly, then the system deems her more trustworthy, providing her with more tasks, and allowing her to make more money. But Eagle admits that there are still some kinks in the system that need to be ironed out, especially for the translation and transcription tasks, whose accuracy can be somewhat subjective.

Txteagle will use a reputation system similar to one developed by a San Francisco startup called Dolores Labs that works with Amazon's Mechanical Turk. CEO Lukas Biewald says that such a system is a powerful tool for txteagle. "You don't have to make assumptions about who can do your work and who can't," he says. "It allows you to take much more risk with the people doing the job," without sacrificing overall accuracy.

Sharon Chiarella, vice president of Amazon's Mechanical Turk project, says that bringing crowd sourcing to developing nations could be a good idea. "One of the things that's powerful about this space is the promise of leveraging a worldwide workforce," she says.

But Chiarella adds that there will be some limitations. The most widely available cell phones, for instance, are generally only able to send and receive text and voice messages. This makes crowd sourcing more complex tasks, such as tagging images, impossible. "The cell-phone screen size somewhat limits the tasks that can be viable via the phone," she says. "But I think that as cell phones continue to evolve, some of those issues will go away."

Eagle agrees but says that his goal is to start small and see if the model works well enough to expand. He hopes to receive grant money that will allow txteagle to roll out the service in Rwanda, Kenya, Bolivia, and the Dominican Republic within the next year.

Comments

  • Exploiting the poor
    Trying to exploit the poor? Oh, how nice!

    This project is nothing more than a way of exploiting the poor people for few pennies.

    Also, majority of these poor people don't really speak multiple languages and they certainly don't speak them well.

    Finally, even though this article alludes to some sort of "reputation system" there's no way to check the quality of these 'translations' and when you're exploiting the poor, you'll get a lot of people trying to scam the system.

    All in all, this is a pretty poor attempt at 'helping' anyone.

    Dave
    Rate this comment: 12345

    davero
    01/23/2009
    Posts:3
    Avg Rating:
    3/5
    • Re: Exploiting the poor
      It's not exploiting the poor if their alternative is zero work and zero income. It would only be exploitation if they were forced into doing this type of work.
      Rate this comment: 12345

      john41
      01/26/2009
      Posts:1
      Avg Rating:
      1/5
      • Re: Exploiting the poor
        By that logic there would be no exploitation since you couldn't force anyone. We all know how many sweatshops are in 3rd world.

        This product, eponymously named after its creator is all about exploiting the poor.
        Rate this comment: 12345

        davero
        01/27/2009
        Posts:3
        Avg Rating:
        3/5
  • Audio Transcription
    Anyone interested in the idea of doing audio transcription using human computation should check out Audio Puzzler. The patent pending technology used there achieves highly accurate transcriptions from people playing a puzzle game as a way of crowdsourcing.

    Another tack on this problem is the Audio reCAPTCHA project, which uses spoken audio captchas as a way of gathering transcriptions of old radio programs.

    Rate this comment: 12345

    Hoenikker
    01/23/2009
    Posts:1
    Avg Rating:
    3/5
  • Twitrans
    Twitrans has similar service, human translators of tweets
    http://twitrans.onehourtranslation.com/

    and it is free ...
    Rate this comment: 12345

    daves9400
    02/07/2009
    Posts:1
  • Great Article!
    Ms. Greene,

    We cite your article in a blog post on our site about Nathan Eagle's efforts in Africa:

    Beyond Txt | Crowdsourcing With txteagle

    Thank you!

    -Jon @ ALTA
    Rate this comment: 12345

    AltaTranslat...
    02/18/2009
    Posts:1

Resources

Events

Log In

Forgot your password?     Register »
Advertisement

Videos

The Marcellus Shale Gas Rush
Technology Review November/December 2009

Current Issue

Natural Gas Changes the Energy Map
The United States has vast supplies of this cleaner fossil fuel. But how should we use it?
Advertisement
Advertisement
Subscribe to Technology Review's daily e-mail update. Enter your e-mail address

TECHNOLOGY RESOURCES

More Technology News from Forbes

Advertisement
MIT Massachusetts Institute of Technology © 2009 Technology Review. All Rights Reserved.