Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Christopher Mims

A View from Christopher Mims

MapRejuice Is SETI@Home on Steroids

Millions of Web surfers have spare computer cycles–why not use browsers to tap them?

  • September 3, 2010

Unless a flash ad in one of your open browser tabs has gone rogue, it’s likely you’ve got a few spare processor cycles available on the PC you’re using to read this.

And if someone were to appropriate just a few of them – too few for you to notice – then you and all the millions of other web surfers out there could be harnessed together like some kind of gigantic insectoid computing hive mind.

The result would be one of the world’s most powerful supercomputers.

That’s the dream, anyway, of a project called MapRejuice. It’s MapReduce - the algorithm invented at Google that powers more or less all the massively parallel processing on which the web’s biggest businesses rely - but implemented in javascript. And it runs in the background of any webpage on which it’s installed.

You could be running it right now without even knowing it.

Using the spare cycles of the world’s internet-connected PCs is nothing new - SETI@Home has been doing just that in service of parsing radio signals from outer space since the late 90’s. There are also dozens of projects that use the BOINC system on which SETI@Home runs, in order to serve scientists who need cheap access to supercomputer-scale computing power to work on problems ranging from cryptography to protein folding.

But MapRejuice doesn’t require special client software, which means pitching in on giant computational problems could be as simple as leaving the appropriate browser window open.

Right now MapRejuice, which remains primarily a proof of concept, isn’t doing that much. The graph on its homepage reveals, in real time, that it’s doing about 300 jobs per minute right now.

Its ultimate capacity? Well, how many spare cycles do all the world’s internet browsers have?

If you’ve got a site that serves users who wouldn’t mind contributing a little processing power to the project, you can grab the line of code you’ll need to drop into your site’s HTML here. Or, if you’ve got a gigantic problem in need of a MapReduce cluster of nontrivial scale, sign up your project here. And if you just think it’s a cool idea, you can vote for it (it’s an entry in the node.js contest) here.

Tech Obsessive?
Become an Insider to get the story behind the story — and before anyone else.

Subscribe today
Want more award-winning journalism? Subscribe to All Access Digital.
  • All Access Digital {! insider.prices.digital !}*

    {! insider.display.menuOptionsLabel !}

    The digital magazine, plus unlimited site access, our online archive, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    Digital magazine (6 bi-monthly issues)

    Access to entire PDF magazine archive dating back to 1899

    The Download: newsletter delivered daily

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.