Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Christopher Mims

A View from Christopher Mims

Building a Cloud out of Smart Phones

Google’s MapReduce algorithm turns a bunch of cell phones into a self-contained cloud computing environment.

  • August 12, 2010

Turning an entire paradigm on its head, an international group of researchers has figured out how to implement cloud computing’s most widely-used algorithm, one that’s usually deployed in giant, hugely-powerful server farms, on a couple of dozen cell phones.

The entire point of cloud computing is that offloading processor-intensive tasks from a local client - a PC or a cell phone - gives our puny local computing resources the ability to leverage hundreds of remote servers tucked away in an anonymous data center to, for example, return search results scoured from every site on the internet in something less than a half a second.

So it might seem strange that so much effort would be devoted to creating Misco, a version of MapReduce that can be handled by a “server farm” comprised of 20-odd Nokia N95 smartphones. (MapReduce was invented by Google but is now used by Yahoo, IBM, Amazon, Facebook and even has an open-source implementation called Hadoop - in a nutshell, it’s what makes the blinding speed of the response time to your web browser’s requests possible.)

The point of this exercise is to create a system that allows the MapReduce magic of distributed processing of large amounts of data to happen closer to the data itself. By eliminating the need to first transmit the data over a relatively slow wireless network, it can, in some situations, be processed even faster than if it were first uploaded, in total, to a remote server. This, despite the fact that the remote server would be much faster than the processor on any one phone.

One of the challenges of implementing MapReduce on cell phones is that in a regular server farm, the failure rate is pretty low, and the latency of a signal transmitted between any one server (node) and another is also relatively low. Not so on cell phones. This means that, among other things, as the failure rate of any one “node” in the system increases (i.e., the phone is out of range, out of commission, etc.) the speed of the Misco processing network degrades exponentially.

Even so, Misco is a pretty neat hack. A hack in search of applications, granted, but this, the researchers claim, is only the beginning.

Follow Mims on Twitter or contact him via email.

AI is here.
Own what happens next at EmTech Digital 2019.

Register now
Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    Print + Digital Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

    Technology Review PDF magazine archive, including articles, images, and covers dating back to 1899

    10% Discount to MIT Technology Review events and MIT Press

    Ad-free website experience

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.