David Zax

A View from David Zax

Amazon Democratizes Supercomputing

Got a big question? Willing to spend $1,279 an hour?

  • December 30, 2011

It may be stretching the point a little to call it, as Wired’s Cade Metz does, the “world’s fastest nonexistent supercomputer.” Amazon’s supercomputer–it built one recently atop its Elastic Compute Cloud (EC2)–exists alright, although it is virtual. Most salient, though, is the fact that Amazon promises to bring supercomputing power to, if not the masses, then at least to anyone with a big question and a decently-sized grant.

Amazon has been building virtual supercomputers on its cloud for a while now, entering the ranks of the top 500 fastest in 2010. Recently, though, Amazon’s offering climbed to become the 42nd fastest in the world. Amazon has been a major player in cloud services since 2006.

Though Amazon’s offering pales in comparison to some of those 41 faster supercomputers–Amazon can run at 240 teraflops, handling 240 trillion calculations a second; Fujitsu’s K Computer runs at 10.51 petaflops, or 10 quadrillion per second–EC2 represents a real potential disruption in the supercomputing market. Recently, a “Top 5 Pharma” customer (Amazon won’t specify who; indeed it seems to be avoiding much public comment about the supercomputer) ran a cluster with Amazon for seven hours at a peak cost of $1,279, per Ars Technica.

That may not sound cheap on the face of it, but consider the alternative: building your own computer cluster capable of similar feats. CNET dug up some numbers: the hardware to support K Computer runs $20 million, and Fujitu foots a $10 million electricity bill each year to run the thing. By contrast, running the EC2 supercomputer 24/7 for a year would cost you $11 million.

Jason Stowe, CEO of Cycle Computing, put it this way to Wired: “It’s just absurd… If you created a 30,000-core cluster in a data center, that would cost you $5 million, $10 million, and you’d have to pick a vendor, buy all the hardware, wait for it to come, rack it, stack it, cable it, and actually get it working. You’d have to wait six months, 12 months before you go it running.” By that point, he says, your research question may have refined itself, and you may need more cores, or fewer.

There are some naysayers to the whole cloud supercomputing idea. Some say Amazon will never give you the customer service you might need for fine-tuning questions. “You need a certain level of support, help with things like loading data off out disks and tweaking the performance of the cluster to suit our needs,” one loyal customer of Penguin Computing, a competitor, tells Wired.

But the bottom line is this: if you don’t need the fastest supercomputer in the world, if you don’t need a lot of hand-holding, and if you’re on a budget, Amazon’s option may be just the thing you need. The economics of the cloud (see our interactive diagram from 2009 for a vivid illustration) are–like a supercomputer itself–overwhelmingly powerful.

Become an MIT Technology Review Insider for in-depth analysis and unparalleled perspective.
Subscribe today

Uh oh–you've read all five of your free articles for this month.

Insider Premium

$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Premium.

  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look. Exclusive early access to stories.

    Insider Conversations. Join in and ask questions as our editors talk to innovators from around the world.

You've read of free articles this month.