Christopher Mims

A View from Christopher Mims

Moore's Law Over, Supercomputing "In Triage," Says Expert

A dean of high performance computing says silicon is at the end of the line.

  • May 9, 2012

High Performance Computing expert Thomas Sterling would like you to know that a computing goal you’ve never heard of will probably never be reached. The reason you should care is that it means the end of Moore’s Law, which says that roughly every 18 months the amount of computing you get for a buck doubles.

Experts are projecting that the rate of growth in supercomputing power is about to plateau, making predictions like this one obsolete

Or at least, the end of Moore’s Law-style advances in the processing power of the world’s biggest supercomputers. For a while now, every 11 years or so, the planet’s smartest and best-funded computer scientists have managed to produce a supercomputer that’s 1,000 times faster than its predecessor. In 1999, we reached teraflops-scale computing, or a trillion (10^12) floating point operations per second. In 2008, Los Alamos’ Roadrunner supercomputer reached petascale computing, or a quadrillion (10^15) floating point operations per second.

In a mind-blowingly jargon-rich interview with HPC Wire, Sterling doesn’t just assert that Zeta-Scale (10^21 FLOPS) computing is impossible, he also makes it seem pretty unlikely we’re going to reach the next milestone, Exascale computing (10^18 FLOPS) without ripping  apart our existing ways of building supercomputers, root and branch. Emphasis mine:

“[I]ndustry will deliver the systems that will be used in the next decade. There is no other choice. It is clear that vendors would prefer not to have to retool and this is true for users as well. To do so will involve a degree of disruption that would be best avoided if it were possible. And for a portion of the overall workload, even at exascale, this may prove to be possible. But such systems are a placebo to an ailing HPC community that if not in triage, is already showing symptoms of underlying conditions that require attention.”

If you read the whole interview, basically, Sterling is showing that we’re not going to reach the next supercomputing milestone with more incremental improvements on existing systems, which is how we reached the last two milestones. Indeed, he says that without “innovative ways of managing vertical and lateral data movement,” current estimates posit that future exascale machines will use roughly ten times more power than is considered feasible.

If Sterling is right, and he is one of the deans of high performance computing, it seems likely that we’ll never reach the next milestone in supercomputing in silicon. Physicist Michio Kaku says Moore’s Law will collapse in about ten years. Sterling agrees, and says it comes down to the basic physical restrictions of working with atoms.

What will the supercomputers of the future be made from, then?

Kaku mentions machines based on protein, DNA, and optical devices as possible replacements. When the time comes to transition to a new medium, he thinks the world will migrate to 3-dimensional chips. That technology would be followed by molecular computers and, eventually, by quantum computers around the end of the 21st century.

 Follow @Mims or get in touch

Want to go ad free? No ad blockers needed.

Become an Insider
Already an Insider? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.