Making Multicore Fly

Before multiple-core processors can help PCs soar, the industry must solve some tricky software and hardware challenges.

This article is part 2 of a two-part series on the advent of multicore processing in consumer PCs; part 1 appeared on December 15.

Throwing an extra engine in a car won't make it run twice as efficiently. And engineers designing microprocessors with multiple cores (two or more central processing units), as well as the PCs that will take advantage of them, face a similar reality. Rather, for PCs to make use of multiple processor cores, the industry will need to modify hardware subsystems, and revise applications software.

One of the biggest hardware challenges with multicore processors will be picking the right memory technologies. Traffic on the chip's system bus, which carries requests from software applications in and out of the processor, must also be optimized. "If you can't keep the cores fed fast enough from memory, you haven't gained anything," says AMD chief technology officer Phil Hester. "We're trying to bridge as much of that gap as possible."

On the software side, multithreaded applications (which are written to recognize and use multiple cores) require more development time than usual. "It will take years before programmers have all the tools and training to make multithreaded code the norm -- and not the hand-crafted exception," says Kevin Krewell, editor-in-chief of InStat's Microprocessor Report.

Some PC parts won't need major revampings with multicore designs, though. For example, the motherboards that house multicore processors won't be radically different from today's versions, although they will be smaller, since the chips draw less power, according to Jeff Austin, marketing manager for Intel's Digital Enterprise Group. (These chips also won't require huge cooling systems on the motherboards.) This difference will help PC makers who want to design small or unusual cases.

Memory, though, will require a serious makeover. "You need more memory to support the additional cores, and you need memory that can keep up with the speed," says Shane Rau, program manager of semiconductor research for IDC.

The amount of cache memory included directly on a processor can make a huge difference to the performance of application software. Cache memory stores frequently used chunks of application data and instructions, for quick pass-offs when individual applications make requests to the CPU. Today's chips are designed with two separate caches, L1 and L2, which serve as holding areas for frequently accessed data.

For multicore chips, Intel and AMD are trying new cache arrangements. Today, Intel's dual-core chips have two L2 caches. Sometimes one core will need data residing in the other core's L2 cache, which takes more time to grab. For the company's next-generation Merom and Conroe dual-core chips, for notebooks and desktops, expected next fall, designers have included a shared L2 cache, so that both cores have continuous full access to the cache.

Intel is also working on a technique to allow direct transfer of data from one core's Level 1 cache to the other, a method that should greatly reduce the amount of traffic on the system bus, says Intel's Austin.

For its multicore chips, AMD plans to increase the size of the L1 and L2 caches and improve their efficiency, Hester says. The company is also considering a third shared cache, to pump through application data requests and graphics rendering.