Peer-to-Peer Comes Clean

Continued from page 1

And then there's a clever peer-to-peer system called Vipul's Razor, which is being used to filter spam. A small software agent runs on every computer attached to the network. This agent detects when e-mail arrives. The theory is that if the same message appears in multiple locations at more-or-less the same time, it's probably spam. This approach is an excellent complement to content-based anti-spam systems: the content systems identify spam that looks like spam, while Razor identifies mail that is sent the way spam is typically sent, no matter what it looks like. Support for Razor is built in to the popular SpamAssassin anti-spam system. In an examination of my spam from September, Razor identified one out of three spam messages--pretty good considering that it doesn't use any keywords at all.

Peer-to-peer has been an active area of academic research as well. Much of the research has focused on trying to create so-called distributed hash tables, or DHTsdatabases that are shared between multiple computers all over the Internet. The best systems automatically find the computers on the Net that are part of the DHT, store data on redundantly on multiple machines, use digital signatures and encryption to protect the information, and even include distributed reputation, trust, and payment systems to keep all of the participants honest and motivated. This sounds like just the sort of technology that companies like Kazaa should be gaga over. Strangely, however, most of the bandit MP3 networks have stayed away from the academic DHTs and have installed their own systems.

Fortunately, many academics are trying to push their research more toward real-world applications. In August, for instance, the Institute of Electrical and Electronics Engineers held its Fourth International Conference on Peer-to-Peer Computing in Zurich, Switzerland. Among the highly technical presentations were papers on how to make unstructured peer-to-peer networks really big, more techniques for securing peer-to-peer systems against attack, techniques for squeezing more functionality out of less bandwidth, and how to build  P2P networks that respond to changes in the underlying Internet. Though highly technical the papers nevertheless make interesting readingespecially if you are an entrepreneur looking for a new company idea.

Indeed, there are plenty of other peer-to-peer applications waiting out there in the wings, perhaps getting ready to be the next Skype. A few weeks ago, for instance, MIT graduate Tim Macinta put out the first beta version of Magic Mirror Backup, a peer-to-peer system that automatically backs up computers throughout your home or office to each other. (Various alpha versions of Magic Mirror have been in circulation for about a year.) The idea is to put all of those unused gigabytes on your various hard drives to use backing up each other. And last year Microsoft published a Windows XP Peer-to-Peer Software Development Kit, which, the company says, contains all software required to create decentralized applications that harness the collective power of edge of the network PCs. I haven't yet heard of anything that was created with it, but perhaps next year we will all be astonished.

Most people who use the Internet today are accustomed to the idea that there are low-cost clients on people's desktops and expensive servers closeted away in expensive telecom hotels with high-quality power and lots of bandwidth, there is nothing inherently client-server in the Internet's underlying architecture or design. As Internet service providers deliver more bandwidth to homes and small businesses, and as desktop hard drives grow ever larger in size, we are sure to see more approaches for harnessing these underutilized resources.

In the future, peer-to-peer may be the norm, and we may look back at today's client-server systems as some sort of weird, unreliable, transitory technology.