November 2002

The Web's Missing Links

A new twist on the hyperlink makes wandering the Web twice as interesting.

By David F. Gallagher

Surfing the Web, as the term implies, is all about forward motion. And like the aquatic version, Web surfing against the tide poses quite a challenge. That's because the Web hyperlink is a one-way affair: it's easy to follow links from page D to pages E, F, or G, but the Web's architecture offers no simple way to see which pages-call them A, B, and C-link to D.  Programmers have tinkered with solutions to this problem since the early days of the Web. But interest in solving it has picked up recently with the spread of weblogs, most of which are personal sites full of links and commentary. In the last two to three years, hundreds of thousands of netizens have created weblogs to chronicle their daily lives, discuss the latest news, or share  expertise in their chosen fields.

Many webloggers link to each other's entries, creating threads of conversation scattered across multiple sites and, consequently, a new demand for "backlinks" to see who is linking to what. "I post to my weblog; you respond in your weblog-but without backlinks, I may never know we're having a conversation," explains Mark Pilgrim, a developer and technology trainer in Apex, NC.
Webloggers, or "bloggers," say recent experiments with backlinking could benefit all kinds of online publishing. Instead of pointing readers only to sources for the item they have just read, backlinks also point to newer material that item inspired, making it easy to follow a path through the Web's marketplace of ideas. And because they can be updated automatically to reflect new incoming links, backlinks turn static Web pages into active hubs of related information.

Search engines such as Google are one source of information on inbound links-just type "link:" and a Web address in Google's search box, and a list appears. But centralized search engines aren't updated frequently enough to allow the kind of discussion tracking webloggers want. A better route, software-savvy webloggers have found, is to make use of referrers. These addresses, sent along with page requests when one clicks on a link, show where the link was found. In most cases, such referrer data are available only to the owner of the requested site, but one way to create a feedback loop is to automatically paste the addresses from server logs into the pages themselves.

That's what software developer Chris Wenham does in his Web magazine, Disenchanted.