Thursday, July 31, 2008

A Google Killer Stumbles

Cuil's rough launch shows the difficulty of challenging major search engines.

By Erica Naone

Credit: Technology Review

Boasting big plans, startup search engine Cuil (pronounced "cool") launched on Monday. The company sold itself on having indexed more pages than Google, ranking based on context rather than on popularity, and displaying results organized by concept within a beautiful user interface. There was just one problem: when the search engine launched, it didn't work very well.

Cuil's site was down intermittently throughout the day on Monday, and even when the site was up, it sometimes returned no results for common queries, or failed to produce the most relevant or up-to-date results. For example, as of Wednesday morning, searching Cuil for its own name returns nothing on the first results page that is related to the engine itself, in spite of the buckets of press it got this week.

"I've seen these sorts of things for all sorts of startups that get launched," says search-engine expert Danny Sullivan, who runs Search Engine Land. "You have issues with how it's displaying results; you have spam showing; you have a lot of duplicate results." But Cuil wasn't supposed to suffer from the common problems that all sorts of startups encounter. Its founders have impressive credentials: Anna Patterson and Russell Power both had major roles in building Google's large search index, and Tom Costello researched search architecture and relevance methods for Stanford University and IBM. On top of the company's talent, Cuil raised a reported $33 million in venture capital. "In many ways, Cuil was the exception," Sullivan says. "They were one of the few people or companies out there where you would say, 'Well, all right, I'd be dubious about anyone else, but if anyone's going to have a chance, you should have a chance.' But they didn't deliver, and I think that makes it even harder now for startups to come along."

One of Cuil's main selling points is the size of its index. Claiming to have indexed 120 billion Web pages, which it states is three times more than any other search engine, the company says, "Size matters because many people use the Internet to find information that is of interest to them, even if it's not popular." But Sullivan notes that relevance may be the most important quality of search. "When you come into the idea of size, that starts getting into the question of obscure search," he says. "The needle-in-the-haystack search sounds so very compelling--the idea that if you don't have a lot of pages, you can't search through the entire haystack. But, as Cuil has demonstrated very well, it doesn't help you to look through the entire haystack if it gets dumped on your head, and all you can see is a bunch of hay out there."