Skip to Content
Uncategorized

How Specialized Engines Could Make Web Search Better

Google’s new tool, which lets anyone build a specialized search engine, could be the key to advancing Web search.
October 25, 2006

Like the universe, the Internet is expanding. But while the growing billions of Web pages mean there’s more information available than ever before, they also make perusing the Internet for meaning even harder. Currently, Web-search algorithms are getting the job done, but the meaningfulness of their results isn’t improving as quickly as the Internet is growing.

Now Google is offering a tool that could provide more-selective searching. But instead of overhauling its algorithm, it’s looking to harness the power of the masses to add authority to search results. On Monday the company announced a tool that allows people to build custom search engines for their own Web sites or blogs that have, at their core, the company’s popular search algorithm.

The new product, called Google Custom Search Engine, will let people winnow the searchable Web and add value to search results. To customize a search engine, users collect the sites or pages of interest, and, if they like, they can selectively rank them. In addition, users can more or less tailor the look and feel of the search on their site.

The idea is called vertical search, and it’s been around for a number of years. Vertical-search engines stick to a topic, searching within a select number of pages that include information about, for example, health care, video games, or programming code. Kosmix and Krugle are popular examples.

Google is not the first company to provide tools so that the average blogger or Web master can make his or her own vertical search. Yahoo also offers its own customizable search-engine tool, and so does Rollyo.com (as in “roll your own search engine”). But Google differentiates itself mainly with its brand, its well-known page-rank algorithm, for those pages not ranked by the user, and also by incorporating AdSense into the product. When an AdSense advertisement–positioned next to search results–is clicked, Google makes money and shares a portion of the proceeds with the search-engine builder.

Google’s Custom Search Engine could benefit both Web surfers who want to know, for example, what sites their favorite blogger finds interesting, and also bloggers and organizations that want to provide expertise through the search function on their sites. One of Google’s featured customized search-engine examples is Realclimate.org, a site that provides opinions from experts on climate change. Realclimate.org is using the tool to add its seal of approval to sites found through its customized search engine. The reasoning goes like this: if you trust a site, then you’ll likely trust the results from its customized search engine as well.

The results of these mini search engines could be useful to those who are looking for information from a trusted source. Additionally, the tool could be financially beneficial to those who participate in AdSense. But the impact of Google’s Custom Search Engine is potentially larger than simply stimulating the rise of boutique search engines. Incorporating the results of thousands of small, “expert” searches into its search results could also help Google’s general search engine grow with the Web.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

The problem with plug-in hybrids? Their drivers.

Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.

How scientists traced a mysterious covid case back to six toilets

When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.