Select your localized edition:

Close ×

More Ways to Connect

Discover one of our 28 local entrepreneurial communities »

Be the first to know as we launch in new countries and markets around the globe.

Interested in bringing MIT Technology Review to your local market?

MIT Technology ReviewMIT Technology Review - logo


Unsupported browser: Your browser does not meet modern web standards. See how it scores »

{ action.text }

As director of research at Google, Peter Norvig is intimately involved in the attempt to manage the world’s information. He’s a good match for the job, having spent much of his life thinking about how computers think and making them do it more efficiently. An expert on artificial intelligence, he has taught at universities, held research jobs in the corporate world and at NASA, and cowritten the influential textbook AI: A Modern Approach.

Norvig came to Google in 2001 as the director of search quality; he assumed his current position four years later. In that role, he oversees about 100 computer scientists as they work on projects as diverse as medical records management and machine translation. An untold number of Google servers housing the searchable Web provide them with a test bed. He says Google is structured to ensure that researchers are not sequestered from the rest of the company. “The main allegiance they have is to the product they’re working on,” he says.

When Norvig arrived in Mountain View, Web search was simply about serving up the pages most relevant to a given query. But as the Web has grown, so has people’s need to filter information quickly. Norvig recently spoke with Technology Review’s information technology editor, Kate Greene, about what’s next for Web search.

TR: Google has many innovative products, but the look and feel of Web search hasn’t changed much in 10 years. Why?

Peter Norvig: We’ve hit on something that people mostly liked. We weren’t the first to do it. Go back to Excite and the search engines before: you have a box, and you get a list of 10 results, with a little bit of information accompanying each result. We’ve just stuck with that.

TR: What has changed?

PN: The scale. There’s probably a thousand times more information. It used to be just Web pages; now it’s video, pictures, blogs, and all sorts of media and formats. Also, the immediacy has changed. When I started, we were updating the index once a month. We thought of it as a library catalogue, a long-term thing. Now we’re seeing it more as up-to-the-minute media. When news breaks, you want to be able to read it in minutes, not in days, weeks, or months.

TR: You claim that Google’s accuracy is pretty good. How do you know how good it is, and how do you make it better?

PN: We test it in lots of ways. At the grossest level, we track what users are clicking on. If they click on the number-one result, and then they’re done, that probably means they got what they wanted. If they’re scrolling down, page after page, and reformulating the query, then we know the results aren’t what they wanted. Another way we do it is to randomly select specific queries and hire people to say how good our results are. These are just contractors that we hire who give their judgment. We train them on how to identify spam and other bad sites, and then we record their judgments and track against that. It’s more of a gold standard because it’s someone giving a real opinion, but of course, since there’s a human in the loop, we can’t afford to do as much of it. We also invite people into the labs, or sometimes we go into homes and observe them as they do searches. It provides insight into what people are having difficulty with.

1 comment. Share your thoughts »

Credit: Howard Cao

Tagged: Web

Reprints and Permissions | Send feedback to the editor

From the Archives


Introducing MIT Technology Review Insider.

Already a Magazine subscriber?

You're automatically an Insider. It's easy to activate or upgrade your account.

Activate Your Account

Become an Insider

It's the new way to subscribe. Get even more of the tech news, research, and discoveries you crave.

Sign Up

Learn More

Find out why MIT Technology Review Insider is for you and explore your options.

Show Me