TR Editors' blog

Microsoft Game Helps Make Search Better

A new game asks users to help refine search results.

Will Knight 07/27/2009

  • 8 Comments

Researchers at Microsoft's labs in Redmond, WA, have released an online game to help fine-tune search results.

Called Page Hunt, the game presents players with web pages and asks them to guess the queries that would produce the page within its first five results. Players score 100 points if the page is no.1 on the list, 90 points if it's no.2, and so on. Bonuses are also awarded for avoiding frequently-used queries.

The idea is to gather useful information on user search habits which could be used to fine tune search algorithms and ranking scheme. The game was developed by Chris Quirk and Raman Chandrasekar at Microsoft, and colleagues from Georgia Tech and the Chinese University of Hong Kong, and it was unveiled this week at the SIGIR09 conference in Boston.

Page Hunt is a clever twist on "human computation"--using people to perform tasks that computers find difficult to do. Luis von Ahn, a professor at Carnegie Mellon University, has been a pioneer in this area, and has developed several similar projects: spam-fighting text puzzles that simultaneously help digitize old books, and games that help tag images and music with the relevant keywords. Another cool example of human computation in action is, of course, Amazon's Mechanical Turk.

The researchers behind Page Hunt have already made one curious finding while testing the game internally: the longer a page's URL (in characters), the harder it was for users to match the page to query words. The research don't speculate about why this should be, but here's a graph showing the relationship between URL length and the "findability" of a page:

I found Page Hunt strangely addictive, although my first score was a pathetic 630.

A paper describing the Page Hunt research can be found here (pdf).

Print

Close Comments

To comment, please sign in or register

Forgot my password

zim_b

1 Comment

  • 927 Days Ago
  • 07/27/2009

I went to try the test and it wanted me to install Silverlight. At that point I stopped. It just confirmed in my opinion that Microsoft does not understand the web.

Reply

willknight

37 Comments

  • 927 Days Ago
  • 07/27/2009

Silverlight

@zim_b--forgot to mention that it requires Silverlight to run. It took me a while to get it installed so I sympathize.

Reply

vonnegut

1 Comment

  • 927 Days Ago
  • 07/27/2009

Very Cool!

although the other comments cant get beyond silverlight, I think this is an awesome idea that promotes the user as part of the build process and transparency into the art of fine tuning search. I think the comment "ms doesnt understand the web" is incredibly shortsighted here. I think this is a very forward, 180 idea from Microsoft.

Reply

acjeffcarl

1 Comment

  • 927 Days Ago
  • 07/27/2009

Re: Very Cool!

Google has been using "human computation" to improve their search results, map results, news results, AdWords, etc, for at least two years with its "Quality Rater" program.  But they actually qualify, train, & QA their raters and pay them an hourly wage instead of asking anyone to do it for free.  Just another example of Microsoft trying to play catch up and frame it as if they thought of something "very cool" and "forward."

Reply

henrystaples

1 Comment

  • 927 Days Ago
  • 07/27/2009

Interesting, but a little frustrating

It's an interesting idea, but it's a little frustrating when the page doesn't match up quite right. It seemed to happen about 3-4 out of every 10 times where pages wouldn't match and I'd have to hit skip. Which makes it seem more like work than a game. A game should have ways to figure it out.

Reply

jdempaire

1 Comment

  • 927 Days Ago
  • 07/27/2009

Interesting and Informative.

I find it very interesting how every day they are more ways to create things with collaboration.

About the long URL, something to think about... more and more website are using longer URL to include keywords and for Search Engine Optimization.

Clever method to help BING compete with Google!, we all need better competitors in the search world.

Reply

willknight

37 Comments

  • 927 Days Ago
  • 07/27/2009

Re: Interesting and Informative.

Good point jdempaire, but wouldn't that mean that sites with longer URLs ought to be more "findable"?

Reply

Advertisement

nsilverrod

1 Comment

  • 924 Days Ago
  • 07/30/2009

Page Hunt

I did reasonably well with this game, but found it frustrating. I found each page much more quickly, with fewer tries (often the first hit on the first try), on Google. So far I am not impressed. Bing has a long way to go.

Reply

About

Insights, opinions, and our editors' analysis of the latest in emerging technologies.

Subscribe to the TR Editors' blog RSS Feed

Advertisement
Advertisement

Facebook

Advertisement