Web

A Better Way to Rank Expertise Online

(Page 2 of 2)

  • Friday, July 31, 2009
  • By Brittany Sauser

To rate a person's level of expertise--as "good," "average," or "novice"--Noll's team integrated a second factor into their algorithm: temporal information. "The idea is that the early bird gets the worm," says Ching-man Au Yeung, a researcher in electronics and computer science at the University of Southampton in the U.K., who collaborated with Noll on the development of the algorithm. Those people who first discover content that subsequently receives a lot of tagging can be identified as trend setters in a community. "They are finding the usefulness of a document before others do," says Au Yeung, who compares their acquisition of influence to the way a knowledgeable academic builds a reputation.

In contrast, followers find useful content later and tag it because it is already popular. These are more likely to be spammers, "people who identify a topic that grows in importance and use it to point to their own stuff," says Scott Golder, formerly a research scientist at Hewlett Packard and currently a graduate student at Cornell. Golder adds that the SPEAR algorithm employs "a very smart set of criteria that has not been used before in computer science."

The researchers tested their algorithm using data from Delicious, analyzing over 71,000 Web documents, 0.5 million users, and 2 million shared bookmarks. "We set the algorithm to find JavaScript experts, for example, and it produced a list of users; the top two were professional software developers," says Noll. "None of the spammers ranked in the top 200."

Noll says that the algorithm can be adjusted for any online community, including Twitter and music-sharing sites. The work was presented last week at the SIGIR Conference in Boston. Noll says that companies including Microsoft were interested in using the algorithm for social Web search, where documents are ranked based on users' bookmarks.

"I'd expect ... this combination of mutual reinforcement with the distinction between discoverers and followers to be useful in many domains," says Kleinberg.

Print

Related Articles

Computers Can't Answer Everything

A startup says natural language processing works best with human intelligence.

Cuil Tries to Rise Again

Last year's "Google-killer" plans a comeback with social search.

A Smarter Way to Dig Up Experts

Data-mining techniques could make it easier to locate expertise.

Close Comments

To comment, please sign in or register

Forgot my password

joelsapp

21 Comments

  • 925 Days Ago
  • 08/04/2009

A Better Way to Rank Expertise Online

Ok, so I understand how they show quality creators except for the part of a trendsetter sharing something that ultimately becomes popular.

So how do they rank popularity ?

If they rank it by how many times it is open, then this model will fail. If they rank it by how much the item is tagged, this can be spammed as well.

Reply

terrycojones

1 Comment

  • 706 Days Ago
  • 03/11/2010

Where to store the rankings

This is great - very interesting. The perfect place to store such a ranking is into FluidDB (see http://doc.fluidinfo.com/fluidDB/) which is designed to let anyone add any information about anything to any of its objects. For example, FluidDB has info on about 0.5M Twitter users (a small number, I know) and a SPEAR ranking could be added to these objects. It could then immediately be searched on, combined with other data, etc. FluidDB is designed as an always-writable database for exactly this kind of thing. An app, http://tickery.net is putting lots of Twitter information into FluidDB and its advanced tab would allow queries on a SPEAR ranking, but any other application could also query the SPEAR ranking via the FluidDB API.

Sorry for so many words, and for sounding like an advetisement! I hope this will sound interesting.

Regards & congrats on the results.

Terry Jones (terry -at- fluidinfo com)

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Videos

A Social-Media Decoder

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Complete Genomics

Nissan

1366 Technologies

Cellular Dynamics International

More

Advertisement

Facebook

Advertisement