Searching Beyond Search Results
A new service mines the contents of Web pages looking for meaning and relevance.
Search is one of the main tasks performed online, and yet often it doesn’t work as well as it should. Take, for example, the common experience of “back-clicking,” when a user has to return to the results page several times before finding the information she’s looking for. According to a 2009 comScore survey, 30 percent of searches are abandoned in frustration, and two-thirds of the rest required users to refine their queries before getting the desired result.
A new product called Yolink, which launched this week, aims to help users figure out which search results are most relevant. It does this by looking at the contents of the Web pages that a list of search result link to. The company bills itself as a step toward semantic search, because it attempts to find meaning in the contents of a Web page. And it can do this even though most pages aren’t marked up in the formats typically used to help machines interpret content. The product is made by TigerLogic, a company based in Irvine, CA.
Yolink’s technology is designed to look past the links on a search results page and perform the next few steps in assessing the value of information for the user. Brian Cheek, vice president of business development for TigerLogic, explains that the company has built several demonstrations of how its technology can be used to enhance the search functionality on a site. These include one for Craigslist that pulls out data from apartment rental listings such as whether a unit allows pets or has parking, using this to supplement the results that the site already returns.
Jeff Dexter, who is director of product development and technology chief architect at Yolink, explains that semantic search typically calls for the text on a page to be marked up by the publisher with tags that help identify different types of information. Yolink is designed to deal with data that hasn’t been marked up. Dexter says the company tried to establish a common model for how data is typically presented across a website. That model is used to identify particular pieces of data.
Yolink will analyze a page–such as a Craigslist listing–looking for clues as to where certain pieces of content are shown. It might notice, for example, that location and price information tend to be near each other. Search engines such as Google present snippets of pages beneath the links they provide to perform a similar service for the user, but Dexter says Yolink’s results go beyond simply identifying keywords and surfacing them.
Yolink does not rerank search results, but it does rank the information it extracts from the page to determine what may be most useful to the user. On a Yolink results page, the user can click on extracted data to see a more detailed preview without navigating away from the results page.
TigerLogic originally built Yolink as a browser plug-in, but the company changed its strategy to provide an application programming interface (API) that lets publishers and website owners integrate the technology into their own sites. The company offers this service to website owners for a range of prices based on how many searches its users perform each month. The service is free for noncommercial sites with fewer than 2,000 searches monthly, and $1,500 a month for commercial sites with 2,000 to 25,000 searches a month.
There’s a growing sense within the search industry that end users are frustrated with the clutter of results they have to wade through, says Greg Sterling, a senior analyst with Opus Research, a market research firm based in San Francisco, and a contributing editor for the website Search Engine Land. Sterling sees Yolink as an effort to reduce the time it takes to decide which link to click. “They have done a nice job of evolving a complement to search,” he says.
The tool isn’t competition for Google or Bing, Sterling says. Instead, it competes with similar search enhancement efforts. “The challenge for anyone in search is to get attention,” Sterling says, “to create an experience that adds something, and that really goes beyond Google.” He thinks publishers and website owners are much more likely to understand how Yolink could improve the search experience on their sites than end users. Sterling believes Yolink’s API strategy will work much better than offering a browser plug-in, which users would only download if they already understood the likely benefits.
Become an MIT Technology Review Insider for in-depth analysis and unparalleled perspective.Subscribe today