Web

How Twitter Could Bring Search Up to Speed

(Page 2 of 2)

  • Wednesday, March 11, 2009
  • By Kate Greene

An upswing in the number of marketers and companies that have joined Twitter over the past year also reflects big interest in using Twitter to tap into the online trends. Sullivan admits that right now the average Twitter user isn't turning to the service for the majority of its searches, but he says that marketers who want to track the sentiment of their brands and products are finding it an indispensable tool. "Is it essential to search Twitter because you're a brand manager?" asks Sullivan. "Yeah, it's becoming very important." He notes that outside search engines, such as Google, cannot easily go through Twitter's data because it is not releasing it. "If I were over at Google, I'd definitely be concerned about that," he says.

Meanwhile, Twitter is clearly thinking about ways to better mine its users' tweets. When you search Twitter, its search engine looks for keywords in the most recent tweets, explains Biz Stone, one of the company's cofounders. The results are then ranked based on the time when they were posted; for some popular topics, this can mean just seconds ago. The search technology used for this was developed at a startup called Summize, which Twitter acquired last July. Until recently, Twitter users needed to go to the address search.twitter.com to use the technology: a link was buried at the bottom of a user's homepage. Twitter is now testing a "more integrated" search box at the top of the page for a small number of users, says Stone.

As simple as it sounds, dealing with the volume of messages posted on Twitter in real time poses a big challenge, according to Stone. "Our biggest technical challenge right now is not that exciting: it's just scaling from an operations and engineering standpoint," he says. In other words, engineers have to make sure that the system doesn't crash under the weight of all the messages that Twitter handles.

Summize was given access to a higher volume of tweets than most third-party developers. In the early days of Twitter, it wasn't a problem to let developers use such a large volume of tweets, but as the service has grown, the application programming interface (API) that allows for such access "requires special design and attention," Stone says. Engineers at Twitter have also been working on a new, more scalable solution. "We'll need to be thoughtful about how, when, and who we partner with to test this technology when it's ready," he adds.

When asked whether Twitter and Google could work together to build a real-time search engine, Stone is a bit more optimistic. "We're huge fans of Google," he says. "And we'd be delighted to partner or work with them in the future."

Print

Related Articles

The Web's Crystal Ball Gets an Upgrade

Bitly's shortened links can forecast the next trend online—a partnership with Verisign is about to boost that predictive power.

A Tangled Web of Shortened Links

A study of link shortening reveals hidden strands of the Web.

Using Twitter to Track Dropped Calls

Unhappy customers often tweet their gripes—now AT&T is mining those complaints to improve its service.

Close Comments

To comment, please sign in or register

Forgot my password

phoenix

172 Comments

  • 1070 Days Ago
  • 03/11/2009

cogito twitterus sum

Our world's such a testy place,
Fads flare up and flame out at a terrible pace,
The texting goes on it just never seems to end,
But we all must keep up as it's part of the trend.

Reply

ztracy

8 Comments

  • 1070 Days Ago
  • 03/11/2009

We Feel Fine

Twitter should put some money up for Jonathan Harris to make twitter the subject of his next work.

http://www.wefeelfine.org/

Reply

jmaximus9

86 Comments

  • 1067 Days Ago
  • 03/14/2009

140 Words?

That is characters not words.

Reply

willknight

37 Comments

  • 1066 Days Ago
  • 03/15/2009

Re: 140 Words?

Hey jmaximus9,
The intro has been fixed. Thanks for pointing out the error.

Reply

ka5s

59 Comments

  • 998 Days Ago
  • 05/22/2009

Your documents, Citizen!

Google disturbed? A number of GOVERNMENT'S would like to be able to search and store Twitter.

Maybe they already do.

Reply

karmadir

4 Comments

  • 813 Days Ago
  • 11/23/2009

HELP IN Business

But, how does twittering help in business?

Please guide.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Videos

A Social-Media Decoder

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Groupon

eSolar

iRobot

Crowdcast

More

Advertisement

Facebook

Advertisement