Technology Review

Communications

How Google's Ear Hears

The new voice-search application for the iPhone marks a milestone for spoken interfaces.

  • Thursday, November 20, 2008
  • By Kate Greene

If you own an iPhone, you can now be part of one of the most ambitious speech-recognition experiments ever launched. On Monday, Google announced that it had added voice search to its iPhone mobile application, allowing people to speak search terms into their phones and view the results on the screen.

In designing the system, Google took on an enormous challenge. Where an automated airline reservation system, say, has to handle a relatively limited number of terms, a Web search engine must contend with any topic that anyone might ever want to research--literally.

Fortunately, Google also has a huge amount of data on how people use search, and it was able to use that to train its algorithms. If the system has trouble interpreting one word in a query, for instance, it can fall back on data about which terms are frequently grouped together.

Google also had a useful set of data correlating speech samples with written words, culled from its free directory service, Goog411. People call the service and say the name of a city and state, and then say the name of a business or category. According to Mike Cohen, a Google research scientist, voice samples from this service were the main source of acoustic data for training the system.

Advertisement

But the data that Google used to build the system pales in comparison to the data that it now has the chance to collect. "The nice thing about this application is that Google will collect all this speech data," says Jim Glass, a principal research scientist at MIT. "And by getting all this data, they will improve their recognizer even more."

Mobile phones are assuming more and more computational duties; in much of the world, they're people's only computers. But their small screens and awkward keyboards can make text-intensive actions, like Web search, frustrating. While mobile browsers are getting better at predicting your search terms, and thereby reducing the amount of typing, nothing is quite as easy as speaking directly into the phone.

Video

Speech-recognition systems, however, remain far from perfect. And people's frustration skyrockets when they can't find their way out of a voice-menu maze. But Google's implementation of speech recognition deftly sidesteps some of the technology's shortcomings, says Glass.

"The beauty of search engines is that they don't have to be exactly right," he says. When a user submits a spoken query, he says, Google's algorithms "just take it and stick it in a search engine, which puts the onus on the user to select the right result or try again." Because people are already used to refining their queries as they conduct Web searches, Glass says, they're more tolerant of imperfect results.

Print

Related Articles

Can Google Get Web Users Talking?

Voice-driven search is a futuristic idea, and may take some getting used to.

Jott: Calling It In

Ever had a great idea while you're stuck in traffic? No problem. Pick up your phone and Jott yourself an e-mail.

How to Talk Like an Iraqi

Laptop software that can translate English-Arabic conversations on the fly is being tested in Iraq.

Close Comments

To comment, please sign in or register

Forgot my password

Guest (dib)

  • 1182 Days Ago
  • 11/20/2008

Google Ears

This is just code. Couldn't it be dropped onto laptops? I'm disabled. If I could speak to my computer it would help significantly.

dib

Reply

adamcomputes

2 Comments

  • 1181 Days Ago
  • 11/21/2008

Re: Google Ears

If you are disabled, you should definitely look at tazti speech recognition (http://www.tazti.com).  It does a lot things that are very helpful, including searching not just Google, but Yahoo, eBay, etc.  Also, it's free which you cannot beat!  They have a video which explains how it works. 

Reply

Guest (ronnie.williams)

  • 861 Days Ago
  • 10/07/2009

iPhones Speech Recognition App

I have done my A-levels about 7 years ago and I know there were speech recognition systems for special people.

@Google Ears: i have checked the one you mentioned, it seems to be a very good speech recognition computer software for disabled people.

Speech recognition system for iPhone will be a blast because iPhone is almost a handy computer withh the access to the world though Wi-Fi or Edge, connecting with people, send messages, business, fun, entertainment and a lot more. If the speech recognition system for iPhone works good then iPhone as s product will be recommend to handy cap people and this will open new horizons for business of developing iphone accessories for special/hand caped people.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

1366 Technologies

Toyota

Geron

SpaceX

More

Advertisement

Facebook

Advertisement