Business Impact

Digital Lip Reader

Speech recognition is a long-promised technology that’s finally beginning to deliver. But today’s best systems tend to fail when the speaker is in a noisy spot. To fix this problem, researchers are adding lip-reading to the mix.

While people rely on mouth shapes all the time to interpret speech, lip reading is no simple task for a computer. For one thing, each shape can correspond to several specific sounds. To make matters worse, mouth movements begin as much as 120 milliseconds before a sound is uttered. Humans can use other cues such as sentence context and facial expressions to overcome these difficulties, but until recently, computers lacked the processing power to do so.

Now groups at Intel, IBM, and other institutions are modifying language-processing programs to link each vocal sound to several possible mouth movements, allowing the software to make a best guess about what’s being uttered. In tests in noisy environments, adding visual information boosted speech recognition accuracy from 20 percent to 75 percent, says Ara Nefian, a senior researcher at Intel Research in Santa Clara, CA.

This story is part of our September 2003 Issue
See the rest of the issue
Subscribe

Initially, this is likely to be most useful to doctors and others working in noisy locations who need better accuracy from office dictation software. With this audience in mind, IBM is building a tiny camera into the boom microphone that comes with existing speech recognition software. Further down the road, researchers envision the day when your car dashboard might have a camera peering at your lips for voice-actuated controls, or your cell phone might watch what you say.

Tech Obsessive?
Become an Insider to get the story behind the story — and before anyone else.

Subscribe today

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Business Impact

How technology advances are changing the economy and providing new opportunities in many industries.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look: exclusive early access to important stories, before they’re available to anyone else

    Insider Conversations: listen in on in-depth calls between our editors and today’s thought leaders

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.