We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Intelligent Machines

Cars May Soon Understand More of What You Say

It should soon be possible to give your car more complicated and natural verbal commands.

In the United States, nearly one in five road accidents involves some form of driver distraction.

Many cars now come with voice control, but you can’t really talk normally to such systems, and you often have to repeat a phrase to get the job done. That could change, however, with the introduction of voice interfaces that allow for a more natural back-and-forth between driver and dashboard.

“What we’re going to see in the very near future is the ability to have a dialogue,” says Charlie Ortiz, who is senior principal manager of the artificial intelligence and reasoning group at Nuance, a voice recognition technology company based in Burlington, Massachusetts. “You might say I want to listen to some Latin jazz, or suggest a particular musician.”

Ortiz says that such technology is now in the vehicle production pipeline, which means it may appear within a few years. It will primarily allow for more natural control of dashboard features and retrieval of information such as directions. “In the navigation domain, we’re developing methods to describe points of interest more abstractly,” he says. “I don’t always know the exact address of where I want to go. I want to be able to say ‘I want to go to a restaurant in the marina near the ballpark.’ “

Nuance came to dominate the market for voice-recognition technology over the past decade after acquiring various other companies in that space (see “Where Speech Recognition Is Going”). Thanks to new techniques and large quantities of training data, speech recognition has improved greatly over that time, and Nuance supplies the technology to companies across numerous industries. It already provides voice control technology to carmakers including Ford, Hyundai, and Chrysler.

Nuance is now looking to build on that by offering greater understanding of speech. This is notoriously difficult, though, because the meaning of words and sentences can vary dramatically depending on the context; and so dialogue usually needs to be carefully constrained within certain areas. Conducting more complex conversations is a major goal for the lab Ortiz runs at Nuance. His team is working to develop personal assistants capable of understanding more types of sentences and responding effectively when they do not comprehend. For instance, a query might refer to a previous discussion and require a subtle appreciation of its context. A user might ask such a system how a particular restaurant compares, in terms of user rating, to other restaurants in his or her search history.

And Ortiz believes that more fluent speech technology could be just around the corner, thanks to advances in parsing semantics. “The stars are aligning at just the right time,” he says. “There have been a lot of advances in various components—language-understanding and the reasoning back-end parts. One big challenge is to put these pieces together.”

Another key challenge, as far as the auto industry is concerned, is ensuring that more sophisticated interfaces aren’t also more distracting. More intuitive speech interfaces might be less taxing, but only if they work well.

“If it works perfectly, great. If it fails, you’re in a worse position,” says Bryan Reimer, a scientist at MIT’s Age Lab, whose research has shown that voice interfaces can be just as distracting as regular ones in cars. “The more complex and vague the commands, the more complex the recognition problem, and the higher damage of failure.”

Several carmakers contacted by MIT Technology Review declined to discuss how voice technology would likely evolve in their products. However, vehicle interfaces are advancing at an impressive pace, spurred on in part by mobile technology (see “Rebooting the Automobile”).

Keep up with the latest in intelligent machines at EmTech Digital.

The Countdown has begun.
March 25-26, 2019
San Francisco, CA

Register now
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Print + All Access Digital.
  • Print + All Access Digital {! insider.prices.print_digital !}*

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivery each weekday to your inbox

    The MIT Technology Review App

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.