We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

  • Espen Friberg
  • Intelligent Machines

    A Sense of Hearing Could Make Cars Safer and More Reliable

    Startup OtoSense makes software that can listen for sirens or engine trouble.

    Most car owners know what it’s like to hear a new clink or grinding noise coming from the engine and wonder how costly the fix will be.

    Startup OtoSense is working with major automakers on software that could give cars their own sense of hearing to diagnose themselves before any problem gets too expensive. The technology could also help human-driven and automated vehicles stay safe, for example by listening for emergency sirens or sounds indicating road surface quality.

    OtoSense has developed machine-learning software that can be trained to identify specific noises, including subtle changes in an engine or a vehicle’s brakes. French automaker PSA Group, owner of brands including Citroen and Peugeot, is testing a version of the software trained using thousands of sounds from its different vehicle models.

    Under a project dubbed AudioHound, OtoSense has developed a prototype tablet app that a technician or even car owner could use to record audio for automated diagnosis, says Guillaume Catusseau, who works on vehicle noise in PSA’s R&D department.

    Espen Friberg

    Tests have shown that the system can identify unwanted noises from the engine, HVAC system, wheels, and other components. It makes the correct diagnosis 95 percent of the time. Catusseau says PSA is now considering how what he dubs a “bionic ear” could be deployed to speed up repairs and make customers happier. “Buzz, squeak, or rattle is a great concern for car owners,” he says. “The customer will perceive the vehicle as being of low quality, [and] this can affect repurchase intent.”

    Would you like your car to have a sense of hearing?

    Tell us in the comments.

    Sebastian Christian, CEO of OtoSense, says the software could be built into vehicles so they can automatically flag potential problems that electronic sensors can’t. Leading U.S. automakers are also testing OtoSense’s technology to see how a sense of hearing can help vehicles understand their environment. (Christian declines to identify them publicly, citing nondisclosure agreements.)

    One idea the startup has tested involves adding accelerometers to a vehicle’s windshield to effectively turn it into a giant microphone. Christian says that the physical properties of windshields make this design good at detecting sirens and the direction they come from.

    That could help a self-driving vehicle stay safe, and allow a human-driven car to inform its driver where to look out for an emergency vehicle. (Google previously disclosed that microphones that detect sirens were part of the bundle of sensors on its self-driving vehicles, which are now being developed by a separate company, Waymo.)

    Audio sensors could also let a vehicle understand the nature of the road surface, for example how icy or snowy it is, says Christian. His company works with chip maker Analog Devices to embed the software needed to understand sound into low-cost processors.

    Sign up for Weekend Reads
    Stories from our archives that put technology in perspective

    By signing up you agree to receive email newsletters and notifications from MIT Technology Review. You can change your preferences at any time. View our Privacy Policy for more detail.

    Automakers have made sensors such as cameras and radar commonplace in high-end vehicles to support cruise control and safety features. Rajesh Rajamani, a professor at the University of Minnesota who works on novel applications for sensors, says the low cost of audio hardware suggests the technology could make it to market quickly if the current R&D proves it to be useful.

    “You can spread a lot of microphones around a car without it becoming very expensive, and compared to vision, sound is much less computationally intensive to analyze,” he says.

    Indeed, the potential power of low-cost sound analysis means OtoSense isn’t the only company trying to use it to help machinery stay healthy. For example, Augury, another startup, is using the same basic approach to spot problems in HVAC systems (see “This Gadget Can Tell What’s Wrong with Your Air Conditioner by Listening to It”).

    Keep up with the latest in machine learning at EmTech Digital.

    The Countdown has begun.
    March 25-26, 2019
    San Francisco, CA

    Register now
    More from Intelligent Machines

    Artificial intelligence and robots are transforming how we work and live.

    Want more award-winning journalism? Subscribe to Insider Plus.
    • Insider Plus {! insider.prices.plus !}*

      {! insider.display.menuOptionsLabel !}

      Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

      See details+

      Print + Digital Magazine (6 bi-monthly issues)

      Unlimited online access including all articles, multimedia, and more

      The Download newsletter with top tech stories delivered daily to your inbox

      Technology Review PDF magazine archive, including articles, images, and covers dating back to 1899

      10% Discount to MIT Technology Review events and MIT Press

      Ad-free website experience

    You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.