Intelligent Machines

New Self-Driving Car Tells Pedestrians When It’s Safe to Cross the Street

How will self-driving cars respond to all those unpredictable humans?

Perhaps the biggest challenge for self-driving cars will not be tracking other vehicles or avoiding unfamiliar obstacles so much as dealing with that most erratic and confusing of phenomena: human behavior.

A new automated driving startup, Drive.ai, is making human interaction a key part of its strategy. The company, which includes numerous AI researchers from Stanford University, is developing systems that can be trained to interpret data from sensors and control a vehicle’s behavior. But more unusually, they are also exploring ways that vehicles might learn the norms of driver and pedestrian behavior. Within the next few weeks the company will begin testing in California automated vehicles fitted with displays and sound systems designed to communicate with pedestrians.

This effort may turn out to be very important, especially since the first self-driving vehicles may be far from fully autonomous (see "Prepare to be Underwhelmed by 2021's Autonomous Cars").

An illustration shows a car fitted with Drive.ai hardware.

“Everybody talks about this magical world where all the cars on the road are self-driving," says Carol Reiley, cofounder and president of Drive.ai. "It’s surprising that the human side has been engineered out of the equation."

Reiley, a roboticist who studied at Johns Hopkins and previously worked on medical robots, says the company is unique in applying machine learning to both driving and human interaction. She notes that subtle everyday interactions, like apologizing after cutting off another driver or saying thank you after someone lets you in at an intersection, will be completely different with automated driving.

The Drive.ai team.

"We fully anticipate people’s behaviors to change around a self-driving car," Reiley says. Self-driving cars may need to behave differently in different locations, she adds, and it will take time to figure out what works best. “But ultimately, we believe that we need to factor in the human element from day one, find out what works, and be responsive,” Reiley says.

The company’s first product will be hardware required to retrofit a vehicle so that it can drive itself. It will be offered to companies that operate fleets of vehicles along specific routes, such as delivery or taxi services. Besides sensors and systems for controlling the car, this will include a roof-mounted communications system and a novel in-car interface.

The company will experiment with using text, sounds, lights, and even motion to communicate with drivers and pedestrians. The display on a vehicle might tell a pedestrian when it’s safe to cross the road, while edging forward could tell another driver to give way. The systems will make use of deep learning, a technique that has proven very powerful for teaching machines how to do tasks that would be difficult to program by hand.

Bryan Reimer, a research scientist at MIT who studies automation and driver behavior, says too little attention has been paid to human behavior by those who are developing automated driving systems.

"The sensing and processing difficulties that many of the key technology firms are currently focused on will be solved faster than our ability to devise cohesive human-centered designs," he says. "While we will see many deployments of higher order automated vehicles, I believe our roadways will be dominated with lower-level automated systems for decades to come."

 

Hear more about deep learning at EmTech MIT 2017.

Register now
An illustration shows a car fitted with Drive.ai hardware.
The Drive.ai team.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look: exclusive early access to important stories, before they’re available to anyone else

    Insider Conversations: listen in on in-depth calls between our editors and today’s thought leaders

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.