Skip to Content

Yibiao Zhao Is Giving Machines a Sense of Imagination

A new approach to AI will help make autonomous vehicles safer and let robots learn how to use tools as a human might.
November 7, 2017
Justin Saglio

Self-driving cars have come a long way, but they still struggle to deal with unexpected situations. Yibiao Zhao wants to change that.

At MIT Technology Review’s EmTech conference on Tuesday, Zhao, the cofounder of iSee, an MIT spin-off, highlighted the limitations of existing machine-learning approaches for self-driving cars—which are based on pattern recognition—and outlined his work on a new set of algorithms that seek to mimic humans’ instinctive understanding of the physical world. (See also our previous coverage of Zhao’s work: “Finally, a Driverless Car with Some Common Sense.”)

“When we see something for just a few seconds as we’re driving, we can quickly deduce the intention of the driver in front of us,” said Zhao. “We want cars to have this same predictive capability.” 

To give it to them, Zhao and his colleagues have drawn on some of their earlier research inspired by cognitive science. That included teaching a robot how to crack a nut using a hammer, and then taking the hammer away and getting the robot to select the next most appropriate tool from a random assortment.

“The aim was to give the robot the same deep understanding of the properties of tools as a human,” said Zhao.

His work could lead to advances in fields beyond autonomous cars. Zhao has also been involved in a government project (sponsored by the Defense Advanced Research Projects Agency) to develop robots that can intuitively understand the intentions of soldiers they’re paired with on the battlefield.

Keep Reading

Most Popular

conceptual illustration of a heart with an arrow going in on one side and a cursor coming out on the other
conceptual illustration of a heart with an arrow going in on one side and a cursor coming out on the other

Forget dating apps: Here’s how the net’s newest matchmakers help you find love

Fed up with apps, people looking for romance are finding inspiration on Twitter, TikTok—and even email newsletters.

digital twins concept
digital twins concept

How AI could solve supply chain shortages and save Christmas

Just-in-time shipping is dead. Long live supply chains stress-tested with AI digital twins.

still from Embodied Intelligence video
still from Embodied Intelligence video

These weird virtual creatures evolve their bodies to solve problems

They show how intelligence and body plans are closely linked—and could unlock AI for robots.

computation concept
computation concept

How AI is reinventing what computers are

Three key ways artificial intelligence is changing what it means to compute.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.