We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Intelligent Machines

This Robot Knows When It’s Confused and Asks for Help

Misunderstandings will be an unavoidable part of communication between robots and humans. One robot is learning to cope with them.

Robots aren’t generally meant to get confused, but modeling confusion might help make them more useful workmates.

As part of an effort to explore ways for humans and robots to work together more naturally and effectively, a team of researchers at Brown University has developed a robot that measures its own confusion and then asks for help if it feels it needs it.

The work is important because it’s so easy for confusion to arise in everyday interactions. So making relations with a robot as natural as possible means figuring out ways of coping with this. The robot takes a command and measures with what certainty it can respond. And when it isn’t sure what’s being asked of it, it requests help.

Previous work by the Brown University team allowed a robot to read both speech and hand gesture cues to infer what’s being asked of it.

What communications skills does a robot coworker require?

Tell us what you think.

The researchers have shown that this is more effective than voice commands alone. If, however, a human asks for a wrench but there are two wrenches near each other, the robot will now decide if the situation is too uncertain and ask for further information, pointing to one and saying, “This one?”

This is the latest step toward mimicking the way two people hold a conversation, says Stefanie Tellex, an assistant professor at Brown University and the lead researcher on the project.

“That interactive, collaborative process is what allows humans to be so effective when they’re talking to each other and making plans,” Tellex says.

Indeed, Tellex says clarifying misunderstandings may be especially important for human-robot interactions. “We realized that robots were kind of limited because they can’t see as well as a person; they can’t hear as well as a person; they can’t understand as well as a person,” she says. “[But] despite encountering many more errors in understanding, they were losing out on this opportunity to try to make things better using this feedback process.”

The researchers tested the robot by introducing it to volunteers asked to get the robot to perform simple tasks, like picking up a wrench, but who were given no specific instructions on how to operate it.

This worked so well that the testers often assumed the robot was more capable than it really was, believing perhaps that it was tracking their gaze or had more sophisticated language skills.

Sign up for The Download
Your daily dose of what's up in emerging technology

Jim Boerkoel, an assistant professor at Harvey Mudd College in Claremont, California, who specializes in human-robot interaction, says misunderstanding can often lead to frustration.

“Not only is asking for help critical for the short-term efficiency of human-robot tasks, as we've seen in this application, but it can also have long-term benefits by engendering trust and transparency in the robotic system,” Boerkoel says. “For instance, asking for help communicates to the human the robot’s intent and an understanding in its own limitations.”

Keep up with the latest in robotics at EmTech Digital.

The Countdown has begun.
March 25-26, 2019
San Francisco, CA

Register now
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Print + All Access Digital.
  • Print + All Access Digital {! insider.prices.print_digital !}*

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivered daily

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.