Skip to Content
77 Mass Ave

Mind-Reading Robots

CSAIL system lets humans correct robots’ mistakes by thinking.

Getting robots to do what we want often requires giving them explicit commands for very specific tasks. But new research suggests that we could one day control them in much more intuitive ways.

A team from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and Boston University has developed a feedback system that lets people use their thoughts to correct robots instantly when the machines make mistakes. Using data from an electroencephalography (EEG) monitor that records brain activity, the system can detect—in the space of 10 to 30 milliseconds—if a person notices an error as a robot performs an object-sorting task.

“Imagine being able to instantaneously tell a robot to do a certain action, without needing to type a command, push a button, or even say a word,” says CSAIL director Daniela Rus, a senior author on a paper about the research being presented at the IEEE International Conference on Robotics and Automation in May. “A streamlined approach like that would improve our abilities to supervise factory robots, driverless cars, and other technologies we haven’t even invented yet.”

Past work in robotics controlled by EEG has required training humans to think in a prescribed way that computers can recognize. For example, an operator might have to look at one of two bright light displays, each of which corresponds to a different task for the robot to execute. But the training process and the act of modulating one’s thoughts can be taxing, particularly for people who supervise tasks in navigation or construction that require intense concentration.

Rus’s team wanted to make the experience more natural. To do that, they focused on brain signals called error-related potentials (ErrPs), which are generated whenever our brains notice a mistake. As the robot—in this case, a humanoid robot named Baxter from Rethink Robotics, the company led by former CSAIL director Rodney Brooks—indicates which choice it plans to make in a binary activity, the system uses ErrPs to determine whether the human agrees with the decision.

“As you watch the robot, all you have to do is mentally agree or disagree with what it is doing,” says Rus. “You don’t have to train yourself to think in a certain way—the machine adapts to you and not the other way around.”

Keep Reading

Most Popular

Europe's AI Act concept
Europe's AI Act concept

A quick guide to the most important AI law you’ve never heard of

The European Union is planning new legislation aimed at curbing the worst harms associated with artificial intelligence.

Uber Autonomous Vehicles parked in a lot
Uber Autonomous Vehicles parked in a lot

It will soon be easy for self-driving cars to hide in plain sight. We shouldn’t let them.

If they ever hit our roads for real, other drivers need to know exactly what they are.

supermassive black hole at center of Milky Way
supermassive black hole at center of Milky Way

This is the first image of the black hole at the center of our galaxy

The stunning image was made possible by linking eight existing radio observatories across the globe.

transplant surgery
transplant surgery

The gene-edited pig heart given to a dying patient was infected with a pig virus

The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.