What will it take to get a robot to clean your home so you don’t have to do it?
In June, Elon Musk announced that developing software to turn an off-the-shelf robot into a household cleaner is a primary goal of his OpenAI robotics institute. Such a machine would surely be popular, but making it happen will be a remarkably daunting robotics challenge. Machines will need to analyze the types of messes in a house, formulate and execute a plan for room-by-room cleaning, and handle unexpected events.
“Cleaning is different from other tasks we’ve thought about in robotics, which [have] typically involved manipulating objects, or moving them place to place,” says Maya Cakmak, an assistant professor of computer science and engineering at the University of Washington. Last year, she earned a three-year, $400,000 grant from the National Robotics Initiative, within the National Science Foundation, to research a cleaning robot.
She points out that getting a robot to clean would require much more than simply getting it to hold a tool to some surface. “There’s the angle, how much you’re pushing and pressure you’re applying, how fast you move it, how much you move it, and even the orientation [of the tool] relative to the dirt.” A robot would also have to adjust to the curvature on a tiled countertop versus a flat floor, and properly choose the right tool for the particular kind of mess: a sponge to absorb spilled juice, a feather duster on shelves, and a stiff brush to loosen soap scum from the shower.
Cakmak is trying to make such things possible. To train robots in her lab, she uses a technique called “programming by demonstration”: The machines learn by imitating a researcher who shows a cleaning technique for the robot’s vision system. Nearing the end of the first year of her three-year grant, Cakmak and her grad students are running a robot through many different training sessions with colored aquarium crystals as “test dirt,” using a variety of cleaning attachments, from a broom to a feather duster. She wants to get the robot to generalize the cleaning motion from the human demonstration, and also correctly identify the “state of dirt” before and after the cleaning action.
Ilker Yildirim, a research scientist at MIT who works on computational models of cognition and perception, says he is impressed by Cakmak’s demonstrations. But he says a robot that can plan and execute the cleaning of multiple rooms with a variety of tools will require the machine to more fully understand its environment. Creating a machine with that level of autonomous decision-making would amount to significant progress toward a genuine artificial intelligence.
Cakmak thinks household robots can’t become truly autonomous until we redesign our houses to make them more machine-friendly. For instance, long hallways might require markings that a robot can read for geolocation purposes. She also thinks that to become ubiquitous, domestic robots need to be hackable by end users, because everyone’s house is different. To this end, Cakmak is working to simplify the task of programming robots, even for people without technical backgrounds.
This new data poisoning tool lets artists fight back against generative AI
The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models.
Rogue superintelligence and merging with machines: Inside the mind of OpenAI’s chief scientist
An exclusive conversation with Ilya Sutskever on his fears for the future of AI and why they’ve made him change the focus of his life’s work.
The Biggest Questions: What is death?
New neuroscience is challenging our understanding of the dying process—bringing opportunities for the living.
Driving companywide efficiencies with AI
Advanced AI and ML capabilities revolutionize how administrative and operations tasks are done.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.