Skip to Content
Artificial intelligence

This Is the Robot Maid Elon Musk Is Funding

OpenAI is teaching warehouse robots to do your household chores.
July 22, 2016

Inside a secretive AI nonprofit backed by Elon Musk and other Silicon Valley figures, a handful of robots designed to help out in warehouses are gradually learning how to do useful household chores.

OpenAI, which was created to do basic AI research, is reprogramming robots developed by Fetch Robotics, a company that supplies warehouse automation hardware. Researchers at OpenAI are equipping the robots with software that lets them train themselves through trial and error.

The effort reflects a bet that innovations in software and machine learning, rather than breakthroughs in hardware, are the way to give robotics remarkable new capabilities. Fetch makes a range of robots for warehouses, including systems that follow workers around a building, carrying items dropped into a basket. OpenAI is using a system that features a mobile base but also 3-D depth sensors, a 2-D laser scanner, and a robotic arm with seven degrees of freedom.

Through reinforcement learning, this robot developed by Fetch Robotics is figuring out how to help around the house.

In April, OpenAI recruited Pieter Abbeel, a professor at the University of California, Berkeley, and a leading expert on robot learning. Abbeel has shown how robots can use a machine-learning approach called deep reinforcement learning to acquire completely new skills that would be hard to program by hand, such as folding towels or retrieving items from a refrigerator. Google DeepMind, an AI subsidiary based in the U.K., uses this technique to get computers to play computer games at a superhuman level (see “Google’s AI Masters Space Invaders”).

Abbeel’s robots learn tasks from scratch, using a neural network that receives sensor input and controls physical movement. The network adjusts its parameters automatically as it inches closer to its goal. A robot might try thousands of grips, for instance, in the process of learning how to hold a certain object.

“If this goal can be achieved, then there will be economic and industrial benefits,” says Marc Deisenroth, an expert on reinforcement learning at Imperial College London. “Imagine a Roomba not only cleaning your floor but also doing the dishes, ironing the shirts, cleaning the windows, preparing breakfast.”

Deisenroth says using off-the-shelf robots could drive costs down. “Currently, the software seems to be the bottleneck,” he adds. “However, independent of this, better hardware could also lead to substantial improvements.” Soft manipulators and elastic feet similar to a monkey’s feet are concepts that researchers have started working on, he says.

Some manufacturers, including the Japanese company Fanuc, are testing reinforcement learning as a way to train industrial robots quickly in new tasks such as learning to grasp unfamiliar objects. When many robots work in parallel, the training time required is reduced accordingly (see “This Factory Robot Learns a New Job Overnight”). Robot researchers at Google are testing similar learning techniques.

“Moving away from having to program robots by hand by endowing robots to learn autonomously is a key element for the future of robotics,” says Jens Kober, an expert on robot learning at Delft University of Technology in the Netherlands. Kober says having robots share the information they have learned will be crucial.

While robots such as those made by Fetch are finding their way into many factories and warehouses, domestic robot helpers remain the stuff of science fiction. Performing seemingly simple tasks like washing dishes or folding laundry in a messy home setting is incredibly hard for a machine. A robot programmed the conventional way can easily be thrown off by an unfamiliar object or a slight variation in lighting.

OpenAI confirmed that it is working with the robots from Fetch, but it declined to comment further. Melonee Wise, the company’s founder, couldn’t be reached for comment (see “Innovators Under 35: Melonee Wise”).

OpenAI was created by Musk and a handful of well-known (and well-heeled) Silicon Valley entrepreneurs, including investor Peter Thiel, Y Combinator president Sam Altman, and the incubator’s cofounder Jessica Livingston. The nonprofit’s backers have committed $1 billion in funding to the project, and it is being led by Ilya Sutskever, a prominent AI researcher who left Google to join the project, and Greg Brockman, an early employee at the high-profile digital payment company Stripe.

While OpenAI has committed to making the technology it develops publicly available, it could certainly benefit companies backed by Musk and Thiel, as well as those emerging from Y Combinator.

 

Deep Dive

Artificial intelligence

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

Providing the right products at the right time with machine learning

Amid shifting customer needs, CPG enterprises look to machine learning to bolster their data strategy, says global head of MLOps and platforms at Kraft Heinz Company, Jorge Balestra.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.