Inside a secretive AI nonprofit backed by Elon Musk and other Silicon Valley figures, a handful of robots designed to help out in warehouses are gradually learning how to do useful household chores.
OpenAI, which was created to do basic AI research, is reprogramming robots developed by Fetch Robotics, a company that supplies warehouse automation hardware. Researchers at OpenAI are equipping the robots with software that lets them train themselves through trial and error.
Advertisement
The effort reflects a bet that innovations in software and machine learning, rather than breakthroughs in hardware, are the way to give robotics remarkable new capabilities. Fetch makes a range of robots for warehouses, including systems that follow workers around a building, carrying items dropped into a basket. OpenAI is using a system that features a mobile base but also 3-D depth sensors, a 2-D laser scanner, and a robotic arm with seven degrees of freedom.
This story is only available to subscribers.
Don’t settle for half the story.
Get paywall-free access to technology news for the here and now.
Through reinforcement learning, this robot developed by Fetch Robotics is figuring out how to help around the house.
In April, OpenAI recruited Pieter Abbeel, a professor at the University of California, Berkeley, and a leading expert on robot learning. Abbeel has shown how robots can use a machine-learning approach called deep reinforcement learning to acquire completely new skills that would be hard to program by hand, such as folding towels or retrieving items from a refrigerator. Google DeepMind, an AI subsidiary based in the U.K., uses this technique to get computers to play computer games at a superhuman level (see “Google’s AI Masters Space Invaders”).
Abbeel’s robots learn tasks from scratch, using a neural network that receives sensor input and controls physical movement. The network adjusts its parameters automatically as it inches closer to its goal. A robot might try thousands of grips, for instance, in the process of learning how to hold a certain object.
“If this goal can be achieved, then there will be economic and industrial benefits,” says Marc Deisenroth, an expert on reinforcement learning at Imperial College London. “Imagine a Roomba not only cleaning your floor but also doing the dishes, ironing the shirts, cleaning the windows, preparing breakfast.”
Deisenroth says using off-the-shelf robots could drive costs down. “Currently, the software seems to be the bottleneck,” he adds. “However, independent of this, better hardware could also lead to substantial improvements.” Soft manipulators and elastic feet similar to a monkey’s feet are concepts that researchers have started working on, he says.
Some manufacturers, including the Japanese company Fanuc, are testing reinforcement learning as a way to train industrial robots quickly in new tasks such as learning to grasp unfamiliar objects. When many robots work in parallel, the training time required is reduced accordingly (see “This Factory Robot Learns a New Job Overnight”). Robot researchers at Google are testing similar learning techniques.
“Moving away from having to program robots by hand by endowing robots to learn autonomously is a key element for the future of robotics,” says Jens Kober, an expert on robot learning at Delft University of Technology in the Netherlands. Kober says having robots share the information they have learned will be crucial.
While robots such as those made by Fetch are finding their way into many factories and warehouses, domestic robot helpers remain the stuff of science fiction. Performing seemingly simple tasks like washing dishes or folding laundry in a messy home setting is incredibly hard for a machine. A robot programmed the conventional way can easily be thrown off by an unfamiliar object or a slight variation in lighting.
Advertisement
OpenAI confirmed that it is working with the robots from Fetch, but it declined to comment further. Melonee Wise, the company’s founder, couldn’t be reached for comment (see “Innovators Under 35: Melonee Wise”).
OpenAI was created by Musk and a handful of well-known (and well-heeled) Silicon Valley entrepreneurs, including investor Peter Thiel, Y Combinator president Sam Altman, and the incubator’s cofounder Jessica Livingston. The nonprofit’s backers have committed $1 billion in funding to the project, and it is being led by Ilya Sutskever, a prominent AI researcher who left Google to join the project, and Greg Brockman, an early employee at the high-profile digital payment company Stripe.
While OpenAI has committed to making the technology it develops publicly available, it could certainly benefit companies backed by Musk and Thiel, as well as those emerging from Y Combinator.
