We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Intelligent Machines

This Is the Robot Maid Elon Musk Is Funding

OpenAI is teaching warehouse robots to do your household chores.

Inside a secretive AI nonprofit backed by Elon Musk and other Silicon Valley figures, a handful of robots designed to help out in warehouses are gradually learning how to do useful household chores.

OpenAI, which was created to do basic AI research, is reprogramming robots developed by Fetch Robotics, a company that supplies warehouse automation hardware. Researchers at OpenAI are equipping the robots with software that lets them train themselves through trial and error.

The effort reflects a bet that innovations in software and machine learning, rather than breakthroughs in hardware, are the way to give robotics remarkable new capabilities. Fetch makes a range of robots for warehouses, including systems that follow workers around a building, carrying items dropped into a basket. OpenAI is using a system that features a mobile base but also 3-D depth sensors, a 2-D laser scanner, and a robotic arm with seven degrees of freedom.

Through reinforcement learning, this robot developed by Fetch Robotics is figuring out how to help around the house.

In April, OpenAI recruited Pieter Abbeel, a professor at the University of California, Berkeley, and a leading expert on robot learning. Abbeel has shown how robots can use a machine-learning approach called deep reinforcement learning to acquire completely new skills that would be hard to program by hand, such as folding towels or retrieving items from a refrigerator. Google DeepMind, an AI subsidiary based in the U.K., uses this technique to get computers to play computer games at a superhuman level (see “Google’s AI Masters Space Invaders”).

Abbeel’s robots learn tasks from scratch, using a neural network that receives sensor input and controls physical movement. The network adjusts its parameters automatically as it inches closer to its goal. A robot might try thousands of grips, for instance, in the process of learning how to hold a certain object.

“If this goal can be achieved, then there will be economic and industrial benefits,” says Marc Deisenroth, an expert on reinforcement learning at Imperial College London. “Imagine a Roomba not only cleaning your floor but also doing the dishes, ironing the shirts, cleaning the windows, preparing breakfast.”

Deisenroth says using off-the-shelf robots could drive costs down. “Currently, the software seems to be the bottleneck,” he adds. “However, independent of this, better hardware could also lead to substantial improvements.” Soft manipulators and elastic feet similar to a monkey’s feet are concepts that researchers have started working on, he says.

Some manufacturers, including the Japanese company Fanuc, are testing reinforcement learning as a way to train industrial robots quickly in new tasks such as learning to grasp unfamiliar objects. When many robots work in parallel, the training time required is reduced accordingly (see “This Factory Robot Learns a New Job Overnight”). Robot researchers at Google are testing similar learning techniques.

“Moving away from having to program robots by hand by endowing robots to learn autonomously is a key element for the future of robotics,” says Jens Kober, an expert on robot learning at Delft University of Technology in the Netherlands. Kober says having robots share the information they have learned will be crucial.

While robots such as those made by Fetch are finding their way into many factories and warehouses, domestic robot helpers remain the stuff of science fiction. Performing seemingly simple tasks like washing dishes or folding laundry in a messy home setting is incredibly hard for a machine. A robot programmed the conventional way can easily be thrown off by an unfamiliar object or a slight variation in lighting.

OpenAI confirmed that it is working with the robots from Fetch, but it declined to comment further. Melonee Wise, the company’s founder, couldn’t be reached for comment (see “Innovators Under 35: Melonee Wise”).

OpenAI was created by Musk and a handful of well-known (and well-heeled) Silicon Valley entrepreneurs, including investor Peter Thiel, Y Combinator president Sam Altman, and the incubator’s cofounder Jessica Livingston. The nonprofit’s backers have committed $1 billion in funding to the project, and it is being led by Ilya Sutskever, a prominent AI researcher who left Google to join the project, and Greg Brockman, an early employee at the high-profile digital payment company Stripe.

While OpenAI has committed to making the technology it develops publicly available, it could certainly benefit companies backed by Musk and Thiel, as well as those emerging from Y Combinator.


Learn from the humans leading the way in machine learning at EmTech Next. Register Today!
June 11-12, 2019
Cambridge, MA

Register now
Through reinforcement learning, this robot developed by Fetch Robotics is figuring out how to help around the house.
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Print Subscription.
  • Print Subscription {! insider.prices.print_only !}*

    {! insider.display.menuOptionsLabel !}

    Six print issues per year plus The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Print magazine (6 bi-monthly issues)

    The Download: newsletter delivery each weekday to your inbox

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.