Skip to Content
Artificial intelligence

How DeepMind plans to stop AI from behaving badly

September 28, 2018

Researchers at the Alphabet subsidiary DeepMind have spelled out how they will ensure that AI is developed safely.

The guidelines aim to make certain that powerful systems capable of learning and figuring out their own solutions to problems don’t start to behave in unexpected and unwanted ways.

The big issues: The researchers say the key challenges are specifying the intended behavior of a system in a way that avoids unwanted consequences; making it robust even in the face of unpredictability; and providing assurances, or ways to override behavior if necessary.

Erratic behavior: This is a growing area of academic research. There are plenty of often amusing examples of machine-learning systems that have started behaving oddly. Take, for example, the AI agent that taught itself a rather bizarre way to rack up points in the game CoastRunners. The AI learned it could accumulate more points not by finishing a race, as was intended, but by hitting certain obstacles around the course instead (as in the gif above). DeepMind’s AI Safety team has also shown ways to have an AI agent shut itself off if it starts behaving in ways that might prove risky.

Far out: We shouldn’t worry unduly about AI systems becoming dangerously autonomous. In any case, there are far greater issues to worry about right now, including the bias that may lurk in AI algorithms or the fact that many machine-learning systems are difficult to understand.

Deep Dive

Artificial intelligence

open sourcing language models concept
open sourcing language models concept

Meta has built a massive new language AI—and it’s giving it away for free

Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3

Yann LeCun
Yann LeCun

Yann LeCun has a bold new vision for the future of AI

One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

AGI is just chatter for now concept
AGI is just chatter for now concept

The hype around DeepMind’s new AI model misses what’s actually cool about it

Some worry that the chatter about these tools is doing the whole field a disservice.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.