Skip to Content

A New AI Ethics Center Shows Growing Angst About Machine Smarts

The pace of progress in artificial intelligence has unsettled many experts, but the biggest risk of all may be inscrutability.
November 3, 2016

Let's face it: the pace of progress in artificial intelligence can sometimes seem unsettling. Terminator-style machines remain science fiction, but AI could have a huge impact on employment, introduce bias into algorithms, and contribute to the development of autonomous weapons. But perhaps the biggest looming threat may be making sure we understand how these increasingly complex systems work when they go awry.

The latest evidence that even the experts are concerned about this is the creation of a new AI ethics research center at Carnegie Mellon University. The new center, called K&< Gates Endowment for Ethics and Computational Technologies, is funded with $10 million from K&< Gates, an international law firm based in Pittsburgh.

Anxiety over machine intelligence has been gaining momentum. Last month the White House released a report assessing the potential effects of AI. And several of the world's largest tech companies recently joined forces to create an organization, called Partnership on AI, to study the technology and its potential impacts.

In a statement, CMU's president, Subra Suresh, said it will be important to consider the human side of all AI systems. “It is not just technology that will determine how this century unfolds," he said. "Our future will also be influenced strongly by how humans interact with technology, how we foresee and respond to the unintended consequences of our work, and how we ensure that technology is used to benefit humanity, individually and as a society." 

CMU itself is experiencing some teething pains due to advances in AI. Last year its robotics department was raided by Uber for a nearby research center dedicated to automated driving. At the same time, the university is spinning out AI-powered startups and consulting with big companies on various AI projects.

Besides unemployment, algorithmic bias, and autonomous weapons, one of the most significant—and least appreciated—consequences of AI could be the way we come to rely on systems that are inscrutable because no one programmed them. This issue is already appearing in some situations, while some experts are trying to devise machine-learning systems that are able to explain their workings.

(Read more: Carnegie Mellon UniversityNature, MIT News, "Obama: My Successor Will Govern a Country Being Transformed by AI," "Tech Titans Join Forces to Stop AI from Behaving Badly")

Keep Reading

Most Popular

DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.

“This is a profound moment in the history of technology,” says Mustafa Suleyman.

What to know about this autumn’s covid vaccines

New variants will pose a challenge, but early signs suggest the shots will still boost antibody responses.

Human-plus-AI solutions mitigate security threats

With the right human oversight, emerging technologies like artificial intelligence can help keep business and customer data secure

Next slide, please: A brief history of the corporate presentation

From million-dollar slide shows to Steve Jobs’s introduction of the iPhone, a bit of show business never hurt plain old business.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.