Skip to Content

How to Root Out Hidden Biases in AI

Algorithms are making life-changing decisions like denying parole or granting loans. Cynthia Dwork, a computer scientist at Harvard, is developing ways of making sure the machines are operating fairly.
October 24, 2017
Miguel Porlan

Why is it hard for algorithm designers or data scientists to account for bias and unfairness?

Take a work environment that’s hostile to women. Suppose that you define success as the fact that someone holds a job for two to three years and gets a promotion. Then your predictor—based on the historical data—will accurately predict that it’s not a good idea to hire women. What’s interesting here is that we’re not talking about historical hiring decisions. Even if the hiring decisions were totally unbiased, the reality—the real discrimination in the hostile environment—persists. It’s deeper, more structural, more ingrained and harder to overcome.

I believe the great use for machine learning and AI will be in conjunction with really knowledgeable people who know history and sociology and psychology to figure out who should be treated similarly to whom.

I’m not saying computers will never be able to do it, but I don’t see it now. How do you know when you have the right model, and when it’s capturing what really happened in society? You need to have an understanding of what you’re talking about. There’s the famous saying “All models are wrong and some are useful.”

as told to Will Knight

Keep Reading

Most Popular

DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.

“This is a profound moment in the history of technology,” says Mustafa Suleyman.

What to know about this autumn’s covid vaccines

New variants will pose a challenge, but early signs suggest the shots will still boost antibody responses.

Human-plus-AI solutions mitigate security threats

With the right human oversight, emerging technologies like artificial intelligence can help keep business and customer data secure

Next slide, please: A brief history of the corporate presentation

From million-dollar slide shows to Steve Jobs’s introduction of the iPhone, a bit of show business never hurt plain old business.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.