Why is it hard for algorithm designers or data scientists to account for bias and unfairness?
Take a work environment that’s hostile to women. Suppose that you define success as the fact that someone holds a job for two to three years and gets a promotion. Then your predictor—based on the historical data—will accurately predict that it’s not a good idea to hire women. What’s interesting here is that we’re not talking about historical hiring decisions. Even if the hiring decisions were totally unbiased, the reality—the real discrimination in the hostile environment—persists. It’s deeper, more structural, more ingrained and harder to overcome.
I believe the great use for machine learning and AI will be in conjunction with really knowledgeable people who know history and sociology and psychology to figure out who should be treated similarly to whom.
I’m not saying computers will never be able to do it, but I don’t see it now. How do you know when you have the right model, and when it’s capturing what really happened in society? You need to have an understanding of what you’re talking about. There’s the famous saying “All models are wrong and some are useful.”
—as told to Will Knight
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
How Rust went from a side project to the world’s most-loved programming language
For decades, coders wrote critical systems in C and C++. Now they turn to Rust.
Design thinking was supposed to fix the world. Where did it go wrong?
An approach that promised to democratize design may have done the opposite.
Sam Altman invested $180 million into a company trying to delay death
Can anti-aging breakthroughs add 10 healthy years to the human life span? The CEO of OpenAI is paying to find out.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.