Skip to Content

The Dangers of Tech-Bro AI

Tabitha Goldstaub, a cofounder of CognitionX, which helps companies deploy AI, says that diversifying the field is necessary to make sure products actually work well.
October 24, 2017
Miguel Porlan

If you think about artificial intelligence and the core components of what makes an AI, you have the fact that it’s given a goal and then will find a way to reach that goal. It’s then often very un-transparent as to how it reached that goal. If you’re building into a machine some unconscious bias, you might not know that it’s there; the output could be detrimental to women and it’s very tough to work out exactly why that has happened.

In traditional technology, you can see [what has happened]: women dying in car crashes because the crash-test dummies were the shape of a man rather than the shape of a woman. [With AI there could be] similar life-or-death situations, in drug trials or in autonomous vehicles and things like that.

There are some examples of [gender bias in AI today]: Google ads displaying higher-earning [job] ads to men than women. We can hypothesize other types of situations that would happen—what if women weren’t as able to get loans or mortgages or insurance?

I don’t have a dystopian view of AI. I don’t see killer robots. I’m so much more focused on the narrow applications, and I think that if you look at every single one of those narrow applications there is a chance that it negatively affects women. I don’t think artificial intelligence is the issue here; it’s the additional issue rather than the cause. We’re talking about the risk that our unconscious sexism or unconscious racism seep into the machines that we’re building.

How do we get anyone who’s building AI to think about these things? We need to have consumers demand ethical AI. Not enough people are seeing this as more than just a gender issue; this is an actual, fundamental product issue.

as told to Rachel Metz

Keep Reading

Most Popular

Geoffrey Hinton tells us why he’s now scared of the tech he helped build

“I have suddenly switched my views on whether these things are going to be more intelligent than us.”

ChatGPT is going to change education, not destroy it

The narrative around cheating students doesn’t tell the whole story. Meet the teachers who think generative AI could actually make learning better.

Meet the people who use Notion to plan their whole lives

The workplace tool’s appeal extends far beyond organizing work projects. Many users find it’s just as useful for managing their free time.

Learning to code isn’t enough

Historically, learn-to-code efforts have provided opportunities for the few, but new efforts are aiming to be inclusive.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.