The algorithm that determines the credit limit for users of Apple’s new credit card, which launched in the US in August, is facing an investigation because it appears to give men higher limits than women.
The news: On November 7, web entrepreneur David Heinemeier Hansson posted a now-viral tweet saying that the Apple Card had given him 20 times the credit limit of his wife. This was despite the fact that they filed joint tax returns and that, upon investigation, his wife had a better credit score than he did. Apple cofounder Steve Wozniak replied to the tweet and said that he, too, had been granted 10 times the credit limit of his wife, even though they have no separate assets or bank accounts.
Upshot: Now New York’s Department of Financial Services is launching an investigation into Goldman Sachs, which manages the card. Its superintendent, Linda Lacewell, said in a blog post that the watchdog would “examine whether the algorithm used to make these credit limit decisions violates state laws that prohibit discrimination on the basis of sex.” The regulator has already recently opened an investigation into reports that an algorithm resulted in black patients receiving less comprehensive care than white patients.
Wider problem: Goldman Sachs posted a statement on Twitter over the weekend, saying that gender is not taken into account when determining creditworthiness. But the unexplainable disparity in the card’s credit limits is yet another example of how algorithmic bias can be unintentionally created. Algorithms of the sort used to assess creditworthiness are trained on years of historical data, and bias can slip into the process in a number of different ways.
Artificial intelligence is creating a new colonial world order
An MIT Technology Review series investigates how AI is enriching a powerful few by dispossessing communities that have been dispossessed before.
Meta has built a massive new language AI—and it’s giving it away for free
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
This horse-riding astronaut is a milestone in AI’s journey to make sense of the world
OpenAI’s latest picture-making AI is amazing—but raises questions about what we mean by intelligence.
How the AI industry profits from catastrophe
As the demand for data labeling exploded, an economic catastrophe turned Venezuela into ground zero for a new model of labor exploitation.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.