The algorithm that determines the credit limit for users of Apple’s new credit card, which launched in the US in August, is facing an investigation because it appears to give men higher limits than women.
The news: On November 7, web entrepreneur David Heinemeier Hansson posted a now-viral tweet saying that the Apple Card had given him 20 times the credit limit of his wife. This was despite the fact that they filed joint tax returns and that, upon investigation, his wife had a better credit score than he did. Apple cofounder Steve Wozniak replied to the tweet and said that he, too, had been granted 10 times the credit limit of his wife, even though they have no separate assets or bank accounts.
Upshot: Now New York’s Department of Financial Services is launching an investigation into Goldman Sachs, which manages the card. Its superintendent, Linda Lacewell, said in a blog post that the watchdog would “examine whether the algorithm used to make these credit limit decisions violates state laws that prohibit discrimination on the basis of sex.” The regulator has already recently opened an investigation into reports that an algorithm resulted in black patients receiving less comprehensive care than white patients.
Wider problem: Goldman Sachs posted a statement on Twitter over the weekend, saying that gender is not taken into account when determining creditworthiness. But the unexplainable disparity in the card’s credit limits is yet another example of how algorithmic bias can be unintentionally created. Algorithms of the sort used to assess creditworthiness are trained on years of historical data, and bias can slip into the process in a number of different ways.
This new data poisoning tool lets artists fight back against generative AI
The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models.
Rogue superintelligence and merging with machines: Inside the mind of OpenAI’s chief scientist
An exclusive conversation with Ilya Sutskever on his fears for the future of AI and why they’ve made him change the focus of his life’s work.
Driving companywide efficiencies with AI
Advanced AI and ML capabilities revolutionize how administrative and operations tasks are done.
Unpacking the hype around OpenAI’s rumored new Q* model
If OpenAI's new model can solve grade-school math, it could pave the way for more powerful systems.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.