Skip to Content
Artificial intelligence

Your #sunset photos might have helped improve Facebook’s AI

Instagram users have used hashtags to classify billions of images, unintentionally creating great labels to train the company’s computer vision algorithms.

The news:  Facebook created a data set of 3.5 billion pictures and 17,000 hashtags pulled from public Instagram accounts to improve how well it can recognize objects in images, the company announced on stage at its annual F8 developer conference today. Using a subset of that data set, Facebook was able to label 85.4 percent of photos correctly, the highest level the company has achieved to date.

But: This free labor does have drawbacks: some hashtags like #photooftheday or #tbt—short for throwback Thursday—don’t describe what’s in the image and can confuse the algorithm.

Why it matters: More accurate computer vision could do everything from surface more relevant content to help keep abusive posts off the site. Of course, Mark Zuckerberg has already had to answer for how users’ data gets handled, and not everyone might be happy to find out that their vacation photos are being put to work.

Deep Dive

Artificial intelligence

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

What’s next for generative video

OpenAI's Sora has raised the bar for AI moviemaking. Here are four things to bear in mind as we wrap our heads around what's coming.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.