Skip to Content

Pinterest is trying to get you to buy even more things by training your smartphone’s camera on the world around you.

Originally focused on helping people find and collect ideas about everything from couches to cakes in online pin boards, Pinterest has been steadily working to remake itself as a place to shop. A little over a year ago, it started adding “buy” buttons so users could more easily go from simply looking at items on its apps and website to actually purchasing them (see “EmTech Digital: Pinterest’s Bid to Reinvent Online Shopping”). The site, which has 100 million monthly users, now has 10 million buyable pins.

On Tuesday, the San Francisco startup previewed a deep-learning-assisted visual search feature that it hopes will encourage even more shopping. With it, you will eventually be able to snap photos of objects around you—a cool-looking T-shirt worn by someone who breezes past you, for instance—or even a whole room. Then you’ll see similar items that others have pinned to Pinterest, and if they have “buy” buttons, you can purchase them.

Pinterest plans to roll out a visual search feature that can recognize objects in photos you take and find similar things users have posted to its service.

Software engineer Dmitry Kislyuk showed off a demo of the feature by using a Pinterest app on his iPhone to snap photos of items like a watch and a black rain boot; the app then showed a number of items on Pinterest that closely matched the ones in front of him. When he took a picture of a stuffed bunny that it couldn’t immediately identify, a bunch of bubbles popped up with words the app thought were related to the object, which he could tap to conduct a search.

Companies have long tried to marry real-world image recognition with online shopping—Amazon, for instance, has a feature in its mobile app that lets you take pictures of items that it will then attempt to find in its vast online store. But while such features can be helpful for finding, say, a specific DVD or a bottle of wine, it can be harder to use them to track down a succulent plant or a decorative bowl (see “AI Advances Make It Possible to Search, Shop with Images”).

Compared with Amazon’s offering, Kislyuk said, “what we’re trying to build is much more generic.”

Pinterest said its new form of visual search will be available in the coming months. It builds on another feature the company rolled out six months ago that lets you search in real time within images already on Pinterest; the company updated this feature as well on Tuesday, to make it more automated, and said that people have conducted 130 million visual searches per month since it was launched.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.