Skip to Content

Pinterest is trying to get you to buy even more things by training your smartphone’s camera on the world around you.

Originally focused on helping people find and collect ideas about everything from couches to cakes in online pin boards, Pinterest has been steadily working to remake itself as a place to shop. A little over a year ago, it started adding “buy” buttons so users could more easily go from simply looking at items on its apps and website to actually purchasing them (see “EmTech Digital: Pinterest’s Bid to Reinvent Online Shopping”). The site, which has 100 million monthly users, now has 10 million buyable pins.

On Tuesday, the San Francisco startup previewed a deep-learning-assisted visual search feature that it hopes will encourage even more shopping. With it, you will eventually be able to snap photos of objects around you—a cool-looking T-shirt worn by someone who breezes past you, for instance—or even a whole room. Then you’ll see similar items that others have pinned to Pinterest, and if they have “buy” buttons, you can purchase them.

Pinterest plans to roll out a visual search feature that can recognize objects in photos you take and find similar things users have posted to its service.

Software engineer Dmitry Kislyuk showed off a demo of the feature by using a Pinterest app on his iPhone to snap photos of items like a watch and a black rain boot; the app then showed a number of items on Pinterest that closely matched the ones in front of him. When he took a picture of a stuffed bunny that it couldn’t immediately identify, a bunch of bubbles popped up with words the app thought were related to the object, which he could tap to conduct a search.

Companies have long tried to marry real-world image recognition with online shopping—Amazon, for instance, has a feature in its mobile app that lets you take pictures of items that it will then attempt to find in its vast online store. But while such features can be helpful for finding, say, a specific DVD or a bottle of wine, it can be harder to use them to track down a succulent plant or a decorative bowl (see “AI Advances Make It Possible to Search, Shop with Images”).

Compared with Amazon’s offering, Kislyuk said, “what we’re trying to build is much more generic.”

Pinterest said its new form of visual search will be available in the coming months. It builds on another feature the company rolled out six months ago that lets you search in real time within images already on Pinterest; the company updated this feature as well on Tuesday, to make it more automated, and said that people have conducted 130 million visual searches per month since it was launched.

Keep Reading

Most Popular

This startup wants to copy you into an embryo for organ harvesting

With plans to create realistic synthetic embryos, grown in jars, Renewal Bio is on a journey to the horizon of science and ethics.

VR is as good as psychedelics at helping people reach transcendence

On key metrics, a VR experience elicited a response indistinguishable from subjects who took medium doses of LSD or magic mushrooms.

This nanoparticle could be the key to a universal covid vaccine

Ending the covid pandemic might well require a vaccine that protects against any new strains. Researchers may have found a strategy that will work.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.