Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Connectivity

Pinterest Hopes to Woo Shoppers with Visual Search

The idea-sharing network is reinventing itself as an online shopping destination, and now it wants to help you find things to buy in the world around you.

Pinterest is trying to get you to buy even more things by training your smartphone’s camera on the world around you.

Originally focused on helping people find and collect ideas about everything from couches to cakes in online pin boards, Pinterest has been steadily working to remake itself as a place to shop. A little over a year ago, it started adding “buy” buttons so users could more easily go from simply looking at items on its apps and website to actually purchasing them (see “EmTech Digital: Pinterest’s Bid to Reinvent Online Shopping”). The site, which has 100 million monthly users, now has 10 million buyable pins.

On Tuesday, the San Francisco startup previewed a deep-learning-assisted visual search feature that it hopes will encourage even more shopping. With it, you will eventually be able to snap photos of objects around you—a cool-looking T-shirt worn by someone who breezes past you, for instance—or even a whole room. Then you’ll see similar items that others have pinned to Pinterest, and if they have “buy” buttons, you can purchase them.

Pinterest plans to roll out a visual search feature that can recognize objects in photos you take and find similar things users have posted to its service.

Software engineer Dmitry Kislyuk showed off a demo of the feature by using a Pinterest app on his iPhone to snap photos of items like a watch and a black rain boot; the app then showed a number of items on Pinterest that closely matched the ones in front of him. When he took a picture of a stuffed bunny that it couldn’t immediately identify, a bunch of bubbles popped up with words the app thought were related to the object, which he could tap to conduct a search.

Companies have long tried to marry real-world image recognition with online shopping—Amazon, for instance, has a feature in its mobile app that lets you take pictures of items that it will then attempt to find in its vast online store. But while such features can be helpful for finding, say, a specific DVD or a bottle of wine, it can be harder to use them to track down a succulent plant or a decorative bowl (see “AI Advances Make It Possible to Search, Shop with Images”).

Compared with Amazon’s offering, Kislyuk said, “what we’re trying to build is much more generic.”

Pinterest said its new form of visual search will be available in the coming months. It builds on another feature the company rolled out six months ago that lets you search in real time within images already on Pinterest; the company updated this feature as well on Tuesday, to make it more automated, and said that people have conducted 130 million visual searches per month since it was launched.

Couldn't make it to Cambridge? We've brought EmTech MIT to you!

Watch session videos
Pinterest plans to roll out a visual search feature that can recognize objects in photos you take and find similar things users have posted to its service.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.