Intelligent Machines

A Biologically Inspired Visual Search Engine

A startup’s new technology will let smart phones recognize objects by mimicking the human visual system.

Ever found a product in a store and wondered if you could get it cheaper somewhere else? Soon a visual search tool will be able to help. Take a snapshot of the product with your phone and it will automatically pull up online pricing information.

Wine time: An app called WINEfindr uses technology developed by Cortexica to identify bottles, and then find comparative pricing information online.

The technology, developed by Cortexica, a startup spun out of research conducted at Imperial College London, has already been used to create a wine comparison app called WINEfindr. Last week, the company launched an application-programming interface (API) for the technology, which will allow others to build similar apps.

“It’s a bit like the bar-code scanning apps that link a physical object in the real world to online content,” says Anil Bharath, a researcher at Imperial and cofounder of Cortexica. “But rather than having to create a QR code, it recognizes the object itself,” he says.

Cortexica’s VisualSearch platform uses techniques inspired by the human vision system to compensate for different lighting conditions. It identifies key features of an object irrespective of their orientation, size, or how dark or light they appear in the image. This makes it possible to identify products at a distance or even while they are moving. Cortexica’s technology can also spot logos and objects in videos.

“The technology is interesting, but they aren’t giving away much,” says James Ferryman of the computer-vision group at the University of Reading, in the U.K.

Ferryman notes that other visual search tools already exist, such as Google’s Goggles, which recognizes many objects, labels, and landmarks and automatically searches the Web for information about them; and TinEye, a service that lets users upload an image and search the Web to find webpages on which the thing pictured appears.

Another of Cortexica’s cofounders, Jeffrey Ng, says his company’s technology is more accurate and scalable than any other now available.

The human vision system compares different points of an image with its neighbors—a phenomenon known as “edge extraction”—in order to identify features in a range of different conditions. “We have basically copied that architecture,” says Bharath. Cortexica uses graphical processing units (GPUs) to handle the parallel processing.

Coping with variations and resolving them is a major issue in computational vision, says Ferryman. “It’s crucial. If you can’t have this invariance, then you can’t do reliable matching,” he says.

Get stories like this before anyone else with First Look.

Subscribe today
Already a Premium subscriber? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium

$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.

  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look. Exclusive early access to stories.

    Insider Conversations. Join in and ask questions as our editors talk to innovators from around the world.

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.