Select your localized edition:

Close ×

More Ways to Connect

Discover one of our 28 local entrepreneurial communities »

Be the first to know as we launch in new countries and markets around the globe.

Interested in bringing MIT Technology Review to your local market?

MIT Technology ReviewMIT Technology Review - logo

 

Unsupported browser: Your browser does not meet modern web standards. See how it scores »

{ action.text }

The number of images recorded by security cameras each day vastly exceeds human analysts’ ability to examine them. “Computer vision” systems aren’t much help: they’re still far too primitive to tell a prowler from a postman. But researchers say the human brain can subconsciously register an anomaly in a scene – say, a shadow where there shouldn’t be one – much faster than a person can visually and verbally identify it. If computers could somehow monitor the brain and flag these “aha” moments, surveillance analysts might be able to scan many times more images per hour.

That’s what Paul Sajda, a bioengineer at Columbia University’s Laboratory for Intelligent Imaging and Neural Computing, hopes to enable with his “cortically coupled computer vision” system, or “C3Vision.” Sajda’s prototype, built with a grant from the U.S. Defense Advanced Research Projects Agency, includes a bonnet of electrodes that is placed on a subject’s head, where it monitors changes in the brain’s electrical activity. A computer scrutinizes those changes for the neural signatures of interesting events and images, as the subject watches a video running at 10 times its normal speed. The flagged images are picked out for a more intensive examination.

“We are aiming to speed up [visual] search by 300 percent,” says Sajda. “The system is designed not only for finding very specific targets but also things image analysts think are ‘unusual,’ which is very difficult to do with a computer vision system.”

Such devices could help law enforcement or counterterrorism officials spot signs of suspicious activity that would otherwise slip by as they scanned surveillance images. “Any system that can help process those images and prioritize them as to likelihood of containing important data is a vast improvement over the current situation,” says Leif Finkel, a professor of bioengineering at the University of Pennsylvania, who was Sajda’s doctoral thesis advisor.

Outside the security realm, radiologists hooked up to the C3Vision system could quickly screen hundreds of mammograms to identify those requiring a closer look, and photo researchers could use it to single out pictures of a particular person among the millions of photographs on the Web. “People are amazingly accurate at identifying whether a particular image – say, of Marilyn Monroe, or the Washington Monument – was presented as one photo” in a series of hundreds, even at a speed of 10 to 20 images per second, says Finkel.

According to Sajda’s recent tests, subjects spotted 90 percent of the “suspicious” images in a series running at 10 images per second.

“I think that it is too early to tell whether this particular approach is going to work in real applications,” says Misha Pavel, a professor of biomedical engineering at Oregon Health Sciences University. “But I have no doubt that we will learn from this approach, and the consequences may be entirely unexpected, novel applications.”

2 comments. Share your thoughts »

Tagged: Biomedicine

Reprints and Permissions | Send feedback to the editor

From the Archives

Close

Introducing MIT Technology Review Insider.

Already a Magazine subscriber?

You're automatically an Insider. It's easy to activate or upgrade your account.

Activate Your Account

Become an Insider

It's the new way to subscribe. Get even more of the tech news, research, and discoveries you crave.

Sign Up

Learn More

Find out why MIT Technology Review Insider is for you and explore your options.

Show Me