Select your localized edition:

Close ×

More Ways to Connect

Discover one of our 28 local entrepreneurial communities »

Be the first to know as we launch in new countries and markets around the globe.

Interested in bringing MIT Technology Review to your local market?

MIT Technology ReviewMIT Technology Review - logo

 

Unsupported browser: Your browser does not meet modern web standards. See how it scores »

Most brain-computer interfaces are designed to help disabled people communicate or move around. A new project is using this type of interface to help computers perform tasks they can’t manage on their own. In experiments, researchers used the interface to sort through satellite images for surface-to-air missiles faster than any machine or human analyst could manage alone.

“With Google, you have to type in words to describe what you’re interested in,” says Paul Sajda, an associate professor at Columbia University. “But let’s say I’m interested in something ‘funny looking.’ ”

Sajda explains that computers struggle to classify images according to this kind of abstract concept, but humans can do it almost instantly. Electrical signals within the brain fire before a person even realizes he’s recognized an image as odd or unusual.

Sajda’s device, called C3Vision (cortically coupled computer vision), uses an electroencephalogram (EEG) cap to monitor brain activity as the person wearing it is shown about 10 images per second. Machine-learning algorithms trained to detect the neurological signals that signify interest in an image are used to analyze this brain activity. By monitoring these signals, the system rapidly ranks the images in terms of how interesting they appear to the viewer. The search is then refined by retrieving other images that are similar to those with the highest rank. “It’s a search tool that allows you to find images that are very similar to those that have grabbed your attention,” says Sajda.

At the speed at which it works, the conscious brain is unable to register a “hit.” But the neurological visual pathways work much faster, says Sajda. The brain produces distinct electrical signals that can be detected and decoded by the 64 EEG electrodes within the cap. “It’s on the edge of the subconscious,” he says.

Most brain-computer interface research is focused on harnessing conscious processes, says Eric Leuthardt, director of the Center for Innovation in Neuroscience and Technology at Washington University School of Medicine. “Reading our brain signals and being able to distinguish ‘interesting’ from ‘not interesting’ prior to us having a conscious perception of seeing the item tells us that there is a substantial amount of processing that our brain does prior to the conscious awareness of the perception.”

Andrew Blake, a computer vision expert and managing director of Microsoft Research Cambridge, in the U.K., says that “controlling machines directly from brain activity is a subject of intense research interest, but it is very difficult to obtain precise control, particularly without invasive methods.”

Sajda calls the approach “information triage” because it uses limited information from the brain to help refine an image search. “The key is, we don’t show the whole database. We take a small sample and show it very rapidly,” says Sajda. “From 10,000 images, we may show just 100 or so.”

This process can deliver any images that grab the subject’s attention. “One of the cool things about the idea is, if you see something new you didn’t expect, and it grabs your attention, then this will also get a relatively high score,” he says.

Sajda and colleagues at Columbia have founded a spinoff company called Neuromatters to commercialize the technology with $4.6 million in funding from the Defense Advanced Research Projects Agency. Along with military applications, Sajda says possible applications might include advanced gaming interfaces and neuro-marketing. “It could be used for getting demographic feedback on how much an advert grabs people’s attention,” he says.

2 comments. Share your thoughts »

Credit: Neuromatters

Tagged: Computing, search, EEG, computer vision, brain-computer interfaces

Reprints and Permissions | Send feedback to the editor

From the Archives

Close

Introducing MIT Technology Review Insider.

Already a Magazine subscriber?

You're automatically an Insider. It's easy to activate or upgrade your account.

Activate Your Account

Become an Insider

It's the new way to subscribe. Get even more of the tech news, research, and discoveries you crave.

Sign Up

Learn More

Find out why MIT Technology Review Insider is for you and explore your options.

Show Me
×

A Place of Inspiration

Understand the technologies that are changing business and driving the new global economy.

September 23-25, 2014
Register »