Brain power: A monkey with an array of tiny electrodes implanted into his brain uses his thoughts to control a robotic arm, grabbing a piece of marshmallow and bringing it to his mouth. Scientists ultimately hope that this type of brain machine interface will help paralyzed people perform everyday tasks, like feeding themselves or brushing their hair.
Andrew Schwartz et al.

Biomedicine

Monkey Thinks Robot into Action

A monkey is able to feed itself with a robotic arm.

  • Wednesday, May 28, 2008
  • By Emily Singer

In a dramatic display of the potential of prosthetic arms, a monkey at the University of Pittsburgh was able to use his brain to directly control a robotic arm and feed himself a marshmallow. The research, published today in the journal Nature, is the first to show that an interface that converts brain signals directly into action is sophisticated enough to perform a practical function: eating. Researchers who led the work have just begun human tests of a related technology.

"It's the first time a monkey--or a human--is directly, with their brain, controlling a real prosthetic arm," says Krishna Shenoy, a neuroscientist at Stanford University who was not involved in the research.

People who suffer from strokes or spinal cord injury, or from some neurodegenerative diseases, such as amyotrophic lateral sclerosis (ALS), are often left paralyzed. But their cerebral cortices--the parts of the brain that control movement, planning, and other functions--may remain largely intact. Scientists hope to capitalize on that with the development of brain machine interfaces--devices that convert brain activity into action, such as movement of a cursor on a computer screen.

People who are completely paralyzed can now use brain machine interfaces that noninvasively measure signals recorded from the surface of the scalp, but the devices are slow and require sustained concentration to operate. To create a prosthesis that works like a real arm--the user thinks about moving his arm, and it moves--will most likely require that electrical activity be recorded directly from the brain.

Advertisement

That has become possible in recent years, thanks to advances in the tiny arrays of electrodes used to record neural signals. In previous research, John Donoghue and his colleagues at Brown University showed that electrodes implanted into the brain of a paralyzed man could be used to move a cursor on a computer screen and even make a simple movement with a robotic arm. But that and other research have been limited to one- or two-dimensional movements, and, other than a few cases using a mechanical arm or gripper, were performed virtually, on a screen.

In the latest research, headed by neuroscientist Andrew Schwartz at the University of Pittsburgh, the monkey was able to perform a more complicated task. "Andy has taken this one step further, to a practical device that could be of use in the real world," says John Kalaska, a neuroscientist at the University of Montreal, in Canada, who wrote a commentary accompanying the publication. "The animal can simply, through a kind of mental practice, get the robot to move toward where the [food] is, close the hand, and bring it back to the mouth and let him eat it."

To achieve the feat, two monkeys had a grid of microelectrodes implanted into the motor cortex, part of the brain that controls motor planning and execution. The animals had previously been trained to move an anthropomorphic robotic arm, with moveable joints at the shoulder, elbow, and wrist, using a joystick. To learn to control the prosthesis with their minds, the monkeys had their arms temporarily restrained as they watched a computer move the arm through the required motions--to extend the arm to the piece of food, grip it, bring it to the mouth, and release it. "They imagine themselves doing the task, like athletes do for sports," says Schwartz. "The neurons are active as they observe the movement, and then we can capture the [neural signals] and use them for our own control."

Print

Related Articles

Brain Interfaces Made of Silk

Gentler, softer electrodes wrap around the folds of the brain to take higher-resolution measurements.

Reading the Surface of the Brain

A startup aims to develop a minimally invasive neural prosthesis for disabled patients.

Tongue Control

Sensory feedback via the tongue might improve neural prostheses.

Close Comments

To comment, please sign in or register

Forgot my password

msreid

27 Comments

  • 1354 Days Ago
  • 05/28/2008

Great tech for the disabled

This is really exciting for its possible uses to help the disabled lead more normal lives.  It will take a while, but I believe in 10-15 years we will start to see commercial devices for disabled people.  I guess one day we'll get to the point where if you are getting ready to die we can just put your brain in a robot that gives it oxygen and nourishment, and you'll just pick up life where you left off.  A bit scary to think about, but a bit intriguing too.

Reply

brainandspinalcord

9 Comments

  • 1244 Days Ago
  • 09/15/2008

Re: Great tech for the disabled

This device would probably not be within the budget of most disabled people, but we'll certainly keep watch for it!

Reply

pkassebaum

11 Comments

  • 1354 Days Ago
  • 05/28/2008

behind the times

This article highlights what seems to be a terribly outdated version of the prosthetic arm demonstrated here.

Reply

Emily Singer

26 Comments

  • 1354 Days Ago
  • 05/28/2008

Re: behind the times

The arm being developed by Dean Kamen is certainly exciting, but it is not controlled by the brain. In the demonstrations I have seen, it was controlled by a foot pedal and by residual muscle activity in the upper body. This approach wouldn't work for people with high levels of paralysis. I bet the two technologies will ultimately be combined in some form.

Reply

pkassebaum

11 Comments

  • 1353 Days Ago
  • 05/29/2008

Re: behind the times

A foot pedal and residual muscle activity?  I was certainly duped by Kamen's TED talk.  Thanks for the insight.

It would be quite awesome for the two projects to come together.

Reply

Monsterboy

92 Comments

  • 1354 Days Ago
  • 05/28/2008

This could be pretty huge.

Humanitarian concerns are great, but ALS is a niche market at best. This would have applications in all manner of machine interfacing, especially remote operations. If the procedure and training can be standardized, can a neural USB be for behind?

Reply

tfrijnts

6 Comments

  • 1353 Days Ago
  • 05/29/2008

talking monkeys?

Could this technology be used to check if certain apes have the brain capacity, but just not the vocal cords, to speak?

Reply

Advertisement

theapp

5 Comments

  • 1347 Days Ago
  • 06/04/2008

Re: talking monkeys?

Wouldn't the fact that a few apes have successfully been taught sign language and have even adapted the "words" they knew to new situations to describe a situation indicate that they are able to speak (or at least have the brain capacity) but lack the ability due to vocal capabilities.  A quick google search on sign language apes pulled up numerous projects indicating that apes are smart enough to learn a language.

Reply

phoenix

172 Comments

  • 1353 Days Ago
  • 05/29/2008

monkey see, monkey do.

Judith Merril, whose presence was a major guiding force in the Sci-Fi world right up until her death, published an Anthology Series ( 1-12 )of the top Science Fiction writers of that time which is recommended reading for any budding enthusiast of the genre. One story in particular comes to mind about a parapelegic who was able to control a biologic counterpart on another planet just through his thought processes.

Reply

urian1975

16 Comments

  • 1353 Days Ago
  • 05/29/2008

Super soldier

you can bet the US military already owns half of this company

Reply

Danieleveld

28 Comments

  • 1353 Days Ago
  • 05/29/2008

TRUELY Behind the Times

I wrote about this technology back in 2003 when Duke University first did it with a rhesus monkey. The report was first published in Oct. 13 2003, and described using microelectrodes implanted in the hemisphere of the brain, sending data to a computer which translated it into mechanical movement via a robotic arm.

Reply

Emily Singer

26 Comments

  • 1353 Days Ago
  • 05/29/2008

Re: TRUELY Behind the Times

This research definitely builds on  Miguel Nicolelis's work at Duke in 2003. But the difference is the complexity of the movement the monkey achieved. In this case, he could move the arm with three degrees of freedom (and that's not counting the ability to open and close the gripper, which makes it about 3.5.) That allowed the monkey to perform a task that is of relevance in the real world - the ability to feed oneself - which had not previously been demonstrated.

Reply

Shiladie

56 Comments

  • 1353 Days Ago
  • 05/29/2008

Level of Control

People need to realise the breakthrough here isn't that it 'can' be moved around by the brain, but by the level of control that is possible, and also intuitive.  There appears to be minimal retraining required to get the arm to move how you want.

"If a monkey can do it"

I also agree that if this can be done, would it be possible in the next 5-10 years to make a similar device for voice?

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Videos

The Virtual Nurse Will See You Now

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Layar

PrimeSense

Netflix

Akamai

More

Advertisement

Facebook

Advertisement