Technology Review - Published By MIT
Advertisement
[1] 2 Next »

Wednesday, May 28, 2008

Monkey Thinks Robot into Action

A monkey is able to feed itself with a robotic arm.

By Emily Singer

smaller text tool iconmedium text tool iconlarger text tool icon
Brain power: A monkey with an array of tiny electrodes implanted into his brain uses his thoughts to control a robotic arm, grabbing a piece of marshmallow and bringing it to his mouth. Scientists ultimately hope that this type of brain machine interface will help paralyzed people perform everyday tasks, like feeding themselves or brushing their hair.
Credit: Andrew Schwartz et al.
Multimedia
video  Watch the monkey use the robotic arm to feed himself.
video  See the monkey manipulate the robotic arm so that he can lick the robotic hand.

In a dramatic display of the potential of prosthetic arms, a monkey at the University of Pittsburgh was able to use his brain to directly control a robotic arm and feed himself a marshmallow. The research, published today in the journal Nature, is the first to show that an interface that converts brain signals directly into action is sophisticated enough to perform a practical function: eating. Researchers who led the work have just begun human tests of a related technology.

"It's the first time a monkey--or a human--is directly, with their brain, controlling a real prosthetic arm," says Krishna Shenoy, a neuroscientist at Stanford University who was not involved in the research.

People who suffer from strokes or spinal cord injury, or from some neurodegenerative diseases, such as amyotrophic lateral sclerosis (ALS), are often left paralyzed. But their cerebral cortices--the parts of the brain that control movement, planning, and other functions--may remain largely intact. Scientists hope to capitalize on that with the development of brain machine interfaces--devices that convert brain activity into action, such as movement of a cursor on a computer screen.

People who are completely paralyzed can now use brain machine interfaces that noninvasively measure signals recorded from the surface of the scalp, but the devices are slow and require sustained concentration to operate. To create a prosthesis that works like a real arm--the user thinks about moving his arm, and it moves--will most likely require that electrical activity be recorded directly from the brain.

That has become possible in recent years, thanks to advances in the tiny arrays of electrodes used to record neural signals. In previous research, John Donoghue and his colleagues at Brown University showed that electrodes implanted into the brain of a paralyzed man could be used to move a cursor on a computer screen and even make a simple movement with a robotic arm. But that and other research have been limited to one- or two-dimensional movements, and, other than a few cases using a mechanical arm or gripper, were performed virtually, on a screen.

In the latest research, headed by neuroscientist Andrew Schwartz at the University of Pittsburgh, the monkey was able to perform a more complicated task. "Andy has taken this one step further, to a practical device that could be of use in the real world," says John Kalaska, a neuroscientist at the University of Montreal, in Canada, who wrote a commentary accompanying the publication. "The animal can simply, through a kind of mental practice, get the robot to move toward where the [food] is, close the hand, and bring it back to the mouth and let him eat it."

To achieve the feat, two monkeys had a grid of microelectrodes implanted into the motor cortex, part of the brain that controls motor planning and execution. The animals had previously been trained to move an anthropomorphic robotic arm, with moveable joints at the shoulder, elbow, and wrist, using a joystick. To learn to control the prosthesis with their minds, the monkeys had their arms temporarily restrained as they watched a computer move the arm through the required motions--to extend the arm to the piece of food, grip it, bring it to the mouth, and release it. "They imagine themselves doing the task, like athletes do for sports," says Schwartz. "The neurons are active as they observe the movement, and then we can capture the [neural signals] and use them for our own control."

[1] 2 Next »

Comments

  • Great tech for the disabled
    msreid on 05/28/2008 at 2:30 PM
    Posts:
    6
    Avg Rating:
    3/5
    This is really exciting for its possible uses to help the disabled lead more normal lives.  It will take a while, but I believe in 10-15 years we will start to see commercial devices for disabled people.  I guess one day we'll get to the point where if you are getting ready to die we can just put your brain in a robot that gives it oxygen and nourishment, and you'll just pick up life where you left off.  A bit scary to think about, but a bit intriguing too.
    Rate this comment: 12345
  • behind the times
    pkassebaum on 05/28/2008 at 3:11 PM
    Posts:
    7
    Avg Rating:
    2/5
    This article highlights what seems to be a terribly outdated version of the prosthetic arm demonstrated here.
    Rate this comment: 12345
    • Re: behind the times
      Emily Singer on 05/28/2008 at 5:40 PM
      Technology Review TR Staff
      Biotechnology and Life Science editor
      Posts:
      15
      Avg Rating:
      4/5
      The arm being developed by Dean Kamen is certainly exciting, but it is not controlled by the brain. In the demonstrations I have seen, it was controlled by a foot pedal and by residual muscle activity in the upper body. This approach wouldn't work for people with high levels of paralysis. I bet the two technologies will ultimately be combined in some form.
      Rate this comment: 12345
      • Re: behind the times
        pkassebaum on 05/29/2008 at 11:29 PM
        Posts:
        7
        Avg Rating:
        2/5
        A foot pedal and residual muscle activity?  I was certainly duped by Kamen's TED talk.  Thanks for the insight.

        It would be quite awesome for the two projects to come together.
        Rate this comment: 12345
  • Stephen Hawking needs this
    gabrielg01 on 05/28/2008 at 7:31 PM
    Posts:
    313
    Avg Rating:
    3/5
    People like Stephen Hawking need this device ASAP!!!
    Rate this comment: 12345
  • This could be pretty huge.
    Monsterboy on 05/28/2008 at 9:12 PM
    Posts:
    62
    Avg Rating:
    4/5
    Humanitarian concerns are great, but ALS is a niche market at best. This would have applications in all manner of machine interfacing, especially remote operations. If the procedure and training can be standardized, can a neural USB be for behind?
    Rate this comment: 12345
  • talking monkeys?
    tfrijnts on 05/29/2008 at 2:57 AM
    Posts:
    6
    Avg Rating:
    3/5
    Could this technology be used to check if certain apes have the brain capacity, but just not the vocal cords, to speak?
    Rate this comment: 12345
    • Re: talking monkeys?
      theapp on 06/04/2008 at 11:39 AM
      Posts:
      2
      Avg Rating:
      1/5
      Wouldn't the fact that a few apes have successfully been taught sign language and have even adapted the "words" they knew to new situations to describe a situation indicate that they are able to speak (or at least have the brain capacity) but lack the ability due to vocal capabilities.  A quick google search on sign language apes pulled up numerous projects indicating that apes are smart enough to learn a language.
      Rate this comment: 12345
  • monkey see, monkey do.
    phoenix on 05/29/2008 at 8:03 AM
    Posts:
    129
    Avg Rating:
    3/5
    Judith Merril, whose presence was a major guiding force in the Sci-Fi world right up until her death, published an Anthology Series ( 1-12 )of the top Science Fiction writers of that time which is recommended reading for any budding enthusiast of the genre. One story in particular comes to mind about a parapelegic who was able to control a biologic counterpart on another planet just through his thought processes.
    Rate this comment: 12345
  • Super soldier
    urian1975 on 05/29/2008 at 10:13 AM
    Posts:
    16
    Avg Rating:
    2/5
    you can bet the US military already owns half of this company
    Rate this comment: 12345
  • TRUELY Behind the Times
    Danieleveld on 05/29/2008 at 11:11 AM
    Posts:
    1
    Avg Rating:
    2/5
    I wrote about this technology back in 2003 when Duke University first did it with a rhesus monkey. The report was first published in Oct. 13 2003, and described using microelectrodes implanted in the hemisphere of the brain, sending data to a computer which translated it into mechanical movement via a robotic arm.
    Rate this comment: 12345
    • Re: TRUELY Behind the Times
      Emily Singer on 05/29/2008 at 11:51 AM
      Technology Review TR Staff
      Biotechnology and Life Science editor
      Posts:
      15
      Avg Rating:
      4/5
      This research definitely builds on  Miguel Nicolelis's work at Duke in 2003. But the difference is the complexity of the movement the monkey achieved. In this case, he could move the arm with three degrees of freedom (and that's not counting the ability to open and close the gripper, which makes it about 3.5.) That allowed the monkey to perform a task that is of relevance in the real world - the ability to feed oneself - which had not previously been demonstrated.
      Rate this comment: 12345
  • Level of Control
    Shiladie on 05/29/2008 at 1:32 PM
    Posts:
    37
    Avg Rating:
    4/5
    People need to realise the breakthrough here isn't that it 'can' be moved around by the brain, but by the level of control that is possible, and also intuitive.  There appears to be minimal retraining required to get the arm to move how you want.

    "If a monkey can do it"

    I also agree that if this can be done, would it be possible in the next 5-10 years to make a similar device for voice?
    Rate this comment: 12345
Advertisement

Current Issue

Technology Review November/December 2008
Sun + Water = Fuel
An MIT chemist has opened the way to making hydrogen fuel from water using sunlight.
•  Subscribe
Save 41%
•  Table of Contents
•  MIT News

Magazine Services

Career Resources

MIT Technology Insider

Stories and breaking news from inside MIT about the latest research, innovations, and startups--in a convenient monthly e-newsletter. Subscribe today

Follow us on Twitter

Twitter

Get Technology Review updates via the web, cellphone, or Instant Messager – Follow techreview on Twitter!

Advertisement
Advertisement
Advertisement
TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology