Technology Review - Published By MIT
Advertisement

Monkey Thinks Robot into Action

A monkey is able to feed itself with a robotic arm.

By Emily Singer

Wednesday, May 28, 2008

smaller text tool iconmedium text tool iconlarger text tool icon

In a dramatic display of the potential of prosthetic arms, a monkey at the University of Pittsburgh was able to use his brain to directly control a robotic arm and feed himself a marshmallow. The research, published today in the journal Nature, is the first to show that an interface that converts brain signals directly into action is sophisticated enough to perform a practical function: eating. Researchers who led the work have just begun human tests of a related technology.

Brain power: A monkey with an array of tiny electrodes implanted into his brain uses his thoughts to control a robotic arm, grabbing a piece of marshmallow and bringing it to his mouth. Scientists ultimately hope that this type of brain machine interface will help paralyzed people perform everyday tasks, like feeding themselves or brushing their hair.
Credit: Andrew Schwartz et al.
Multimedia
video  Watch the monkey use the robotic arm to feed himself.
video  See the monkey manipulate the robotic arm so that he can lick the robotic hand.

"It's the first time a monkey--or a human--is directly, with their brain, controlling a real prosthetic arm," says Krishna Shenoy, a neuroscientist at Stanford University who was not involved in the research.

People who suffer from strokes or spinal cord injury, or from some neurodegenerative diseases, such as amyotrophic lateral sclerosis (ALS), are often left paralyzed. But their cerebral cortices--the parts of the brain that control movement, planning, and other functions--may remain largely intact. Scientists hope to capitalize on that with the development of brain machine interfaces--devices that convert brain activity into action, such as movement of a cursor on a computer screen.

People who are completely paralyzed can now use brain machine interfaces that noninvasively measure signals recorded from the surface of the scalp, but the devices are slow and require sustained concentration to operate. To create a prosthesis that works like a real arm--the user thinks about moving his arm, and it moves--will most likely require that electrical activity be recorded directly from the brain.

That has become possible in recent years, thanks to advances in the tiny arrays of electrodes used to record neural signals. In previous research, John Donoghue and his colleagues at Brown University showed that electrodes implanted into the brain of a paralyzed man could be used to move a cursor on a computer screen and even make a simple movement with a robotic arm. But that and other research have been limited to one- or two-dimensional movements, and, other than a few cases using a mechanical arm or gripper, were performed virtually, on a screen.

Story continues below

In the latest research, headed by neuroscientist Andrew Schwartz at the University of Pittsburgh, the monkey was able to perform a more complicated task. "Andy has taken this one step further, to a practical device that could be of use in the real world," says John Kalaska, a neuroscientist at the University of Montreal, in Canada, who wrote a commentary accompanying the publication. "The animal can simply, through a kind of mental practice, get the robot to move toward where the [food] is, close the hand, and bring it back to the mouth and let him eat it."

To achieve the feat, two monkeys had a grid of microelectrodes implanted into the motor cortex, part of the brain that controls motor planning and execution. The animals had previously been trained to move an anthropomorphic robotic arm, with moveable joints at the shoulder, elbow, and wrist, using a joystick. To learn to control the prosthesis with their minds, the monkeys had their arms temporarily restrained as they watched a computer move the arm through the required motions--to extend the arm to the piece of food, grip it, bring it to the mouth, and release it. "They imagine themselves doing the task, like athletes do for sports," says Schwartz. "The neurons are active as they observe the movement, and then we can capture the [neural signals] and use them for our own control."

Comments

  • Great tech for the disabled
    This is really exciting for its possible uses to help the disabled lead more normal lives.  It will take a while, but I believe in 10-15 years we will start to see commercial devices for disabled people.  I guess one day we'll get to the point where if you are getting ready to die we can just put your brain in a robot that gives it oxygen and nourishment, and you'll just pick up life where you left off.  A bit scary to think about, but a bit intriguing too.
    Rate this comment: 12345

    msreid
    05/28/2008
    Posts:8
    Avg Rating:
    4/5
  • behind the times
    This article highlights what seems to be a terribly outdated version of the prosthetic arm demonstrated here.
    Rate this comment: 12345

    pkassebaum
    05/28/2008
    Posts:11
    Avg Rating:
    3/5
    • Re: behind the times
      The arm being developed by Dean Kamen is certainly exciting, but it is not controlled by the brain. In the demonstrations I have seen, it was controlled by a foot pedal and by residual muscle activity in the upper body. This approach wouldn't work for people with high levels of paralysis. I bet the two technologies will ultimately be combined in some form.
      Rate this comment: 12345

      Emily Singer
      05/28/2008
      Posts:18
      Avg Rating:
      4/5
      • Re: behind the times
        A foot pedal and residual muscle activity?  I was certainly duped by Kamen's TED talk.  Thanks for the insight.

        It would be quite awesome for the two projects to come together.
        Rate this comment: 12345

        pkassebaum
        05/29/2008
        Posts:11
        Avg Rating:
        3/5
  • Stephen Hawking needs this
    People like Stephen Hawking need this device ASAP!!!
    Rate this comment: 12345

    gabrielg01
    05/28/2008
    Posts:361
    Avg Rating:
    3/5
  • This could be pretty huge.
    Humanitarian concerns are great, but ALS is a niche market at best. This would have applications in all manner of machine interfacing, especially remote operations. If the procedure and training can be standardized, can a neural USB be for behind?
    Rate this comment: 12345

    Monsterboy
    05/28/2008
    Posts:71
    Avg Rating:
    4/5
  • talking monkeys?
    Could this technology be used to check if certain apes have the brain capacity, but just not the vocal cords, to speak?
    Rate this comment: 12345

    tfrijnts
    05/29/2008
    Posts:6
    Avg Rating:
    3/5
    • Re: talking monkeys?
      Wouldn't the fact that a few apes have successfully been taught sign language and have even adapted the "words" they knew to new situations to describe a situation indicate that they are able to speak (or at least have the brain capacity) but lack the ability due to vocal capabilities.  A quick google search on sign language apes pulled up numerous projects indicating that apes are smart enough to learn a language.
      Rate this comment: 12345

      theapp
      06/04/2008
      Posts:2
      Avg Rating:
      1/5
  • monkey see, monkey do.
    Judith Merril, whose presence was a major guiding force in the Sci-Fi world right up until her death, published an Anthology Series ( 1-12 )of the top Science Fiction writers of that time which is recommended reading for any budding enthusiast of the genre. One story in particular comes to mind about a parapelegic who was able to control a biologic counterpart on another planet just through his thought processes.
    Rate this comment: 12345

    phoenix
    05/29/2008
    Posts:172
    Avg Rating:
    3/5
  • Super soldier
    you can bet the US military already owns half of this company
    Rate this comment: 12345

    urian1975
    05/29/2008
    Posts:16
    Avg Rating:
    2/5
  • TRUELY Behind the Times
    I wrote about this technology back in 2003 when Duke University first did it with a rhesus monkey. The report was first published in Oct. 13 2003, and described using microelectrodes implanted in the hemisphere of the brain, sending data to a computer which translated it into mechanical movement via a robotic arm.
    Rate this comment: 12345

    Danieleveld
    05/29/2008
    Posts:11
    Avg Rating:
    4/5
    • Re: TRUELY Behind the Times
      This research definitely builds on  Miguel Nicolelis's work at Duke in 2003. But the difference is the complexity of the movement the monkey achieved. In this case, he could move the arm with three degrees of freedom (and that's not counting the ability to open and close the gripper, which makes it about 3.5.) That allowed the monkey to perform a task that is of relevance in the real world - the ability to feed oneself - which had not previously been demonstrated.
      Rate this comment: 12345

      Emily Singer
      05/29/2008
      Posts:18
      Avg Rating:
      4/5
  • Level of Control
    People need to realise the breakthrough here isn't that it 'can' be moved around by the brain, but by the level of control that is possible, and also intuitive.  There appears to be minimal retraining required to get the arm to move how you want.

    "If a monkey can do it"

    I also agree that if this can be done, would it be possible in the next 5-10 years to make a similar device for voice?
    Rate this comment: 12345

    Shiladie
    05/29/2008
    Posts:42
    Avg Rating:
    4/5

Log In

Forgot your password?     Register »
Advertisement
Technology Review July/August 2009

Current Issue

Search Me
Inside the launch of Stephen Wolfram’s new “computational knowledge engine.”
•  Subscribe
Save 41%
•  Table of Contents
•  MIT News
Advertisement

Follow us on Twitter

Twitter

Get Technology Review updates via the web, cellphone, or Instant Messager – Follow techreview on Twitter!

Advertisement
Subscribe to Technology Review's daily e-mail update. Enter your e-mail address

Advertisement
TECHNOLOGY RESOURCES

More Technology News from Forbes

Advertisement
MIT Massachusetts Institute of Technology © 2009 Technology Review. All Rights Reserved.