Biomedicine

Monkey Thinks Robot into Action

(Page 2 of 2)

  • Wednesday, May 28, 2008
  • By Emily Singer

Schwartz and his team used relatively simple algorithms to decode the patterns of neural activity recorded during the observation phase, and then used that information to control the robotic arm in real time. (Scientists can deduce both direction and speed of an intended movement from the activity of ensembles of neurons in the motor cortex: activity of specific collections of cells indicates direction, while the amplitude of the overall signal dictates speed.)

After just two days of training, the monkeys learned to control the arm in three dimensions and to control the gripper placed at the end that functions as a hand. The animals even learned to use the arm in ways in which they hadn't been trained: an accompanying video shows an animal using the arm to push a piece of food into his mouth. In a second video, the monkey brings the gripper back to his mouth and licks it, ignoring another piece of food. "He gets so good at using the tool that he may think about it as part of his own body," says Schwartz. He likens the training process to learning to use a mouse to control a computer cursor. After a certain learning period, "you're not thinking about how you have to activate a muscle in an index finger to push the left mouse button," he says. "In that way, you've embodied the cursor on the screen."

Schwartz and his collaborators are now testing the technology in humans. The first test run, begun just last week, is in an epilepsy patient who is undergoing a diagnostic test, known as electrocorticography, in which electrodes are surgically placed on the surface of the brain to try to identify the source of seizures. The surface electrodes are more precise than noninvasive scalp recordings and are less invasive than electrodes implanted into the brain, although they give a cruder level of control. Scientists will piggyback on that diagnostic test and try to use the signals recorded from the electrodes to control a computer program.

If successful, the researchers will begin testing the technology in ALS patients. In the end stages of this disease, patients are completely paralyzed; a brain-controlled computer program could help them do basic things, such as write an e-mail. "We think this could give them a way of communicating with others that's faster than existing methods," says Schwartz. "We hope to be able to create an interface for moderate typing speed, about 30 to 40 words a minute."

The researchers aim to test fully implanted electrodes, like those used in the monkey to control the robotic arm, in humans within the next two years. "With humans, I fully expect to get a lot better control," says Schwartz. In addition to being easier to train, humans can hopefully explain what's difficult or needs to be improved, he says.

Even if those tests are successful, significant hurdles remain before such devices can be routinely used in patients. The electrodes currently in use aren't ideal for long-term recording: the signals degrade over time. And the entire system will ultimately need to be made portable and wireless, or at least user friendly. "We need to make it easy enough so that patients can practice anytime they want to, rather than having a technician come out to the house and set up complicated equipment," says Schwartz. "We hope there will be improvement in electrode arrays--everything from bioactive coatings to telemetry. In two years, a lot of that should be in place."

More in Biomedicine

Genesis of a Virus

Read More »
Print

Related Articles

Brain Interfaces Made of Silk

Gentler, softer electrodes wrap around the folds of the brain to take higher-resolution measurements.

Reading the Surface of the Brain

A startup aims to develop a minimally invasive neural prosthesis for disabled patients.

Tongue Control

Sensory feedback via the tongue might improve neural prostheses.

Close Comments

To comment, please sign in or register

Forgot my password

msreid

27 Comments

  • 1358 Days Ago
  • 05/28/2008

Great tech for the disabled

This is really exciting for its possible uses to help the disabled lead more normal lives.  It will take a while, but I believe in 10-15 years we will start to see commercial devices for disabled people.  I guess one day we'll get to the point where if you are getting ready to die we can just put your brain in a robot that gives it oxygen and nourishment, and you'll just pick up life where you left off.  A bit scary to think about, but a bit intriguing too.

Reply

brainandspinalcord

9 Comments

  • 1248 Days Ago
  • 09/15/2008

Re: Great tech for the disabled

This device would probably not be within the budget of most disabled people, but we'll certainly keep watch for it!

Reply

pkassebaum

11 Comments

  • 1358 Days Ago
  • 05/28/2008

behind the times

This article highlights what seems to be a terribly outdated version of the prosthetic arm demonstrated here.

Reply

Emily Singer

26 Comments

  • 1358 Days Ago
  • 05/28/2008

Re: behind the times

The arm being developed by Dean Kamen is certainly exciting, but it is not controlled by the brain. In the demonstrations I have seen, it was controlled by a foot pedal and by residual muscle activity in the upper body. This approach wouldn't work for people with high levels of paralysis. I bet the two technologies will ultimately be combined in some form.

Reply

pkassebaum

11 Comments

  • 1357 Days Ago
  • 05/29/2008

Re: behind the times

A foot pedal and residual muscle activity?  I was certainly duped by Kamen's TED talk.  Thanks for the insight.

It would be quite awesome for the two projects to come together.

Reply

Monsterboy

92 Comments

  • 1358 Days Ago
  • 05/28/2008

This could be pretty huge.

Humanitarian concerns are great, but ALS is a niche market at best. This would have applications in all manner of machine interfacing, especially remote operations. If the procedure and training can be standardized, can a neural USB be for behind?

Reply

tfrijnts

6 Comments

  • 1357 Days Ago
  • 05/29/2008

talking monkeys?

Could this technology be used to check if certain apes have the brain capacity, but just not the vocal cords, to speak?

Reply

Advertisement

theapp

5 Comments

  • 1351 Days Ago
  • 06/04/2008

Re: talking monkeys?

Wouldn't the fact that a few apes have successfully been taught sign language and have even adapted the "words" they knew to new situations to describe a situation indicate that they are able to speak (or at least have the brain capacity) but lack the ability due to vocal capabilities.  A quick google search on sign language apes pulled up numerous projects indicating that apes are smart enough to learn a language.

Reply

phoenix

172 Comments

  • 1357 Days Ago
  • 05/29/2008

monkey see, monkey do.

Judith Merril, whose presence was a major guiding force in the Sci-Fi world right up until her death, published an Anthology Series ( 1-12 )of the top Science Fiction writers of that time which is recommended reading for any budding enthusiast of the genre. One story in particular comes to mind about a parapelegic who was able to control a biologic counterpart on another planet just through his thought processes.

Reply

urian1975

16 Comments

  • 1357 Days Ago
  • 05/29/2008

Super soldier

you can bet the US military already owns half of this company

Reply

Danieleveld

28 Comments

  • 1357 Days Ago
  • 05/29/2008

TRUELY Behind the Times

I wrote about this technology back in 2003 when Duke University first did it with a rhesus monkey. The report was first published in Oct. 13 2003, and described using microelectrodes implanted in the hemisphere of the brain, sending data to a computer which translated it into mechanical movement via a robotic arm.

Reply

Emily Singer

26 Comments

  • 1357 Days Ago
  • 05/29/2008

Re: TRUELY Behind the Times

This research definitely builds on  Miguel Nicolelis's work at Duke in 2003. But the difference is the complexity of the movement the monkey achieved. In this case, he could move the arm with three degrees of freedom (and that's not counting the ability to open and close the gripper, which makes it about 3.5.) That allowed the monkey to perform a task that is of relevance in the real world - the ability to feed oneself - which had not previously been demonstrated.

Reply

Shiladie

56 Comments

  • 1357 Days Ago
  • 05/29/2008

Level of Control

People need to realise the breakthrough here isn't that it 'can' be moved around by the brain, but by the level of control that is possible, and also intuitive.  There appears to be minimal retraining required to get the arm to move how you want.

"If a monkey can do it"

I also agree that if this can be done, would it be possible in the next 5-10 years to make a similar device for voice?

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Videos

The Virtual Nurse Will See You Now

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Silver Spring Networks

Akamai

Amazon.com

BrightSource Energy

More

Advertisement

Facebook

Advertisement