Technology Review - Published By MIT
Log in to My.TechnologyReview.com | Register
Advertisement
[1] 2 Next »

Friday, March 02, 2007

An Alternative to the Computer Mouse

A user interface that tracks eye movement may provide an alternate way to use a computer.

By Kate Greene

smaller text tool iconmedium text tool iconlarger text tool icon
The eyes have it: Logo from the Gaze-enhanced User Interface Design (GUIDe) project at Stanford. The project’s goal is to use information about where a person is looking in order to develop applications that make interacting with computers easier.
Credit: Manu Kumar, the GUIDe Program at Stanford University
Multimedia
•  View a slide show of the GUIDe Interface

A researcher at Stanford has created an alternative to the mouse that allows a person using a computer to click links, highlight text, and scroll simply by looking at the screen and tapping a key on the keyboard. By using standard eye-tracking hardware--a specialized computer screen with a high-definition camera and infrared lights--Manu Kumar, a doctoral student who works with computer-science professor Terry Winograd, has developed a novel user interface that is easy to operate.

"Eye-tracking technology was developed for disabled users," Kumar explains, "but the work that we're doing here is trying to get it to a point where it becomes more useful for able-bodied users." He says that nondisabled users tend to have a higher standard for easy-to-use interfaces, and previously, eye-tracking technology that disabled people use hasn't appealed to them.

At the heart of Kumar's technology is software called EyePoint that works with standard eye-tracking hardware. The software uses an approach that requires that a person look at a Web link, for instance, and hold a "hot key" on the keyboard (usually found on the number pad on the right) as she is looking. The area of the screen that's being looked at becomes magnified. Then, the person pinpoints her focus within the magnified region and releases the hot key, effectively clicking through to the link.

Kumar's approach could take eye-tracking user interfaces in the right direction. Instead of designing a common type of gaze-based interface that is controlled completely by the eyes--for instance, a system in which a user gazes at a given link, then blinks in order to click through--he has involved the hand, which makes the interaction more natural. "He's got the right idea to let the eye augment the hand," says Robert Jacob, professor of computer science at Tufts University, in Medford, MA.

Rudimentary eye-tracking technology dates back to the early 1900s. Using photographic film, researchers captured reflected light from subjects' eyes and used the information to study how people read and look at pictures. But today's technology involves a high-resolution camera and a series of infrared light-emitting diodes. This hardware is embedded into the bezel of expensive monitors; the one Kumar uses cost $25,000. The camera picks up the movement of the pupil and the reflection of the infrared light off the cornea, which is used as a reference point because it doesn't move.

Even the best eye tracker isn't perfect, however. "The eye is not really very stable," says Kumar. Even when a person is fixated on a point, the pupil jitters. So he wrote an algorithm that allows the computer to smooth out the eye jitters in real time. The rest of the research, says Kumar, involves studying how people look at a screen and figuring out a way to build an interface that "does not overload the visual channel." In other words, he wanted to make its use feel natural to the user.

One of the important features of the interface, says Kumar, is that it works without a person needing to control a cursor. Unlike the mouse-based system in ubiquitous use today, EyePoint provides no feedback on where a person is looking. Previous studies have shown that it is distracting to a person when she is aware of her gaze because she consciously tries to control its location. In the usability studies that Kumar conducted, he found that people's performance dropped when he implemented a blue dot that followed their eyes.

[1] 2 Next »

Comments

  • cool
    cfoley on 03/02/2007 at 1:49 AM
    Posts:
    1
    That could make using software so much more efficient.
    Rate this comment: 12345
  • Will the Mouse Go Away?
    deejay on 03/02/2007 at 3:17 AM
    Posts:
    22
    Avg Rating:
    4/5
    Yup !!!

    Gets my vote.
    Rate this comment: 12345
  • weird keys
    ms on 03/02/2007 at 1:58 PM
    Posts:
    64
    Avg Rating:
    4/5
    What a good idea to have another input channel. But controlling it with weird keys is counterproductive. A serious deficiency of the mouse is that it takes one's hand away from the keyboard. Similarly for weird keys (like the numeric keypad and the F keys).  I'd suggest using the control key, but it was displaced long ago from its position on those old teletypes in favor of the worse-than-useless caps lock! Well, OK, how about using the caps lock key and/or the simultaneous depression of multiple accessible keys.
    Rate this comment: 12345
  • An alternative approach
    sriramna on 03/03/2007 at 10:28 AM
    Posts:
    1
    From the point of better feedback and legacy compatibility, it would be a better idea to get the mouse pointer to move by following the eye as long as the hot key is pressed.  This will ensure a much lesser error rate.

    What next? Double-click by blinking the eyes!
    Rate this comment: 12345
  • Similar invention in Czech Rep. without using keys!
    tarak on 03/03/2007 at 12:28 PM
    Posts:
    1
    http://cyber.felk.cvut.cz/i4c/en_system.html
    Rate this comment: 12345
  • Combine it with speech recognition
    Christian Schwarte on 03/17/2007 at 10:32 AM
    Posts:
    1
    This should be combined with speech recognition – several spoken commands can easily be discerned and used as substitutes for hot keys. I guess the experience will be even better if one could just lean back and control the computer this way.
    Rate this comment: 12345
  • Yet another approach
    aghi on 03/20/2007 at 8:04 AM
    Posts:
    1
    Another kind of technology has been developed here in Brazil: http://www.fpf.br/cont.php?modulo=hardware&op=mouse
    Rate this comment: 12345
  • CTS for eyes?
    jayhatchpong on 04/10/2007 at 9:08 PM
    Posts:
    1
    I have strained my eyes enough by working before the computer screen for 8 hours daily. I hope this eye-mouse is not a new way to develop Eye-Type@Carpal Tunnel Syndrome. Using eye as tracking will increasingly force our eyes work harder. 
    Rate this comment: 12345
  • Eyepoint Adapation
    mkogrady on 04/30/2007 at 1:52 PM
    Posts:
    92
    Avg Rating:
    3/5
    Can a product like thie be modified to allow a soldier equipped with robotic weapons to see and shoot targets with high accuracy and limited exposure?
    Rate this comment: 12345
    • Re: Eyepoint Adapation
      enantiomer2000 on 08/06/2007 at 7:21 PM
      Posts:
      27
      Avg Rating:
      2/5
      I can see products like this being integrated with HeadsUp displays like the Microvision Color Eyewear that is being developed.

      Bye bye carpal tunnel
      Rate this comment: 12345
Advertisement

Current Issue

Technology Review September/October 2008
How Obama Really Did It
Social technology helped bring him to the brink of the presidency.
•  Subscribe
Save 41%
•  Table of Contents
•  MIT News

Magazine Services

Career Resources

MIT Technology Insider

Stories and breaking news from inside MIT about the latest research, innovations, and startups--in a convenient monthly e-newsletter. Subscribe today

Follow us on Twitter

Twitter

Get Technology Review updates via the web, cellphone, or Instant Messager – Follow techreview on Twitter!

Advertisement

More Technology News from Forbes

Advertisement
Advertisement
Advertisement
TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology