The eyes have it: Logo from the Gaze-enhanced User Interface Design (GUIDe) project at Stanford. The project’s goal is to use information about where a person is looking in order to develop applications that make interacting with computers easier.
Manu Kumar, the GUIDe Program at Stanford University

Computing

An Alternative to the Computer Mouse

A user interface that tracks eye movement may provide an alternate way to use a computer.

  • Friday, March 2, 2007
  • By Kate Greene

A researcher at Stanford has created an alternative to the mouse that allows a person using a computer to click links, highlight text, and scroll simply by looking at the screen and tapping a key on the keyboard. By using standard eye-tracking hardware--a specialized computer screen with a high-definition camera and infrared lights--Manu Kumar, a doctoral student who works with computer-science professor Terry Winograd, has developed a novel user interface that is easy to operate.

"Eye-tracking technology was developed for disabled users," Kumar explains, "but the work that we're doing here is trying to get it to a point where it becomes more useful for able-bodied users." He says that nondisabled users tend to have a higher standard for easy-to-use interfaces, and previously, eye-tracking technology that disabled people use hasn't appealed to them.

Advertisement

At the heart of Kumar's technology is software called EyePoint that works with standard eye-tracking hardware. The software uses an approach that requires that a person look at a Web link, for instance, and hold a "hot key" on the keyboard (usually found on the number pad on the right) as she is looking. The area of the screen that's being looked at becomes magnified. Then, the person pinpoints her focus within the magnified region and releases the hot key, effectively clicking through to the link.

Kumar's approach could take eye-tracking user interfaces in the right direction. Instead of designing a common type of gaze-based interface that is controlled completely by the eyes--for instance, a system in which a user gazes at a given link, then blinks in order to click through--he has involved the hand, which makes the interaction more natural. "He's got the right idea to let the eye augment the hand," says Robert Jacob, professor of computer science at Tufts University, in Medford, MA.

Rudimentary eye-tracking technology dates back to the early 1900s. Using photographic film, researchers captured reflected light from subjects' eyes and used the information to study how people read and look at pictures. But today's technology involves a high-resolution camera and a series of infrared light-emitting diodes. This hardware is embedded into the bezel of expensive monitors; the one Kumar uses cost $25,000. The camera picks up the movement of the pupil and the reflection of the infrared light off the cornea, which is used as a reference point because it doesn't move.

Even the best eye tracker isn't perfect, however. "The eye is not really very stable," says Kumar. Even when a person is fixated on a point, the pupil jitters. So he wrote an algorithm that allows the computer to smooth out the eye jitters in real time. The rest of the research, says Kumar, involves studying how people look at a screen and figuring out a way to build an interface that "does not overload the visual channel." In other words, he wanted to make its use feel natural to the user.

One of the important features of the interface, says Kumar, is that it works without a person needing to control a cursor. Unlike the mouse-based system in ubiquitous use today, EyePoint provides no feedback on where a person is looking. Previous studies have shown that it is distracting to a person when she is aware of her gaze because she consciously tries to control its location. In the usability studies that Kumar conducted, he found that people's performance dropped when he implemented a blue dot that followed their eyes.

Print

Related Articles

For Your Eyes Only

Everyone has a unique pattern of eye movements. A new biometric security system exploits this for a simple, hard-to-fool approach.

Eye Tracking for Mobile Control

"EyePhone" lets users browse through mobile phone menus at the blink of an eye.

Microsoft's Many Multitouch Mice

Apple's Magic Mouse might be slick, but Microsoft is also working on five new designs.

Close Comments

To comment, please sign in or register

Forgot my password

cfoley

1 Comment

  • 1800 Days Ago
  • 03/02/2007

cool

That could make using software so much more efficient.

Reply

deejay

23 Comments

  • 1800 Days Ago
  • 03/02/2007

Will the Mouse Go Away?

Yup !!!

Gets my vote.

Reply

ms

190 Comments

  • 1800 Days Ago
  • 03/02/2007

weird keys

What a good idea to have another input channel. But controlling it with weird keys is counterproductive. A serious deficiency of the mouse is that it takes one's hand away from the keyboard. Similarly for weird keys (like the numeric keypad and the F keys).  I'd suggest using the control key, but it was displaced long ago from its position on those old teletypes in favor of the worse-than-useless caps lock! Well, OK, how about using the caps lock key and/or the simultaneous depression of multiple accessible keys.

Reply

sriramna

1 Comment

  • 1799 Days Ago
  • 03/03/2007

An alternative approach

From the point of better feedback and legacy compatibility, it would be a better idea to get the mouse pointer to move by following the eye as long as the hot key is pressed.  This will ensure a much lesser error rate.

What next? Double-click by blinking the eyes!

Reply

tarak

1 Comment

  • 1799 Days Ago
  • 03/03/2007

Similar invention in Czech Rep. without using keys!

http://cyber.felk.cvut.cz/i4c/en_system.html

Reply

Christian Schwarte

1 Comment

  • 1785 Days Ago
  • 03/17/2007

Combine it with speech recognition

This should be combined with speech recognition – several spoken commands can easily be discerned and used as substitutes for hot keys. I guess the experience will be even better if one could just lean back and control the computer this way.

Reply

aghi

1 Comment

  • 1782 Days Ago
  • 03/20/2007

Yet another approach

Another kind of technology has been developed here in Brazil: http://www.fpf.br/cont.php?modulo=hardware&op=mouse

Reply

Advertisement

jayhatchpong

1 Comment

  • 1761 Days Ago
  • 04/10/2007

CTS for eyes?

I have strained my eyes enough by working before the computer screen for 8 hours daily. I hope this eye-mouse is not a new way to develop Eye-Type@Carpal Tunnel Syndrome. Using eye as tracking will increasingly force our eyes work harder. 

Reply

mkogrady

423 Comments

  • 1741 Days Ago
  • 04/30/2007

Eyepoint Adapation

Can a product like thie be modified to allow a soldier equipped with robotic weapons to see and shoot targets with high accuracy and limited exposure?

Reply

enantiomer2000

66 Comments

  • 1643 Days Ago
  • 08/06/2007

Re: Eyepoint Adapation

I can see products like this being integrated with HeadsUp displays like the Microvision Color Eyewear that is being developed.

Bye bye carpal tunnel

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Taking a Measurement
Learn how to use your PC to take measurements

> Click here for more National Instruments Videos <
Whitepaper

BUILD VERSUS BUY
Understanding the Total Cost of Embedded Design

National Instruments has gathered customer information and data regarding some of the cost differences between building a custom solution versus using NI off-the-shelf tools. Using this data, we built the Graphical System Design ‘Build vs. Buy’ Calculator. The calculator can help show the financial differences between building a custom solution versus buying an off-the-shelf system. This paper discusses the benefits and drawbacks of both a traditional custom design approach and off-the-shelf embedded tools.

View full PDF > Listen to story >
Find us on Youtube

Videos

Windows on an iPad

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Complete Genomics

Joule Unlimited

Goldwind Science and Technology

Serious Materials

More

Advertisement

Facebook

Advertisement