The Chinese Solar Machine Layer by Layer Fire in the Library The Mystery Behind Anesthesia
The eyes have it: Logo from the Gaze-enhanced User Interface Design (GUIDe) project at Stanford. The project’s goal is to use information about where a person is looking in order to develop applications that make interacting with computers easier.
Manu Kumar, the GUIDe Program at Stanford University
Multimedia
A user interface that tracks eye movement may provide an alternate way to use a computer.
A researcher at Stanford has created an alternative to the mouse that allows a person using a computer to click links, highlight text, and scroll simply by looking at the screen and tapping a key on the keyboard. By using standard eye-tracking hardware--a specialized computer screen with a high-definition camera and infrared lights--Manu Kumar, a doctoral student who works with computer-science professor Terry Winograd, has developed a novel user interface that is easy to operate.
"Eye-tracking technology was developed for disabled users," Kumar explains, "but the work that we're doing here is trying to get it to a point where it becomes more useful for able-bodied users." He says that nondisabled users tend to have a higher standard for easy-to-use interfaces, and previously, eye-tracking technology that disabled people use hasn't appealed to them.
At the heart of Kumar's technology is software called EyePoint that works with standard eye-tracking hardware. The software uses an approach that requires that a person look at a Web link, for instance, and hold a "hot key" on the keyboard (usually found on the number pad on the right) as she is looking. The area of the screen that's being looked at becomes magnified. Then, the person pinpoints her focus within the magnified region and releases the hot key, effectively clicking through to the link.
Kumar's approach could take eye-tracking user interfaces in the right direction. Instead of designing a common type of gaze-based interface that is controlled completely by the eyes--for instance, a system in which a user gazes at a given link, then blinks in order to click through--he has involved the hand, which makes the interaction more natural. "He's got the right idea to let the eye augment the hand," says Robert Jacob, professor of computer science at Tufts University, in Medford, MA.
Rudimentary eye-tracking technology dates back to the early 1900s. Using photographic film, researchers captured reflected light from subjects' eyes and used the information to study how people read and look at pictures. But today's technology involves a high-resolution camera and a series of infrared light-emitting diodes. This hardware is embedded into the bezel of expensive monitors; the one Kumar uses cost $25,000. The camera picks up the movement of the pupil and the reflection of the infrared light off the cornea, which is used as a reference point because it doesn't move.
Even the best eye tracker isn't perfect, however. "The eye is not really very stable," says Kumar. Even when a person is fixated on a point, the pupil jitters. So he wrote an algorithm that allows the computer to smooth out the eye jitters in real time. The rest of the research, says Kumar, involves studying how people look at a screen and figuring out a way to build an interface that "does not overload the visual channel." In other words, he wanted to make its use feel natural to the user.
One of the important features of the interface, says Kumar, is that it works without a person needing to control a cursor. Unlike the mouse-based system in ubiquitous use today, EyePoint provides no feedback on where a person is looking. Previous studies have shown that it is distracting to a person when she is aware of her gaze because she consciously tries to control its location. In the usability studies that Kumar conducted, he found that people's performance dropped when he implemented a blue dot that followed their eyes.
What a good idea to have another input channel. But controlling it with weird keys is counterproductive. A serious deficiency of the mouse is that it takes one's hand away from the keyboard. Similarly for weird keys (like the numeric keypad and the F keys). I'd suggest using the control key, but it was displaced long ago from its position on those old teletypes in favor of the worse-than-useless caps lock! Well, OK, how about using the caps lock key and/or the simultaneous depression of multiple accessible keys.
From the point of better feedback and legacy compatibility, it would be a better idea to get the mouse pointer to move by following the eye as long as the hot key is pressed. This will ensure a much lesser error rate.
What next? Double-click by blinking the eyes!
Similar invention in Czech Rep. without using keys!
http://cyber.felk.cvut.cz/i4c/en_system.html
Combine it with speech recognition
This should be combined with speech recognition – several spoken commands can easily be discerned and used as substitutes for hot keys. I guess the experience will be even better if one could just lean back and control the computer this way.
Another kind of technology has been developed here in Brazil: http://www.fpf.br/cont.php?modulo=hardware&op=mouse
I have strained my eyes enough by working before the computer screen for 8 hours daily. I hope this eye-mouse is not a new way to develop Eye-Type@Carpal Tunnel Syndrome. Using eye as tracking will increasingly force our eyes work harder.
Can a product like thie be modified to allow a soldier equipped with robotic weapons to see and shoot targets with high accuracy and limited exposure?
I can see products like this being integrated with HeadsUp displays like the Microvision Color Eyewear that is being developed.
Bye bye carpal tunnel
Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.
National Instruments has gathered customer information and data regarding some of the cost differences between building a custom solution versus using NI off-the-shelf tools. Using this data, we built the Graphical System Design ‘Build vs. Buy’ Calculator. The calculator can help show the financial differences between building a custom solution versus buying an off-the-shelf system. This paper discusses the benefits and drawbacks of both a traditional custom design approach and off-the-shelf embedded tools.
View full PDF >Our list of the 50 most innovative companies, including the following:
cfoley
1 Comment
cool
That could make using software so much more efficient.
Reply