SXSW: Allowing Ordinary Webcams to Track your Gaze
I reported earlier this month on a prototype laptop that has an infrared camera to track your eye movements, cutting mouse use and creating a more intuitive experience. Here at SXSW a startup just presented technology that could allow such techniques using a regular webcam, rather than the kind of specialized cameras built into that prototype.

GazeHawk has combined a suite of image recognition software that recognizes faces, estimates head motion and position in 3D, and follows eye movements. Those capabilities are combined with data from a brief calibration step where users look at specific points on their screen to identify where a person’s gaze is directed to about 70 pixels, co-founder Brian Krausz told me, after pitching in a contest for new web technology firms.
As a startup, revenue is crucial for GazeHawk who right now are targeting web designers and advertisers interested in knowing know where people look on a page, and if their ads are being noticed. The startup pays people to have their gaze tracked on the site of interest (sign up here) and does it by using their browser to tap into their webcam. The photo above shows example results: a heat map showing where a person’s eyes lingered.
Krausz said that he believed GazeHawk’s technology could be used for gaming or other consumer applications, allowing eye tracking on existing hardware. However, that would require a certain amount of rearchitecting the service, which currently doesn’t decode gazes from video in real time. “It could be done in real time,” he says, “but we don’t need to for our current application and that saves us a lot of resources.”
The 9 month old company will soon get its technology working on the iPad, said Krausz. That could give designers of apps new insight into what works for users, and in the long term perhaps even a new control method to accompany the touchscreen.
Keep Reading
Most Popular
Geoffrey Hinton tells us why he’s now scared of the tech he helped build
“I have suddenly switched my views on whether these things are going to be more intelligent than us.”
Meet the people who use Notion to plan their whole lives
The workplace tool’s appeal extends far beyond organizing work projects. Many users find it’s just as useful for managing their free time.
Learning to code isn’t enough
Historically, learn-to-code efforts have provided opportunities for the few, but new efforts are aiming to be inclusive.
Deep learning pioneer Geoffrey Hinton has quit Google
Hinton will be speaking at EmTech Digital on Wednesday.
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.