SXSW: Allowing Ordinary Webcams to Track your Gaze
I reported earlier this month on a prototype laptop that has an infrared camera to track your eye movements, cutting mouse use and creating a more intuitive experience. Here at SXSW a startup just presented technology that could allow such techniques using a regular webcam, rather than the kind of specialized cameras built into that prototype.

GazeHawk has combined a suite of image recognition software that recognizes faces, estimates head motion and position in 3D, and follows eye movements. Those capabilities are combined with data from a brief calibration step where users look at specific points on their screen to identify where a person’s gaze is directed to about 70 pixels, co-founder Brian Krausz told me, after pitching in a contest for new web technology firms.
As a startup, revenue is crucial for GazeHawk who right now are targeting web designers and advertisers interested in knowing know where people look on a page, and if their ads are being noticed. The startup pays people to have their gaze tracked on the site of interest (sign up here) and does it by using their browser to tap into their webcam. The photo above shows example results: a heat map showing where a person’s eyes lingered.
Krausz said that he believed GazeHawk’s technology could be used for gaming or other consumer applications, allowing eye tracking on existing hardware. However, that would require a certain amount of rearchitecting the service, which currently doesn’t decode gazes from video in real time. “It could be done in real time,” he says, “but we don’t need to for our current application and that saves us a lot of resources.”
The 9 month old company will soon get its technology working on the iPad, said Krausz. That could give designers of apps new insight into what works for users, and in the long term perhaps even a new control method to accompany the touchscreen.
Keep Reading
Most Popular

The big new idea for making self-driving cars that can go anywhere
The mainstream approach to driverless cars is slow and difficult. These startups think going all-in on AI will get there faster.

Inside Charm Industrial’s big bet on corn stalks for carbon removal
The startup used plant matter and bio-oil to sequester thousands of tons of carbon. The question now is how reliable, scalable, and economical this approach will prove.

The hype around DeepMind’s new AI model misses what’s actually cool about it
Some worry that the chatter about these tools is doing the whole field a disservice.

The dark secret behind those cute AI-generated animal images
Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.
Stay connected

Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.