I reported earlier this month on a prototype laptop that has an infrared camera to track your eye movements, cutting mouse use and creating a more intuitive experience. Here at SXSW a startup just presented technology that could allow such techniques using a regular webcam, rather than the kind of specialized cameras built into that prototype.
GazeHawk has combined a suite of image recognition software that recognizes faces, estimates head motion and position in 3D, and follows eye movements. Those capabilities are combined with data from a brief calibration step where users look at specific points on their screen to identify where a person’s gaze is directed to about 70 pixels, co-founder Brian Krausz told me, after pitching in a contest for new web technology firms.
As a startup, revenue is crucial for GazeHawk who right now are targeting web designers and advertisers interested in knowing know where people look on a page, and if their ads are being noticed. The startup pays people to have their gaze tracked on the site of interest (sign up here) and does it by using their browser to tap into their webcam. The photo above shows example results: a heat map showing where a person’s eyes lingered.
Krausz said that he believed GazeHawk’s technology could be used for gaming or other consumer applications, allowing eye tracking on existing hardware. However, that would require a certain amount of rearchitecting the service, which currently doesn’t decode gazes from video in real time. “It could be done in real time,” he says, “but we don’t need to for our current application and that saves us a lot of resources.”
The 9 month old company will soon get its technology working on the iPad, said Krausz. That could give designers of apps new insight into what works for users, and in the long term perhaps even a new control method to accompany the touchscreen.
A Roomba recorded a woman on the toilet. How did screenshots end up on Facebook?
Robot vacuum companies say your images are safe, but a sprawling global supply chain for data from our devices creates risk.
A startup says it’s begun releasing particles into the atmosphere, in an effort to tweak the climate
Make Sunsets is already attempting to earn revenue for geoengineering, a move likely to provoke widespread criticism.
10 Breakthrough Technologies 2023
These exclusive satellite images show that Saudi Arabia’s sci-fi megacity is well underway
Weirdly, any recent work on The Line doesn’t show up on Google Maps. But we got the images anyway.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.