Tom Simonite

A View from Tom Simonite

SXSW: Allowing Ordinary Webcams to Track your Gaze

That small camera over your screen knows where you’re looking.

  • March 15, 2011

I reported earlier this month on a prototype laptop that has an infrared camera to track your eye movements, cutting mouse use and creating a more intuitive experience. Here at SXSW a startup just presented technology that could allow such techniques using a regular webcam, rather than the kind of specialized cameras built into that prototype.

GazeHawk has combined a suite of image recognition software that recognizes faces, estimates head motion and position in 3D, and follows eye movements. Those capabilities are combined with data from a brief calibration step where users look at specific points on their screen to identify where a person’s gaze is directed to about 70 pixels, co-founder Brian Krausz told me, after pitching in a contest for new web technology firms.

As a startup, revenue is crucial for GazeHawk who right now are targeting web designers and advertisers interested in knowing know where people look on a page, and if their ads are being noticed. The startup pays people to have their gaze tracked on the site of interest (sign up here) and does it by using their browser to tap into their webcam. The photo above shows example results: a heat map showing where a person’s eyes lingered.

Krausz said that he believed GazeHawk’s technology could be used for gaming or other consumer applications, allowing eye tracking on existing hardware. However, that would require a certain amount of rearchitecting the service, which currently doesn’t decode gazes from video in real time. “It could be done in real time,” he says, “but we don’t need to for our current application and that saves us a lot of resources.”

The 9 month old company will soon get its technology working on the iPad, said Krausz. That could give designers of apps new insight into what works for users, and in the long term perhaps even a new control method to accompany the touchscreen.

The latest Insider Conversation is live! Listen to the story behind the story.

Subscribe today
Already a Premium subscriber? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.