Beating face fraudsters: A new liveness-detection algorithm for biometric face-recognition systems can tell when it’s presented with a high-quality photo of a face instead of the real thing by measuring how different points of the face move relative to each other.
Klaus Kollreider, H. Fronthaler, Halmstad University

Computing

Looking for Signs of Life

New facial-recognition software features a test that can root out fraudsters trying to pass off a photograph as a real person.

  • Tuesday, July 17, 2007
  • By Duncan Graham-Rowe

Scientists in Sweden have developed a liveness-detection system that they say should help reduce the chances of face-biometrics systems being fooled by photographs.

"Liveness is going to be a major issue for biometrics," says Josef Bigun, a professor of signal analysis who led the research at Halmstad University, in Sweden. This is particularly the case with face recognition. "[Today's systems] cannot tell the difference between a picture and a face," he says.

While some systems have rudimentary defences designed to spot photographs, a crook can easily foil them just by bending the picture, says Bigun. Detection systems need to be "a little bit more sophisticated," he says.

Most face-recognition systems assume that the users will always be accompanied by an official to monitor the process.

Advertisement

But as face biometrics becomes more ubiquitous, this will not always be an option. Some companies, such as the Japanese firm Fujitsu, are already using unattended hand geometry readers to enable people to withdraw cash at ATMs. Face biometrics is likely to follow a similar path, says Bigun.

Michael Jones, a face-recognition researcher at the Mitsubishi Electric Research Laboratories, in Cambridge, MA, believes that face recognition will be more prone to fraud: "It's so easy to get a photo of a face. You can't get someone's irises or fingerprints off the Internet."

Bigun is trying to combat the problem by using an algorithm that measures the optical flow--a measurement of the 3-D movement of two-dimensional information--to detect how parts of a real face should move in 3-D relative to each other.

Face biometrics currently use two much simpler processes to try to detect liveness. One is to measure how similar the face being presented is to the stored face template of a particular person. Since no two presentations of the same face will look exactly the same, biometrics systems are, somewhat ironically, designed to reject faces that too closely match the original template. So in theory, it may detect a picture if it looks too similar to the original template. But there's an easy way to get around this, says Bigun: "You simply add statistical noise to an image." This could be done using a digital copy of the image and basic photo-manipulation software: a user could randomly add dots to the image to introduce small errors.

The second approach uses optical flow to measure the movement of key parts of the face--such as the nose, eyes, and ears--relative to each other. The aim here is to detect slight movements of a photo as the fraudster holds it in front of the camera. If all regions of the image move in a perfectly linear fashion--that is, the nose, eyes, and ears all move in precisely the same way--then the system recognizes that a photo is likely being used.

However, this approach runs the small risk of rejecting a legitimate person if he or she happens to be holding his or her facial expression very still. Also, as mentioned, simply bending a photo can fool these algorithms because it will cause different points of the photo to move at slightly different trajectories from the point of view of the camera, since they are not on the same two-dimensional plane.

Print

Related Articles

Better Face-Recognition Software

Computers outperform humans at recognizing faces in recent tests.

Face Recognition Software Goes Public

A website provides image-processing software for sorting through online photo albums. But does it raise a privacy concern?

Boosting Biometrics

Merging multiple biometric techniques creates identification systems that are virtually spoof-proof.

Close Comments

To comment, please sign in or register

Forgot my password

Bruceahz

38 Comments

  • 1673 Days Ago
  • 07/17/2007

why not a challenge?

Wouldn't it be fairly simple to present a challenge "question"? Something like "Please open your mouth now" or "Please close one eye now". Since the request is randomly selected from a group of possible actions, no video can be prepared a priori.

Reply

nulloot

1 Comment

  • 1672 Days Ago
  • 07/18/2007

Re: why not a challenge?

Amagine yourself as an end user. How soon will you get tired of smiling, blinking, turning or something else doing in order to get identified?

Reply

EGZone

3 Comments

  • 1671 Days Ago
  • 07/19/2007

Re: why not a challenge?

I fully agree with you guys...being a technical man myself i do understand how difficult it can be rubbing head when we don't know what to do.

Anyone interested in discussing such stuffs are welcome at: www.egzone.info

Or simply visit my blog and open a new thread where we do have many domain experts in their respective fields at: www.egzone.info/blog.

Reply

cronodragon

2 Comments

  • 1673 Days Ago
  • 07/17/2007

Puppet

Just make a puppet of the face and the system will be violated.

Reply

Guest (bob c.e.t.)

  • 1673 Days Ago
  • 07/17/2007

smile

smile???????

Reply

Redwood

1 Comment

  • 1672 Days Ago
  • 07/18/2007

Detecting live people

Requesting that the subject blink or move seems like an easy way to distinguish between photos and live people.  If that approach is unacceptable, live eyes can be detected using their retroreflective properties.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Adding Data Logging
Log measured data to a file and open it in Microsoft Excel

> Click here for more National Instruments Videos <
Whitepaper

Temperature Measurements with Thermocouples: How-To Guide

This document is part of the “How-To Guide for Most Common Measurements” centralized resource portal. This tutorial provides a detailed guide for measurement and device considerations to take temperature measurements using thermocouples. Get an introduction to thermocouples, which are inexpensive sensing devices widely used with PC-based data acquisition systems. Also review some specific thermocouple examples and learn how thermocouples work and ways to integrate them into a data acquisition measurement system.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

1366 Technologies

A123 Systems

American Superconductor

Nissan

More

Advertisement

Facebook

Advertisement