Skip to Content

Face Recognition

A camera and algorithm know it’s you.

With airports tightening up security, biometric technologies such as face recognition may come on line. A few techniques exist to match known facial profiles against those of strangers in a crowd or to verify a person’s claimed identity, as at an ATM. But two stand out: local feature analysis, developed by Joseph Atick, who founded Jersey City, NJ-based Visionics; and eigenface, first demonstrated at Helsinki University of Technology, later developed at MIT, and currently marketed by Viisage Technology of Littleton, MA.

A system based on local feature analysis uses a camera and computer to identify a person in a crowd. First it scans a field of view for shapes that could be faces. It then searches for facial features like those already stored in its memory. To be sure the eyes, nose and mouth belong to a living being-and not a mannequin-the program looks for eye-blinks or other telltale facial movements. The system then analyzes the pixels that make up the face image. It compares the darkness of each pixel to that of its neighbors, looking for areas where abrupt differences in value radiate outward from a single pixel. These changes can occur between the eyebrows and skin, the eyes and eyelids, or on features that protrude, such as the cheekbones and nose. The system plots the location of each pixel, known as an “anchor point,” then connects the dots, forming a mesh of triangles. It measures the angles of each triangle and comes up with a number made of 672 ones and zeroes that identifies the face. The program attempts to match that number to a similar one in its database. There can never be a perfect match, so the program ranks how confident it is about the identification. And since the program plots the anchor points by bone structure, disguises such as beards, makeup and eyeglasses won’t fool it.

Like feature analysis, the eigenface method also reduces a face to a number. But instead of looking at a collection of facial features locally, it examines the face as a whole. First it averages out a database of head shots to produce one composite face. Then it compares the face being identified to the composite. An algorithm measures how much the target face differs from the composite and generates a 128-digit personal identification number based on the deviation. Both systems offer security at the expense of constant surveillance. Whether society is willing to pay that cost is yet to be determined.

Got a new technology you’d like to see explained in Visualize? Send your ideas to

Keep Reading

Most Popular

Workers disinfect the street outside Shijiazhuang Railway Station
Workers disinfect the street outside Shijiazhuang Railway Station

Why China is still obsessed with disinfecting everything

Most public health bodies dealing with covid have long since moved on from the idea of surface transmission. China’s didn’t—and that helps it control the narrative about the disease’s origins and danger.

individual aging affects covid outcomes concept
individual aging affects covid outcomes concept

Anti-aging drugs are being tested as a way to treat covid

Drugs that rejuvenate our immune systems and make us biologically younger could help protect us from the disease’s worst effects.

Europe's AI Act concept
Europe's AI Act concept

A quick guide to the most important AI law you’ve never heard of

The European Union is planning new legislation aimed at curbing the worst harms associated with artificial intelligence.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.