Making sense: The image above was created using software designed to generate pictures with hidden figures. Pattern-recognition software tends to have more trouble spotting the flamingo on the right than humans do.
Niloy J. Mitra, Hung-Kuo Chu, Tong-Yee Lee, Lior Wolf, Hezy Yeshurun, Daniel Cohen-Or

Computing

"Emergent" Images to Outwit Spambots

Software creates images that confuse machines but are clear to people.

  • Wednesday, January 6, 2010
  • By Rachel Kremen

Researchers have developed an automated system for creating still and video images that can be identified by humans but not by computers. Such technology could be useful for Captcha systems, which were designed to keep "spambots"--or automated junk e-mail programs--from signing up for free online accounts.

The new technology uses simple images of a recognizable, moving figure, such as a running man or galloping horse, and converts them into blotches, hidden within a similarly blotchy scene. Computers are usually unable to detect the figure, but the human eye typically can.

Coined in 2000, "Captcha" stands for Completely Automated Public Turing test to tell Computers and Humans Apart. A typical Captcha system generates distorted text, often on a slightly cluttered background. The user must respond with the correct string of characters in order to access an online service, such as the account creation tool for a free e-mail address. But existing Captcha system don't offer complete security--they are occasionally broken by security researchers and hackers. Captcha systems for Live Mail, Gmail, Yahoo!, Livejournal, and PayPal have all been cracked at one point. While the current systems are considered secure for now, most in the field agree it's only a matter of time before they are broken again. Captcha system designers have to keep improving their methods to stay one step ahead of those who seek to circumvent them.

"The systems we all use today are relatively easy to break," says Danny Cohen-Or, a researcher on the project and a professor of computer science at Tel Aviv University. "What we have developed is something that, with more effort, could be like the base of a stronger Captcha [system]."

Advertisement

Developed with researchers at the Indian Institute of Technology in Delhi, the National Cheng Kung University in Taiwan, and others from the University of Tel Aviv, the software was inspired by "gestalt," or the idea of the whole being greater than the sum of the parts. Specifically, the software exploits the human ability to analyze a chaotic, fragmented scene to find a hidden figure.

The key was designing an adjustable system that could generate images that are easy enough for a human to identify, but too difficult for pattern-recognition software.

Video

The software begins with a 3-D subject, such as a running dog. It converts the dog into a series of carefully generated black dots, which the researchers call "splats," that take into account the dog's silhouette and shape. To ensure that the subject isn't too obvious, long, complicated shapes are broken into smaller parts, and the silhouettes are slightly deformed. The software then places the subject in a scene with more shapes, including some made of small pieces of the subject, to create added visual confusion. Videos are created as a series of still images.

The "emergent" images generated by the system were tested on three kinds of learning-based pattern recognition software. After training on a set of 30 emergent images, the systems were presented with other emergent images. The best of the three pattern recognition systems could only distinguish between a horse and a human 60 percent of the time. Humans, presented with the same task, answered correctly nearly 100 percent of the time. The software can also create images that are far more difficult for computers to interpret, but this would make it harder for humans to interpret, too. "It's still not something that the big mass of users will be able to do," Cohen-Or says.

Print

Related Articles

Researchers Crack Audio Security System

Spammers could create new accounts more cheaply.

Video Ads that Outwit Spammers

Websites may soon be asking you to watch a short ad rather than enter garbled text.

The CAPTCHA Arms Race

Researchers mull the next step in spam deterrents.

Close Comments

To comment, please sign in or register

Forgot my password

profquatermass

57 Comments

  • 766 Days Ago
  • 01/07/2010

All very well but....

How does the user choose which image they see?

Do they select a word or choose from a selection of images?

If it's too hard to enter the correct answer, the user will give up and leave.

Reply

arnetwork

85 Comments

  • 255 Days Ago
  • 06/02/2011

doesn't work for me

I was unable to identify the target image in the visual graphics examples used in this article. Even when I knew what I was supposed to be able to see I couldn't isolate it from the background clutter. Visual captchas as described in this article would freeze me out of access even more than current captchas do.

Usually, when confronted with the requirement to pass a captcha access test I decline because I find them so difficult. This new approach is beyond even my ability to understand what the frame of reference is.

At least with the current captcha system I can see that they refer to letters or numerals. I can even usually clearly make out one or two of the characters in a given captcha and comfortably guess at a couple of others. Given two or three chances I could possibly work out the rest of the characters. But of course, that isn't how captchas work. A single failure produces a brand new captcha. I can hardly ever get past a captcha.

However I can't even start with the examples given in this article because they appear to me as visual white noise.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Adding Data Logging
Log measured data to a file and open it in Microsoft Excel

> Click here for more National Instruments Videos <
Whitepaper

Temperature Measurements with Thermocouples: How-To Guide

This document is part of the “How-To Guide for Most Common Measurements” centralized resource portal. This tutorial provides a detailed guide for measurement and device considerations to take temperature measurements using thermocouples. Get an introduction to thermocouples, which are inexpensive sensing devices widely used with PC-based data acquisition systems. Also review some specific thermocouple examples and learn how thermocouples work and ways to integrate them into a data acquisition measurement system.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

iRobot

First Solar

Synthetic Genomics

Pacific Biosciences

More

Advertisement

Facebook

Advertisement