Computing

Software Learns to Tag Photos

(Page 2 of 2)

  • Thursday, November 9, 2006
  • By James Lee

Better image-recognition software could have a range of applications, Li says. It could, for example, improve Internet search engines or automatically tag digital-image collections. Li believes it might also help scientists sort through large amounts of visual information: "Image classification is sometimes a need in scientific study. Without computer assistance, researchers have to manually classify images, and this process can be slow and fall behind the high throughput of new images."

The underlying algorithms could perhaps lend themselves to various other difficult computing tasks. "Similar approaches can be applied to video analysis and possibly other problems," Li adds.

Luis von Ahn, an assistant professor of computer science at Carnegie Mellon University, in Pittsburgh, PA, says the research is a "step in the right direction" but that the software's accuracy rate must be improved. He notes that images on sites like Flickr often contain very similar material. "The truth of the matter is that these images are largely all about the same thing--people mostly take pictures of other people," he says. "So just using the word 'people' already tags a large percentage of the images correctly."

Von Ahn also believes that humans could play a greater role in training vision-recognition algorithms. He runs a site called Peekaboom that turns tagging images into a game for two online players. As an image is slowly revealed, each player must race to find the right tag for it. This helps train von Ahn's software to identify images by focusing on key portions. So far, approximately 100,000 individual images have been classified using Peekaboom, von Ahn says.

Alexander Berg, a computer-vision expert based at the University of California, in Berkley, agrees that humans could help computers understand complex data better. He suggests that the tags that appear on sites like Flickr and YouTube, as well as on many blogs and news websites, could prove crucial to this endeavor in the future. "In general, image and video search is an area due for major strides," Berg says. "More and more data is online with some amount of human labeling."

It's an idea that is welcomed by Li: "The more reliable data we can access and use, the better."

Print

Related Articles

The Future of Computing, According to Intel

Massively multicore processors will enable smarter computers that can infer our activities.

To comment, please sign in or register

Forgot my password

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Adding Data Logging
Log measured data to a file and open it in Microsoft Excel

> Click here for more National Instruments Videos <
Whitepaper

Temperature Measurements with Thermocouples: How-To Guide

This document is part of the “How-To Guide for Most Common Measurements” centralized resource portal. This tutorial provides a detailed guide for measurement and device considerations to take temperature measurements using thermocouples. Get an introduction to thermocouples, which are inexpensive sensing devices widely used with PC-based data acquisition systems. Also review some specific thermocouple examples and learn how thermocouples work and ways to integrate them into a data acquisition measurement system.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Roche

Amazon.com

Layar

Cotendo

More

Advertisement

Facebook

Advertisement