We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Business Impact

Color Matching by Phone

Technology from Hewlett-Packard could help shoppers find the right color.

Hewlett-Packard (HP) Labs has unveiled a research project that could help people select colors when shopping for products. The technology uses color-correcting and computer-vision algorithms that reside on HP servers. The idea, explains Nina Bhatti, principal scientist at HP Labs, is that consumers use their mobile phones to take pictures of themselves or objects, and then send these pictures to HP servers. Within seconds, the consumer receives a text message with a color recommendation for matching makeup to skin tone, or for finding the right paint hue for the home.

Blending in: A woman (above) holds a color-reference chart while her picture is taken with a cell phone. The picture is sent to HP servers, where the chart helps determine the color of the woman’s skin irrespective of lighting and camera quality. Software in the server matches her skin tone to one stored in a database and recommends the appropriate makeup color via text message.

The research prototype that Bhatti and her team developed is specifically designed to help people find the best shade of makeup based on their skin tone. Not all women who buy makeup purchase it from a cosmetics counter, where an expert can identify the best shade of foundation for them, Bhatti explains. Many buy cosmetics from drugstores, catalogues, and, increasingly, the Web, where there’s no opportunity to test how the color blends with the skin. “Studies have shown that up to 75 percent of women are wearing the wrong shade of makeup,” Bhatti says.

Using HP’s prototype, a consumer simply takes a picture of herself while holding a color-reference chart that could be provided at the makeup counter at stores, in catalogues, or in magazines. When the picture is uploaded to HP servers, software compares the values of the color-reference chart in the picture with the accepted values for these colors. The color-correction algorithm takes the difference between these values and applies it to all the pixels in the picture to eliminate the effects of harsh lighting or poor camera quality.

Once the color in the picture is corrected, face-detection software finds the person’s face and pulls out its predominant color, overlooking blemishes and other irregularities. This corrected face color is then compared with a database of faces, explains Bhatti. HP researchers have a database of 260 women with different skin tones on whom makeup artists have tested products. The consumer receives a text message identifying the makeup color that looks best on the woman in the database with the most similar skin tone. The technology is described in detail in an upcoming issue of the International Journal of Imaging Systems and Technology. Of course, in the real world, cosmetics companies might want to provide the database of faces, using their own makeup artists to determine the matching hue, says Bhatti.

Color-matching algorithms have been used for years to maintain the color of images across devices such as cameras, computer monitors, and printers. And the idea of using color-matching algorithms to help people shop isn’t entirely new, says Joshua Weisberg , director of digital imaging business development at Microsoft, who worked on the color-management system in Vista. Roughly nine years ago, Weisberg helped test a system that corrected the color of clothes from an online catalogue so that there was less difference between the actual color and that on the monitor. But the technology didn’t take off: people had to hold up a color card to their monitor and click a few buttons to calibrate it. “We knew that it did increase the color accuracy of what would be on the monitors,” Weisberg says, “but in reality, most people didn’t want to spend the three minutes to do it.” While it’s too early to tell what impact HP’s effort will have on the market, he says, “it’s great that HP is investing in technology to solve color management problems. ”

Bhatti says that consumers will find the color-matching technology useful in a variety of ways. A person could use the approach to find a sweater that best complements his or her skin tone, for instance. People could also take pictures of paint on their walls and compare the color to paint chips at a hardware store. Additionally, the technology could be modified for comparing the colors of furniture and rugs. But there are challenges here, Bhatti admits: fabrics and hair are prone to a phenomenon in which two colors may appear identical under one light, but not under another.

Bhatti says that HP doesn’t have a timeline for bringing its color-correction product to market. She says that the company is currently “in talks” with cosmetics manufacturers, but it’s not ready to announce partnerships.

Cut off? Read unlimited articles today.

Become an Insider
Already an Insider? Log in.
More from Business Impact

How technology advances are changing the economy and providing new opportunities in many industries.

Want more award-winning journalism? Subscribe to Print + All Access Digital.
  • Print + All Access Digital {! insider.prices.print_digital !}*

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivered daily

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.