Soft Scissors for Cutting Photos

Researchers at Microsoft have found a way to help photo editors cut a furry object out of a picture and keep its fuzz. As anyone who has used an editing tool like Photoshop knows, it’s impossible to easily and accurately cut around stray hairs or other soft edges. But Michael Cohen and his team at Microsoft Research have developed a tool, called Soft Scissors, that accounts for the basic shape of an object, such as a dog, as well as the shape of fur and stray hairs. (See slide show of images.)

Technology for making these soft cuts has been around for years, but there’s usually a trade-off between the quality of the cut and the amount of time it takes to process it. Cohen’s goal in this work, presented earlier this month at SIGGRAPH, is to reduce the amount of time it takes to produce a high-quality cut of a furry object.

The researchers modified an algorithm that they had previously developed for making high-quality cuts around difficult objects by adding three new characteristics to it. First, when a person traces around the object, the algorithm chooses a minimal amount of pixels to use to update the object’s edge. For instance, if most of the edge is smooth, then fewer pixels need to be collected to determine where the edge of the object is. Second, the color of the object is also incrementally estimated. Third, the width of the tracing tool automatically adjusts to accommodate longer stray hairs.

Currently, the algorithm requires a user to trace around an object, but the researchers suspect that it could also be used as the basis for a tool that automatically cuts furry foreground objects, possibly even in video.