Cleaning Up Shaky Home Video

Video-enhancing software developed for the CIA is coming to consumers.

An annoying side effect of ubiquitous video cameras--on cell phones and digital still cameras, for instance--is ubiquitous low-quality videos. YouTube is rife with them: shaky soccer games, dimly lit baby's first steps, and pixelated party clips. Next month, however, software maker MotionDSP, based in San Mateo, CA, will release a $40 download for PCs that could clean up some of the most annoying aspects of subpar video, from shakes to low light. The product, called vReveal, is aimed at the average home videographer who wants better vacation clips but doesn't want to invest in serious video-editing software.

Vivid video: MotionDSP will offer consumer software that can take low-quality video (left) and convert it into high-quality video (right) by analyzing the characteristics of pixels across a number of frames. Credit: MotionDSP

Multimedia   Click here to see a video comparing low-quality video with video that's been processed with MotionDSP's software.

According to MotionDSP's CEO, Sean Varah, the company developed its image-enhancement algorithms for the CIA. But the consumer version of the software comes with conventional video-editing tools that allow people to edit and stitch clips together, and it works with the Windows XP and Vista operating systems.

The idea of cleaning up video is certainly not new. For years, software companies have been using so-called super-resolution algorithms to make scenes clearer. In essence, these algorithms analyze information about the color and position of pixels within a handful of video frames and extrapolate extra information that can be used to make edges sharper or eliminate motion due to camera jitter. Salient Stills, an MIT spinoff founded in 2000, uses super-resolution algorithms and other techniques to enhance video for law-enforcement agencies. More recently, Intel has investigated the potential of running super-resolution algorithms on its multicore machines.

Apple, whose iMovie is generally considered the most useful consumer video-editing software, announced yesterday at the Macworld Expo that iMovie '09 will have some form of automatic video stabilization to clear up shakes. Additionally, Adobe and Sony offer editing software that includes video-enhancing features for under $100.

But Varah says that vReveal's advantage is that it was designed specifically for the casual home user. "What [Sony's and Adobe's products] started off as were high-end video-editing programs," he says. "The companies feature-stripped them to make cheap, under-$100 products that you can run at home."

Story continues below

Varah also argues that having to meet the CIA's requirements set a higher standard for MotionDSP's algorithms. The algorithms leverage a handful of patents based on work done in the lab of Peyman Milanfar, MotionDSP co-founder and professor at the University of California in Santa Cruz.

The algorithms track motion through several frames of video to determine which characteristics of the motion appear to be due to a jerky camcorder. This motion is then subtracted from the scene when the video is rendered.