|
Tuesday, June 26, 2007 Converting DVD into HD DVDSoftware for multicore computers could add resolution to video in real time. By Kate Greene
Researchers at Intel have developed an algorithm that, by leveraging the power of multiple microprocessors, can boost the resolution of a video as it plays in real time. The technology, called super resolution, can run on machines with as few as two cores and as many as hundreds, potentially letting people enhance video captured with a cheap webcam, improve old home movies, or turn a DVD-quality video into a high-resolution flick. Intel's super-resolution research is part of the company's push to find the best applications to run on its multicore machines, says Jerry Bautista, codirector of Intel's tera-scale computing research program. While multicore computers--machines with more than one processing core--are currently available to consumers in dual- and quad-core varieties, Intel has a research-grade microprocessor with 80 cores. (See "The Promise of Personal Supercomputing.") And as researchers get closer to their goal of achieving tera-scale computing on desktop computers--in which trillions of calculations per second are enabled by massively multicore systems--the company is ramping up its software research; improving video quality using multicore machines is one of the top priorities on Intel's to-do list, says Bautista. To be sure, the chip maker isn't the first to explore the idea of adding resolution to video. Super-resolution theory dates back to the 1980s, says Peyman Milanfar, a professor of electrical engineering at the University of California, Santa Cruz. But in the early days, the algorithms just didn't work well, and the computing power wasn't there to process the videos quickly. In 2003, Milanfar and his group developed computationally efficient algorithms that were able to improve the resolution for most video, although not in real time. Indeed, Milanfar's approach has been the basis of other research by academics and companies. Super-resolution algorithms upgrade video in two main steps, explains Oscar Nestares, senior research scientist at Intel. First, the algorithm examines pixels in the video frames to see how fast each pixel is moving and in which direction. For instance, if a car is moving down a street, the pixels that compose it will all be moving in a predictable way. The data collected in the first step is then used to estimate the movement of new pixels that are added to increase the video resolution. The result is a cleaner video that appears to be captured at the same time as the original. "We're trying to get information that's not there between frames," says Intel's Bautista. "The only way we can do this is if we collect lots of data and make better educated guesses at what those intermediate pixels should be." Bautista explains that one thing that differentiates Intel's super-resolution algorithm from others is its ability, in real time, to generate what's known as a robust result. This means that the algorithm is able to toss out any erroneous pixels that could be a result of electrical noise in the sensor or dust on the lens, for instance. These erroneous pixels tend to lead to inaccurate guesses and a video that isn't true to reality. |
New Tricks for Online Photo Editing
10/16/2007



Comments
inboulder on 06/26/2007 at 3:28 AM
10
Mr.Doerr on 06/26/2007 at 11:24 AM
1
3danim8 on 06/26/2007 at 11:53 AM
1
Should the description read: "output on the right..."
brunascle on 06/26/2007 at 12:15 PM
Web Developer
70
and judging the result by the resolution you're able to achieve is totally meaningless. i can put a video into whatever resolution i want simply by filling in random pixels, or upscaling. the only way to judge it is to either compare it to an original taken at the same resolution, or by human perception.
GaryB on 06/26/2007 at 5:59 PM
42
I'd like to see this work on non-text, say a sports clip with near/play far/crowd differences. Or better yet, a youtube clip which have just awful resolution and terrible compression artifacts. But, as is, it's pretty cool work.
mem11363 on 07/08/2007 at 2:16 AM
1
pookien on 08/22/2007 at 1:18 PM
1
http://www.thedeemon.com/super_resolution/
http://www.thedeemon.com/VideoEnhancer/
jkent on 04/22/2008 at 6:18 PM
1
http://www.cnbc.com/id/23954891/
The company's called Topaz Labs. www.topazlabs.com . They make some bold claims.