Technology Review - Published By MIT
Advertisement

arXiv blog

The Physics arXiv Blog produces daily coverage of the best new ideas from an online forum called the Physics arXiv on which scientists post early versions of their latest ideas. Contact me at KentuckyFC @ arxivblog.com

Email Subscription

Recently on the arXiv blog...

Recent comments on the arXivblog

  • Mr CP : Wow!  These games are almost as fun as throwing a real ball around!  Almost.  :)
  • scoubidoo : I suggest you visit the NooJ website: http://www.nooj4nlp.net/pages/nooj.htmland discover the...
  • coolmike : The other issue that is being overlooked is the type of prepaid service, and how the cost impacts...
  • jhertzberg : I checked the date as I read this (nope, not April 1st). How long until we start using...
  • jtempere : Both yttrium barium copper oxide and the family of bismuth strontium calcium copper oxides have...
  • sleeprun : We read a Wharton study of doctors influencing new treatment adoption.  It was not the most...
  • ZephirAWT : isn't completelly new in this context, as the simmilar concept was proposed by Mark Hucko in 1985...
  • ZephirAWT : If I understood it well, by your theory matter universe is surrounded by antimatter universe and...
  • matt_s : Couldn't we theoretically save the earth from the eventual expansion of the sun in it's...
  • ... : This is not about the originators of ideas, but about how the ideas spread. A well connected...
  • debu : Please read my ether-gravity or theory of gravitoethertons which explains many aspects of quantum...
  • ms : So is AMSC selling superconducting wire that doesn't exist?
  • shazl : I believe the results are not only because of somebody being post-paid or pre-paid. It's...
  • ... : I am surprised no one is addressing an immediate need for energy here on earth, and what this...
  • IXANTI666 : THE NEXT STEP HUMAN TELEPORTATION.SINCE WE ARE MADE UP OF QUATUM MATTER TO BEGIN WITH TO BORROW...
  • 020648 : try www.prisonplanet.tv
  • ZephirAWT : And what prohibits scientists in ATTEMPT to replicate J.F.Prins experiments? Are they so...
  • ... : Make me some 90K Tc superconductor and I'll finish my PhD in a month! How's this for a conspiracy...
  • sfrysfry : For ideas on entangling larger structures, I introduce the conjecture of Nicholas Greaves, an...
  • snedunuri : This might explain how UFOs get the energy they need to travel interstellar distances. Either...
Advertisement
Tuesday, March 17, 2009

Why compressive sensing will change the world

A new way to sample signals produces 2D images using a single pixel...and that's just the start.

If you haven't come across compressive sensing, you will do soon. It's a way of sampling and reconstructing an analogue signal at a rate far lower than standard information theory would deem possible.

If you're curious, Olga Holtz from the University of California, Berkeley, has prepared a handy primer so you can impress your friends with your superior knowledge when they finally stumble across it.

Holtz points out that the conventional limit is determined by the Shannon-Nyquist-Whittaker sampling theory which states that perfect reconstruction is possible only when the sampling frequency is greater than twice the maximum frequency of the signal under study.

Entire fields of electronics engineering and information theory are based on this idea; unnecessarily as it now turns out.

Compressive sensing relies on the fact that most analogue signals have a structure of some kind that can be exploited to reconstruct them. Know this structure and the signal can be reconstructed using a sampling rate that is significantly lower than the Nyquist rate.

The difficulty is in determining the structure, an NP-hard problem that cannot usually be solved in a reasonable amount of time. But it turns out that with a little mathematical trickery, even this isn't necessary and the signal can indeed be reconstructed successfully with a fraction of the Nyquist sampling rate.

That's going to have big implications for all kinds of measurements. Holtz gives the example of a camera developed by Richard Baraniuk and Kevin Kelly at Rice University which produces an image equivalent to a 5 megapixel image compressed using a standard jpeg algorithm to about 50,000 pixels.

The Baraniuk/Kelly camera records 200,000 pixels but does it with a single solitary pixel used over and over again.

The trick is in the way the camera processes the image before it is recorded: the image is reflected off a randomised array of micromirrors before being focused onto the single pixel. The array is randomised again and the recording repeated 200,000 times to create the image.

The result is a 25-fold saving in the amount of data the camera needs to collect compared with a 5 megapixel image.

That may not be of much significance for your holiday snaps. But if you're an astronomer, medical imaging specialist, communications engineer (or just about anybody who ever makes any kind of measurement) this should make your eyes light up.

Ref: arxiv.org/abs/0812.3137: Compressive Sensing: A Paradigm Shift in Signal Processing

(Incidentally, this idea explains a phenomenon that has puzzled physicists for some time: the curious creation of "ghost images" that physicists had thought were the result of entanglement. Last year, we discussed some work showing that entanglement could not be involved but raising the quite reasonable question of what on Earth was to blame. In fact, the entire affair can be explained by compressive sensing, as pointed out by Wim and Igor Carron in the comments at the time.)


Comments

  • Compressive Sensing Hardware and other resources.
    For those of your readers who might be interested, I am making a survey of the known hardware implementing compressive sensing in some fashion or another at:

    http://igorcarron.googlepages.com/compressedsensinghardware

    As can be seen from the list, while extremely valuable, the single pixel camera at Rice is not the only example of new architecture enabled by this new sampling scheme. For your information, I also write a small blog on the topic:

    http://nuit-blanche.blogspot.com/search/label/CS

    The Repository at Rice is also an extremely valuable resource:

    http://dsp.rice.edu/cs

    Most of these links on the subject (videos of very recent online talks,...) can eventually be found from here:

    http://compressedsensing.googlepages.com/

    Cheers,

    Igor.
    Rate this comment: 12345

    igorc
    03/17/2009
    Posts:6
    Avg Rating:
    5/5
  • Compressive Sensing: Top 10 Emerging Technologies
    It is pretty impressive stuff. I had the chance to visit Kevin Kelly and Richard Baraniuk's setup at Rice a few years back. The power of the computational approach was evident to me when I saw the types of pictures tthey created with such a simple hardware setup.

    Here's the Technology Review article about the initial work by Kelly and Baraniuk:

    http://www.technologyreview.com/read_article.aspx?ch=specialsections&sc=personal&id=17610

    In 2007, we featured compressive sensing as a TR10. This link includes a good infographic.

    http://www.technologyreview.com/read_article.aspx?ch=specialsections&sc=emerging&id=18293
    Rate this comment: 12345

    Kate Greene
    03/17/2009
    Posts:16
    Avg Rating:
    4/5
  • Compressive sensing and Ghost imaging
    We've just read your new entry on compressive-sensing and your remark about ghost-imaging and our arXiv entry.
    We would like to thank you for the reference to our work and for the link that has been made thanks to it between GI and CS.

    However, we wish to note that actually the reconstruction in done in all the works doing GI to-date have utilized a LINEAR reconstruction
    algorithm without any nonlinear L_1 minimization which is the 'engine' of CS.

    Ghost imaging works well with a linear reconstruction, and therefore we believe that compressed sensing is not a central theme in ththe debate whether ghost imaging is a classical or quantum phenomenon. CS does allow
    us to obtain 'ghost images' with a significantly improved SNR and with much less realizations, and we are very excited from that. Somehow we feel
    that this point is not that clear in today's arxiv blog.

    To demonstrate this, we have recently successfully utilized Figueiredo's
    GPSR algorithm (http://www.lx.it.pt/~mtf/GPSR/) on our real GI experimental results.
    We've used a 76x70 resolution data, gathered by the same setup as in our arXiv paper: a transparency plate with the to-be-resolved pattern is shined by a random light pattern (speckles) generated by a scattered
    laser-beam.
    I'm attaching two preliminary results reconstructed using 1024 and 2048
    measurements / observations, which are ~20% and 40% of the Shannon/Nyquist
    rate, respectively.

    The results of the two GPSR algorithms are obtained by minimizing l1 in the 2D-DCT domain, and are plotted next to the reconstruction using the 'standard' Ghost-Imaging (GI) linear algorithm: x=A'(y-<y>), and an approximation of the original transparency.

    Ori Katz,
    Ultrafast Optics Group,
    Dept. of Physics of Complex Systems,
    Weizmann Institute of Science.
    www.weizmann.ac.il/~feori For the team's latest results see here
    Rate this comment: 12345

    kfc
    03/18/2009
    Posts:5
    Avg Rating:
    5/5
Advertisement

Log In

Forgot your password?     Register »
Advertisement
Technology Review January/February 2010

Current Issue

Security in the Ether
Information technology's next grand challenge will be to secure the cloud--and prove we can trust it.
•  Subscribe
Save 36%
•  Table of Contents
•  MIT News
» Gift Subscription
» Digital Subscription
» Reprints, Back Issues
» Subscribe
» Table of Contents
» MIT News

More Technology News from Forbes

Advertisement
MIT Massachusetts Institute of Technology © 2010 Technology Review. All Rights Reserved.