Much has been made of the ‘unprecedented’ scale of the IT infrastructure required to store all the data coming from the world’s largest physics experiment - the Large Hadron Collider (LHC) near Geneva, Switzerland. But another gigantic science experiment, one you’ve probably never heard of, will some day pump out data on a similar scale. And, unlike the LHC, the data it produces will be comprehensible by non-scientists, and made freely available.
Once it’s complete, The Large Synoptic Survey Telescope on top of Cerro Pachón ridge in Chile will sport the world’s largest digital camera. It will peer deep into space yet have a field of view unprecedented in modern telescopes – ten square degrees of the heavens encompassed by a collecting area of forty square meters. The telescope will take 800 panoramic pictures a night, covering the entire night sky twice each week.
The result will be an unfathomably huge photo collection: 20 terabytes of data stored every 24 hours. Running all-out (and telescopes this expensive are usually booked year round) that’s 7.3 petabytes of data a year – half as much data as the 15 petabytes the LHC is producing each year. (To put that in perspective, over its lifetime LHC will produce as much data as all the words spoken by humankind since its appearance on earth.)
In order to handle that much data, once a day all the raw images from the telescope will be transferred to the Archive Center at the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign, where 100 teraflops of processing power will digest and archive it on what will initially be 15 petabytes of storage (to be expanded as the experiment continues).
The results will be freely available to the public via existing open standards, and could help with everything from tracking killer asteroids to unraveling the mysteries of dark energy and dark matter. According to the LSST’s homepage, “Anyone with a computer will be able to fly through the Universe, zooming past objects a hundred million times fainter than can be observed with the unaided eye.”
How AI is reinventing what computers are
Three key ways artificial intelligence is changing what it means to compute.
These weird virtual creatures evolve their bodies to solve problems
They show how intelligence and body plans are closely linked—and could unlock AI for robots.
Our brains exist in a state of “controlled hallucination”
Three new books lay bare the weirdness of how our brains process the world around us.
We reviewed three at-home covid tests. The results were mixed.
Over-the-counter coronavirus tests are finally available in the US. Some are more accurate and easier to use than others.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.