In a dark room down the hall from Michael Bove’s office at MIT’s Media Lab is an apparatus with a white screen the size of a CD jewel box. When Bove sits in a chair opposite the machine and flips a switch, an image of a human rib cage seems to leap out a few inches beyond the screen. The image is produced by the Mark II, a 14-year-old holographic-video system that takes up most of the room. But its vividness is one of the inspirations for Bove’s own project: to bring 3-D video displays to consumer and medical markets.
Bove’s new system, which is called Mark III, is scheduled to be completed by the end of the summer. It can run on a standard PC with a graphics card and will be small enough to fit on top of a desk. (In contrast, an earlier version of Mark II required whole racks of computers.) Although Bove doesn’t yet have any manufacturing partners, he predicts that a product based on Mark III’s design would cost just a couple of hundred dollars to manufacture and could become standard in doctor’s offices as a way to view magnetic resonance images and computed tomography scans in 3-D detail. It would also be within the price range of gamers and technology enthusiasts.
The development of holographic video at MIT dates back to the late 1980s, when researchers put together Mark I, a proof-of-concept system with a low-resolution display. But Mark I and Mark II were destined never to leave the lab. They were, Bove says, “loud, finicky, and a general pain in the neck to work with.” And while numerous researchers in the United States, Japan, Korea, and the United Kingdom have invested time and money in holographic video, no one has yet found a way to build a system that is compact, inexpensive, and easy to use.
In 2004, Bove, who is the head of the Consumer Electronics Lab at MIT, started exploring the possibility of making holographic video practical for consumers. Thanks to ever-more-powerful PCs, small, ultrabright lasers, and other compact optoelectronic devices, he says, a consumer-friendly system is now within reach. And, he says, “there’s more and more 3-D information that’s kicking around” and could easily be projected holographically. Many video games, for example, are now based on sophisticated 3-D models of the virtual world–models that have to be flattened out for the 2‑D screens of PCs or game machines. Similarly, the 3-D data in hospitals’ large stores of magnetic resonance images and computed tomography scans has to be rendered as 2-D cross sections in order for doctors and patients to interpret it.
View a demo of the optical set-up that produces 3-D video.
The Media Lab’s video holograms appear to float above a piece of frosted glass. An electronic device behind the glass, called a light modulator, reproduces interference patterns that encode information about the pictured object. Laser light striking the modulator scatters just as it would if it were reflecting off the object at different angles.
A holographic video begins with a computed 3-D model of some moving object or scene. This model “can be thought of as having a whole lot of points on its surface at different depths that change over time,” Bove says. To make that model holographic, a computer needs to figure out the intensity of the light that would be reflected from each point on the object to the point where the viewer’s eyes will be. “You need to create a diffraction pattern that reconstructs all the different intensities for all the different angles,” Bove says. He found that graphics chips in today’s PCs are adept at doing this sort of 3‑D rendering, computing the diffraction patterns, and combining them into a single video output.
After the computation is complete, the output is fed to the light modulator. The introduction of a novel modulator, says Bove, is a primary reason he and his team have been able to shrink the holographic setup. The modulator is an inexpensive device adapted from use in telecommunications; Daniel Smalley, a graduate student in Bove’s lab, modified its components, optimizing them to convert electrical signals into holographic patterns. Previous holographic systems used up to 18 separate modulators that were made of expensive materials and took up a lot of space. The new device, says Bove, is about half the size of a postage stamp. It’s fast and can accommodate a large amount of data, allowing for high-resolution holograms.
When light from a laser or set of lasers enters the modulator, it’s converted into a series of diffraction patterns that are shaped and focused by a number of lenses and mirrors before they reach the screen. One of the advantages of the new modulator, explains Bove, is that it allows the researchers to avoid using a bulky rotating mirror that previous setups required to keep a holographic scene from drifting horizontally. That mirror was “the bane of the two early generations of [holographic] video display,” he says. Now that it’s been eliminated, Quinn Smithwick, a postdoc in the lab, has figured out how to shorten and fold the system’s optical path so that the necessary components fit into a space about half a meter long.
Currently, Mark III uses a gas laser housed in a foot-long tube. But in its final version, it will use a semiconductor laser as small as a postage stamp. Bove says the system will project a monochromatic video scene, about the size of a snapshot photo, that will have the resolution of a standard television image.
Aware that this sort of display wouldn’t cut it in consumer applications, Bove and his team have laid out plans for the next generation of the system, Mark IV. Mark IV will use a set of powerful red, blue, and green semiconductor lasers to shine full-color videos onto a screen the size of a computer monitor. A prototype could be ready within the next couple of years.
The market, of course, will dictate how quickly, if ever, holographic video makes its way into living rooms or doctor’s offices. If all goes well, however, it could give doctors a better window into the body, let scientists visualize data more accurately, and help gamers immerse themselves more deeply in virtual worlds.
This new data poisoning tool lets artists fight back against generative AI
The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models.
Rogue superintelligence and merging with machines: Inside the mind of OpenAI’s chief scientist
An exclusive conversation with Ilya Sutskever on his fears for the future of AI and why they’ve made him change the focus of his life’s work.
Data analytics reveal real business value
Sophisticated analytics tools mine insights from data, optimizing operational processes across the enterprise.
Driving companywide efficiencies with AI
Advanced AI and ML capabilities revolutionize how administrative and operations tasks are done.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.