Skip to Content

How a Single Screen Can Show Several Interactive Perspectives

A new kind of display technology could allow several people to watch and interact with the same screen but see different points of view.

Visiting an interactive 3-D environment is often a lonely experience. The need to wear a special headmounted display or to look at different screens means that it can be hard to interact meaningfully with other users.

That could be about to change thanks to a new technology unveiled today by Xiaolin Wu and Guangtao Zhai at McMaster University in Canada.

These guys have worked out a way for a single display to show several different image streams which the viewers choose using a controller attached to LCD glasses.

That’s possible because of relatively innocuous advances in display technology. Many displays these days are capable of showing images at a rate of 240 per second or more. Similarly, LCD glasses can match this rate.

Of course, the human visual system cannot process images at a rate higher than about 60 Hz.

So this allows several image streams to be displayed at the same time. For example, one might show the human body, another might show the vascular system, another the internal organs and another skeleton.

One viewer might select the vascular system superimposed on the skeleton. Another might want to look at the internal organs and so on.

Another option might be to show the same view from different angles. Then as the viewer moves his or her head, the perspective can be made to change.

The big advantage, of course, is that all viewers look at the same screen and so are able to discuss what they see.

A more technical advantage is that this dramatically reduces the amount of real-time processing that has to be done. All the headmounted glasses have to do is synchronise with a specific subset of images based on the user’s choice or head movement.

That has obvious applications in things like gaming and virtual tourism. It also has applications in life-critical work such as surgery, where doctors may need to interact in different ways with a 3-D data set and discuss their views.

Wu and Zhai have also identified an interesting set of security applications. Their idea is that an image can be scrambled between several streams and reassembled using a pair of encrypted LCD glasses. An eavesdropper without the glasses, on the other hand, would simply see a screen of white noise.

One application they suggest is to scramble the keys on an ATM machine so that only those wearing the glasses can see them. This would prevent an onlooker from seeing the user’s pin number.

Wu and Zhai call this process temporal psychovisual modulation and even seem to have a rudimentary version of their system working, which they show off in a video.

A potentially interesting advance.

Ref: arxiv.org/abs/1201.1601: Temporal Psychovisual Modulation: a new paradigm of information display

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

The problem with plug-in hybrids? Their drivers.

Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

How scientists traced a mysterious covid case back to six toilets

When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.