Skip to Content

Prototype Microsoft Displays Watch You Back

A new screen could enable more sophisticated touch computing and glasses-free 3-D.

In a keynote speech this morning at the Society for Information Display’s annual Display Week conference in Seattle, Steven Bathiche, the research director of Microsoft’s Applied Sciences Group, demonstrated an immersive computing system that expand on the company’s Surface technology. Surface is a tabletop display that uses a set of four cameras to detect the location of objects placed on its surface, and special software to identify objects. Even with fantastic software, this technology can only do so much.

During his talk, Bathiche played a video that shows what’s possible when this concept is combined with better hardware–some nifty (but sketchily explained) optics and a transparent display. Transparent displays can do more than provide heads-up information while allowing you to see in front of you (for example showing traffic information on a windshield). A transparent display can look back at you. Bathiche’s group has combined a flat lens called a wedge lens with a transparent light-emitting diode display. This system can act as a touch screen; it can also detect gestures made from several feet away.

In video of a demo system where the display is mounted on top of the flat lens, a man walks up to the display and then walks back several feet, while the display shows his image. That image is captured using the lens rather than an external camera. Using this form factor, each hand can be assigned a different function–the left hand draws while the right moves the “paper” on screen. Even when the hands cross, the system keeps track of which hand is which and what it does.

Another system Bathiche showed on video uses a camera and image-processing sofrware to determine two viewers’ positions, and the positions of their eyes, and then processes that information to sequentially and directionally display different images to each viewer. Bathiche said this enables side-by-side, glasses-free 3-D viewing.

Keep Reading

Most Popular

Rendering of Waterfront Toronto project
Rendering of Waterfront Toronto project

Toronto wants to kill the smart city forever

The city wants to get right what Sidewalk Labs got so wrong.

Muhammad bin Salman funds anti-aging research
Muhammad bin Salman funds anti-aging research

Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging

The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.

Yann LeCun
Yann LeCun

Yann LeCun has a bold new vision for the future of AI

One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.