Skip to Content

Prototype Microsoft Displays Watch You Back

A new screen could enable more sophisticated touch computing and glasses-free 3-D.

In a keynote speech this morning at the Society for Information Display’s annual Display Week conference in Seattle, Steven Bathiche, the research director of Microsoft’s Applied Sciences Group, demonstrated an immersive computing system that expand on the company’s Surface technology. Surface is a tabletop display that uses a set of four cameras to detect the location of objects placed on its surface, and special software to identify objects. Even with fantastic software, this technology can only do so much.

During his talk, Bathiche played a video that shows what’s possible when this concept is combined with better hardware–some nifty (but sketchily explained) optics and a transparent display. Transparent displays can do more than provide heads-up information while allowing you to see in front of you (for example showing traffic information on a windshield). A transparent display can look back at you. Bathiche’s group has combined a flat lens called a wedge lens with a transparent light-emitting diode display. This system can act as a touch screen; it can also detect gestures made from several feet away.

In video of a demo system where the display is mounted on top of the flat lens, a man walks up to the display and then walks back several feet, while the display shows his image. That image is captured using the lens rather than an external camera. Using this form factor, each hand can be assigned a different function–the left hand draws while the right moves the “paper” on screen. Even when the hands cross, the system keeps track of which hand is which and what it does.

Another system Bathiche showed on video uses a camera and image-processing sofrware to determine two viewers’ positions, and the positions of their eyes, and then processes that information to sequentially and directionally display different images to each viewer. Bathiche said this enables side-by-side, glasses-free 3-D viewing.

Keep Reading

Most Popular

DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.

“This is a profound moment in the history of technology,” says Mustafa Suleyman.

What to know about this autumn’s covid vaccines

New variants will pose a challenge, but early signs suggest the shots will still boost antibody responses.

Human-plus-AI solutions mitigate security threats

With the right human oversight, emerging technologies like artificial intelligence can help keep business and customer data secure

Next slide, please: A brief history of the corporate presentation

From million-dollar slide shows to Steve Jobs’s introduction of the iPhone, a bit of show business never hurt plain old business.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.