Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Connectivity

Augmented Reality on Your Desk—All You Need Is a Lightbulb Socket

A prototype device uses a small projector, a depth sensor, and a computer to project multi-touch displays onto any surface.

Do you have a lamp with a standard-size lightbulb socket? If so, you’ve already got one piece of the required gear for turning your desk—or fridge, wall, or pretty much any other surface—into an augmented-reality display that you can interact with much as you do with the screen of a smartphone.

That’s the premise behind a project from researchers in the Future Interfaces Group at Carnegie Mellon University. Called Desktopography, it uses a small projector, a depth sensor, and a computer to project images onto surfaces; the projections can move around to stay out of the way of objects that are also on the surface. It screws into a lightbulb socket, and the latest prototype uses the lamp for power, says Robert Xiao, a graduate student who leads the project.

Desktopography can project things like a calculator or map onto a desk, and then you can interact with it or move it around by using multiple fingers. If you place an object—say, a cup—on the area where one of the images is projected, software helps it quickly move to an open spot. The projections can be linked to physical objects, too, so if you move a book across a table, a calendar projected on it can travel along.

While it’s still confined to the lab, Xiao says Desktopography is an attempt to bring augmented reality to everyday life without adding any sensors or electronics to the surfaces on which you want to see images. Unlike Microsoft’s HoloLens and Meta’s Meta 2 (see “The Desktop of the Future Is Coming”), it doesn’t require a headset to produce good-looking images, and unlike apps such as Pokémon Go, it doesn’t use a smartphone to make these virtual images appear in front of you.

Carnegie Mellon researchers built a prototype of an augmented-reality display that projects onto surfaces and has multi-touch capabilities like a smartphone screen.

“It’s about trying to break interaction out from our screens and our devices, where they’re separated from reality, and a separate world, really … and try to merge those onto our environment,” Xiao says.

There are a lot of hurdles to overcome before Desktopography can be commercialized. For instance, using a camera for precise multi-touch tracking is tricky, especially when the camera is above your hand and trying to estimate when your finger touches a surface, since it can’t see the bottom of your finger. And it’s also hard to pack everything into a small package while properly dissipating the heat generated by running the device.

Xiao is trying to be realistic, saying it could take about five years to make his project a real product.

Couldn't make it to EmTech Next to learn how virtual reality is driving the future of work?

Go behind the scenes and check out our video
More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    Print + Digital Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

    Technology Review PDF magazine archive, including articles, images, and covers dating back to 1899

    10% Discount to MIT Technology Review events and MIT Press

    Ad-free website experience

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.