Skip to Content

Building a Library for VR, One Image at a Time

The Internet is slowly becoming available in virtual reality with a new library of photorealistic scans.
October 11, 2016

If you’re searching for a new house or apartment online, you might start noticing a new icon that looks like a pair of glasses in the bottom right corner of photos. Clicking it will launch a 360° virtual-reality view that you can see as long as you’re wearing a Google Cardboard or Samsung Gear VR headset.

It’s the result of a library of more than 250,000 3-D scans that San Francisco company Matterport just converted to be compatible with VR. In these early days of VR, the content isn’t diverse enough to match the abilities of a desktop computer. Matterport’s library of photorealistic scans can fill some gaps in cases where a VR view can improve upon a more traditional Internet browsing experience.

Matterport’s initial partners are concentrated in real estate. Websites like,, and Sotheby’s will now feature the VR headset icons on some photos. But the library extends far beyond 3-D scans of houses. Anyone with Matterport’s room scanner—a souped-up camera more likely to be owned by a company or studio given its $4,500 price tag—can upload scans to the library for $19 each. They’re converted into VR-viewable content from the browser-based 3-D models for which Matterport is known.

Matterport is opening the whole package up to developers, who could choose to take a 3-D space and build a social or gaming experience on top of it. They could also expand on the real estate partner’s current application by making it possible to virtually place furniture or paint within a 3-D scan of a room that you can tour in VR.

Virtual reality is a heavily visual medium. But right now, most of those visuals still need to be built. VR is so new that it hasn’t yet been seeded with the heaps of pre-made content that have made the modern Internet so interesting.

“It’s very hard to create content for VR from scratch,” Matterport cofounder and chief strategy officer Matt Bell says. “If you were to go build a 3-D model of someone’s apartment just from taking a lot of photos and doing measurements and building it in a 3-D design program, that would take weeks to do.”

Linden Lab, creator of the expansive online social world Second Life, is working on a new social world for VR. It’s called Sansar, and like Second Life it’s built to allow users to quickly pull together places and objects to customize their space. You can interact with other people within the game and program objects to do pretty much whatever you want.

Linden Lab is working on the same challenge of bringing real life content into VR, according to CEO Ebbe Altberg. The game currently features an Egyptian tomb that is a 3-D scan of the real deal. The scan was uploaded, published, and shared to Sansar’s community, and now virtual social interactions can take place inside the tomb.

“How else would other people ever have a chance to visit that tomb and talk to other people inside of it?” Altberg says.

It’s a good case for using 3-D scans in VR to simulate travel. Users can visit places that are too expensive or dangerous to visit. Altberg also sees applications in education, advertising, and skill training.

As VR grows, so will the visual content available to use and remix. But for now, Matterport’s library is a good example of how the infant VR industry can fit into our daily activities on the Internet.

Keep Reading

Most Popular

Geoffrey Hinton tells us why he’s now scared of the tech he helped build

“I have suddenly switched my views on whether these things are going to be more intelligent than us.”

Meet the people who use Notion to plan their whole lives

The workplace tool’s appeal extends far beyond organizing work projects. Many users find it’s just as useful for managing their free time.

Learning to code isn’t enough

Historically, learn-to-code efforts have provided opportunities for the few, but new efforts are aiming to be inclusive.

Deep learning pioneer Geoffrey Hinton has quit Google

Hinton will be speaking at EmTech Digital on Wednesday.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.