Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

  • Scape; Photos edited by MIT Technology Review
  • Connectivity

    Mapping the world in 3D will let us paint streets with augmented reality

    Machines need an exact digital replica of our world if we’re going to get true, location-specific AR—or accurate robot food deliveries.

    If you believe tech optimists, 10 years from now self-driving cars will be ubiquitous, drones will deliver our parcels, and robots will bring us our groceries. And one day soon, our cities will be painted with augmented reality that feels as if it belongs to the street corner where it was placed.

    Whether or not any of that comes to pass, one piece of the puzzle will be crucial to this future: ultra-precise location technology. GPS and the wandering blue dot on smartphone mapping apps are useful for a human navigating an unfamiliar city, but that just won’t cut it for machines. They will need to know where things are down to the centimeter.

    Sign up for The Download
    Your daily dose of what's up in emerging technology

    London-based startup Scape reckons that’s what it can provide. The firm’s visual positioning service uses GPS and multiple camera images to work out exactly where you are within two or three seconds, according to cofounder Edward Miller. It has collected over two billion street images to precisely 3D-map more than 100 cities around the world, including London, San Francisco, Paris, Moscow, and Tokyo. Some of the data was collected by employees cycling around the cities with cameras attached to their bicycles, but Scape’s platform can process images from any source.

    Scape

    In use, Scape’s algorithms extract “points of interest” (like street signs, storefronts, or lampposts) from any image in order to compare it with the billions already in its database. Its system then uses triangulation to deduce the angle and distance from which the object was observed, returning its precise location to the end user. This kind of accuracy will anchor AR to the world better than is possible with GPS or other technologies—making it far more impressive and versatile.

    “Scape is about taking this to the next level. It’s about expanding this capability out to an entire living, breathing city,” Miller says.

    Scape

    There are some exciting applications of AR already, mostly within the entertainment world: just a few days ago Snapchat celebrated the launch of the latest season of Game of Thrones by unleashing virtual dragons in New York. But many commercial companies also want AR products that are locked in a specific place for customers as they walk through a city. Relying on GPS to do this doesn’t really work too well at the moment (beyond games like Pokémon Go).

    “Using existing location technologies, you can navigate through a city with an accuracy of a few meters. This is okay, but for augmented reality, you’ll need a completely different level of precision,” says Krystian Mikolajczyk, a computer vision expert at Imperial University.

    Of course, this kind of accuracy won’t just be a boon for AR applications. The challenge of how to make machines understand their surroundings is one that lots of companies are grappling with.

    For example, Waymo packs its cars with GPS, lidar, cameras, and radar sensors to help them navigate autonomously. Starship Technologies, which provides robot delivery services, uses a similar approach. The difference here is the level of precision—and the fact that Scape is doing it purely using cameras, which are significantly cheaper than lidar and other laser technologies. Its platform also differs from others in generating maps that can cope with changes to the environment, which is crucial for creating one unified version of the world for both people and computers. This will be important for letting humans collect robot or drone deliveries, for example.

    Scape wants to use its location services to become the underlying infrastructure upon which driverless cars, robotics, and augmented-reality services sit. 

    “Our end goal is a one-to-one map of the world covering everything,” says Miller. “Our ambition is to be as invisible as GPS is today.”

    Learn from the humans leading the way in connectivity at EmTech Next. Register Today!
    June 11-12, 2019
    Cambridge, MA

    Register now
    Scape
    More from Connectivity

    What it means to be constantly connected with each other and vast sources of information.

    Want more award-winning journalism? Subscribe to MIT Technology Review.
    • Print + All Access Digital {! insider.prices.print_digital !}* Best Value

      {! insider.display.menuOptionsLabel !}

      The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

      See details+

      12-month subscription

      Unlimited access to all our daily online news and feature stories

      6 bi-monthly issues of print + digital magazine

      10% discount to MIT Technology Review events

      Access to entire PDF magazine archive dating back to 1899

      Ad-free website experience

      The Download: newsletter delivery each weekday to your inbox

      The MIT Technology Review App

    • All Access Digital {! insider.prices.digital !}*

      {! insider.display.menuOptionsLabel !}

      The digital magazine, plus unlimited site access, our online archive, and The Download delivered to your email in-box each weekday.

      See details+

      12-month subscription

      Unlimited access to all our daily online news and feature stories

      Digital magazine (6 bi-monthly issues)

      Access to entire PDF magazine archive dating back to 1899

      The Download: newsletter delivery each weekday to your inbox

    • Print Subscription {! insider.prices.print_only !}*

      {! insider.display.menuOptionsLabel !}

      Six print issues per year plus The Download delivered to your email in-box each weekday.

      See details+

      12-month subscription

      Print magazine (6 bi-monthly issues)

      The Download: newsletter delivery each weekday to your inbox

    /3
    You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.