Microsoft just added an interesting new feature to Bing
Maps–augmented reality. Actually, it’s a bit more like augmented reality in
reverse.
A new function, called Streetside Photos, takes real images
and video clips and neatly stitches them onto the Bing Map’s street-level view,
using a clever combination of geolocation information (from a GPS-enabled device, or added manually by the user) and imaging-matching algorithms. This means you can, for example, zoom in on a street and see an image of a particular
storefront that was just uploaded to Flickr or Twitpic instead of the standard one. Steetside Photos, which
is available for Seattle and
San Francisco maps, also
includes some nice historical imagery.
Advertisement
Blaise Agüera y Arcas, architect of Bing Maps, demoed the feature today at the TED conference,
which is taking place in Long Beach and Palm Springs, California.
This story is only available to subscribers.
Don’t settle for half the story.
Get paywall-free access to technology news for the here and now.
Agüera y Arcas presented another image-stitching program called Photosynth at TED in 2007. He tells me that the new application’s
algorithms are similar to Photosynth’s but effectively work in reverse.
“In Photosynth you start off with a bag of disorganized photos and it
finds visual connections,” he says. “This is the same; instead of a
bag of photos I have one and all of the structured imagery [to attach it
to].”
The software behind Streetside Photos can adjust a photo
so that it matches to within a few inches, rather than a few feet. This kind of
precision is important for augmented reality to work effectively. “The
pushpin or the GPS both have quite a bit of inaccuracy,” says Arcas.
“It’s typical for it to be off by 40 meters or more. Some are even more
ambiguous.”
The user sees a list of photos on the side of the screen
and, if she clicks on one, the map view moves to that spot and the photo
becomes a bubble overlaying it.
Perhaps most impressively, it can overlay moving video
on top of a map, creating a “lens” type of effect, as illustrated in
the video at Pike Place Market in Seattle below. While Agüera y Arcas would not say if
there will be a Smart phone app to follow Streetside Photos, it seems like a
natural progression.
Agüera y Arcas explain the concept in the video below.
