Do not adjust your smartphone: there isn’t really a cartoon lion in front of you, it’s just an impressive augmented reality trick developed using new tools from Google. The search company has long attempted to popularize AR on smartphones. But on Tuesday, the company revealed its latest tactic: a set of software tools called ARCore that it hopes developers will use to make AR apps for Android phones.
In a blog post, Dave Burke, vice president of Android Engineering, writes that ARCore can do things like track a phone’s location and the direction in which it’s facing by using its camera and sensors (helpful for keeping virtual objects in the same spot), figure out where there are horizontal surfaces (upon which an app may want to place, say, a virtual cup of coffee), and pay attention to real-world light to help developers figure out the most realistic ways to display their virtual objects.
An early version of ARCore is being released Tuesday, and in his post Burke says it will initially work with the company’s Pixel smartphone and Samsung’s Galaxy S8 handset, as long as they’re running the Nougat version of Android, or newer. (He writes that this would make ARCore capable of running on “millions” of devices off the bat, but really that’s just a small percentage of the more than two billion devices out there using Android.)
There have been smartphone augmented reality apps available for Android and iOS for years, but none of them work all that well or look that good: virtual images tend to float awkwardly in space, rather than fitting in with real-world surroundings, and the software doesn’t cope well with things like changing lighting conditions. Even Pokémon Go, a smash hit when it was released in the summer of 2016, doesn’t do a great job of mixing virtual creatures with reality as you see it through your smartphone screen.
However, a handful of short videos and GIFs that Google made available to show off ARCore in action look impressive. In one clip, a life-size, solid-looking cartoon lion stands in a lobby, facing a real dog, with appropriate-looking shadows on the tile floor moving as the lion shifts. In another, a life-size scarecrow stands on a sidewalk in front of a very real taco truck, pondering the menu, fitting in quite well with the people standing behind him.
Burke writes that ARCore takes advantage of mobile augmented-reality technologies that were developed through building Tango. That is a technology that Google first showed off in 2014, which uses a combination of sensors and computer vision to help phones figure out precisely where they are in 3-D space, even in the absence of GPS. But Tango-capable devices require fancy hardware, like a depth sensor, and there are few phones out there that support it, so it hasn’t become widely used.
ARCore is meant to work without such hardware additions, which means it could be added to apps that a lot more people will be able to use in the near future. Burke says the goal is to have ARCore working on 100 million devices at the end of the developer preview, which Google anticipates will be sometime this winter.
Embracing CX in the metaverse
More than just meeting customers where they are, the metaverse offers opportunities to transform customer experience.
Identity protection is key to metaverse innovation
As immersive experiences in the metaverse become more sophisticated, so does the threat landscape.
The modern enterprise imaging and data value chain
For both patients and providers, intelligent, interoperable, and open workflow solutions will make all the difference.
Scientists have created synthetic mouse embryos with developed brains
The stem-cell-derived embryos could shed new light on the earliest stages of human pregnancy.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.