Update: this article previously identified the firm Metaio as ‘Junaio.’ Turns out Junaio is the app, Metaio its maker.
Most “real world” augmented reality is primitive, at best. Applications like Layar and “rich storytelling” new media startup TagWhat produce software that can overlay, on your smartphone’s camera view, interesting information about places and objects around you, but that’s about it. Their interfaces are relatively static, relying on “tags” or pop-ups to provide information, rather than truly integrating their augmented reality with the real thing.
Not so Metaio. In a video just launched to promote upcoming AR conference insideAR, Metaio is showing off a demonstration technology that overlays augmented reality on top of real reality – with a fidelity of up to 40,000 polygons at once.
The results might look like they were rendered on a Nintendo GameCube, but keep in mind that Junaio is using a mere phone to: analyze a scene, interpret the distance to objects and the orientation of the phone in 6 dimensions, and project images on top of what it sees – all in real time.
The problem that has plagued real-world augmented reality, the kind that, once unleashed, will probably be the most amazing thing anyone has seen since the PC revolution itself, is that it’s really hard to know exactly what the camera that’s to overlay reality with a convincingly augmented simulacrum of it is pointing at.
GPS and similar location services aren’t accurate enough to pinpoint your location, and the orientation sensors in most phones barely know when you’ve rotated the device, much less what its exact pitch and yaw are.
But if a device, like the Tegra-2 and Android-powered Samsung smartphone used in this demo, has stored in it a complete three-dimensional representation of a given physical environment, it can simply analyze the scene visually and map augmented reality on top of it using that information. In this way, GPS and orientation sensors are used solely to narrow down the number of different scenes the device has to search in its map of a given city.
This, in short, is what real augmented reality looks like. And when it arrives – in conjunction with displays that fit into eyeglasses, which need to improve significantly before they can be used for this application – it will transform our lives as much as PCs and smartphones have, if not more.
Meta has built a massive new language AI—and it’s giving it away for free
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
The gene-edited pig heart given to a dying patient was infected with a pig virus
The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.
Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging
The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.
Yann LeCun has a bold new vision for the future of AI
One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.