Skip to Content

Apple Is Getting Real About Augmented Reality

The company reportedly has plans to bake AR technology into its iPhone and a new pair of smart glasses—but it needs to tread carefully.
Google Glass failed to impress.

Apple is reportedly planning to bring augmented reality to the masses.

According to Bloomberg, Apple’s CEO, Tim Cook, plans for the company to add AR features to the iPhone and, later, launch a pair of smart glasses that allow users to augment their reality. The hope: to make the technology a widely available and compelling consumer product before other companies manage to, in order to provide a much-needed new reason to stick with Apple.

Apple will be playing a high-stakes game, betting that we’ll all want to improve our digital lives with augmented reality. But while software for a phone is one thing, the company will have to work hard to avoid repeating past mistakes in the arena of wearable devices like the Apple Watch and Google Glass. 

This is by no means the first time we’ve heard reports of Apple’s AR ambitions. Last summer Cook said it was a technology that Apple was “doing a lot of things on behind [the] curtain.” And late last year reports surfaced that Apple was interested in building AR spectacles.

The latest report, though, suggests that Apple has been doubling down on its efforts to advance the technology. It has amassed a large team of software developers and hardware engineers with experience working on the Oculus Rift and Microsoft HoloLens VR headsets, as well as staff with backgrounds in visual effects and computer games.

Sources tell Bloomberg that progress is being made, most notably with software for the iPhone. It describes, for instance, SnapChat-esque real-time video effects, as well as new ways to manipulate photographs. It’s likely that some of these features are similar to those already being developed by Baidu, whose software makes use of machine learning to add detail to the real world.

The new Apple software might not necessarily make it onto the iPhone as is. But its development certainly suggests that AR features may soon find their way onto the handsets.

The glasses are “further down the road,” according to Bloomberg. Rightly so. That’s a much larger challenge, with far more to go wrong. First, there’s the hardware to nail: if Apple doesn’t want a Google Glass-style failure on its hands, it’ll need to create something that’s both polished and (relatively) affordable. While Bloomberg says the device would lean on the processing power of an iPhone for the most part, there are still plenty of tricky design choices to be made, not least relating to optics and batteries.

Second, as we’ve argued before, Apple runs the risk of repeating its Watch mistake and building a new piece of hardware without a clearly defined use. The company will perhaps be hoping that its legion of experts can create, not just a compelling hardware offer, but also the kinds of software that will make the device fun and useful—maybe even something people soon find they can’t live without.

But those are ambitious goals for an unproven technology. It will be interesting to see how Apple’s AR turns out in reality—and whether or not its gamble pays off.

(Read more: Bloomberg, “If Apple Builds Smart Glasses, They’d Better Be Spectacular,” “Baidu Is Bringing Intelligent AR to the Masses,” “How to Read Between the Lines of Tim Cook’s Epic Interview”)

Keep Reading

Most Popular

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

AGI is just chatter for now concept
AGI is just chatter for now concept

The hype around DeepMind’s new AI model misses what’s actually cool about it

Some worry that the chatter about these tools is doing the whole field a disservice.

Hoan Ton-That, CEO of Clearview AI
Hoan Ton-That, CEO of Clearview AI

The walls are closing in on Clearview AI

The controversial face recognition company was just fined $10 million for scraping UK faces from the web. That might not be the end of it.

spaceman on a horse generated by DALL-E
spaceman on a horse generated by DALL-E

This horse-riding astronaut is a milestone in AI’s journey to make sense of the world

OpenAI’s latest picture-making AI is amazing—but raises questions about what we mean by intelligence.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.