Skip to Content

Apple Just Gave a Private Demo of Its Latest Self-Driving Tech

Apple’s AI team gave AI researchers a sneak peek at several driving projects.
December 10, 2017
Apple recently published details of system called VolexNet, which is capable of recognizing pedestrians and vehicles from a 3-D data.

At a private workshop held this week for AI researchers, Apple researchers gave a rare glimpse of some machine-learning technology they’re building for self-driving cars.

Speaking to an exclusive audience of researchers in the field, Ruslan Salakhutdinov, Apple’s director of AI, discussed several projects apparently related to automated driving.

The technical talks were given Friday during the Neural Information Processing Systems conference, the largest AI-focused academic event of the year, which was held in Long Beach, California. The event attracted thousands of researchers, including many from rival tech companies. The talks were designed to showcase Apple’s technical prowess and to woo potential recruits.

Salakhutdinov, who joined Apple in 2016 but still holds a post as a professor at Carnegie Mellon University, showed off a project previously disclosed in a paper posted online by Apple last month. This project trained a system to recognize pedestrians and other vehicles from 3-D point cloud information.

Other projects not previously revealed included a method for classifying different objects on the road using cameras placed on top of a vehicle, and a method of using camera footage to track its position very precisely. This technique, known as visual SLAM (simultaneous location and mapping), could be used for autonomous driving but also for augmented and virtual reality.

Apple has long been rumored to be working on automated driving. While the company hasn’t publicly acknowledged such a project, some details have leaked out. For example, the company has applied for a permit to test automated vehicles in California. Tim Cook, Apple’s CEO, has also all but confirmed the rumor, telling Bloomberg that the company is “focused on autonomous systems,” which he also described as “the mother of all AI projects.”

Carlos Guestrin, Apple’s director of machine learning and a professor at the University of Washington in Seattle, spoke after Salakhutdinov about several of the company’s large-scale machine-learning efforts, including that behind the face recognition system developed for the iPhone X.

Guestrin reassured researchers that working at Apple didn’t not mean you couldn’t publish research. He also announced that Apple was open-sourcing a tool called Turi Create that is designed to make machine learning easier. Guestrin joined Apple after his startup, Turi, was acquired last year.

Apple develops a range of machine-learning technologies for its products, but the company still discloses only a tiny amount of its research compared with competitors like Google and Facebook. Apple usually avoids talking  about its research as a way to avoid tipping competitors off about future products.

It says much about the current battle between tech companies for machine-learning talent that Apple has abandoned this secretive culture and begun publishing machine-learning research and discussing some projects more openly. The company has even begun its own Machine Learning Journal, where it has published details of several AI-related projects.

Friday’s event attracted researchers from big universities and tech firms, including Google and Facebook. Nvidia, Uber, Microsoft, Facebook, and others threw lavish parties during the conference that were packed with researchers. Not to be outdone, Apple put on its own mixer several hours after the technical talk.

Keep Reading

Most Popular

Rendering of Waterfront Toronto project
Rendering of Waterfront Toronto project

Toronto wants to kill the smart city forever

The city wants to get right what Sidewalk Labs got so wrong.

windows desktop with anime image from Wallpaper Engine
windows desktop with anime image from Wallpaper Engine

Chinese gamers are using a Steam wallpaper app to get porn past the censors

Wallpaper Engine has become a haven for ingenious Chinese users who use it to smuggle adult content as desktop wallpaper. But how long can it last?

Yann LeCun
Yann LeCun

Yann LeCun has a bold new vision for the future of AI

One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.

Linux hack concept
Linux hack concept

The US military wants to understand the most important software on Earth

Open-source code runs on every computer on the planet—and keeps America’s critical infrastructure going. DARPA is worried about how well it can be trusted

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.