On a recent bike ride through the woods near Menlo Park in California, Adam Bry, CEO of a company called Skydio, and his coworkers were joined by a small, nimble drone. As they rode along a dirt track, the drone followed close by, weaving expertly around tree trunks and branches in a series of deft maneuvers.
What’s amazing is that the drone wasn’t piloted by a person, but by Skydio’s technology. It lets an unmanned aerial vehicle (UAV) use several video cameras not only to avoid obstacles but also to navigate at high speeds through busy airspace as expertly as a human pilot.
That kind of autonomy could transform the consumer drone market by making aircraft much harder to crash. It could also make it easier for drones to do tasks autonomously even in busy settings. Skydio, founded last year, has so far raised $25 million in funding in a round led by Andreessen Horowitz and Accel Partners. Bry declined to say when Skydio’s first product would appear or how much it might cost.
“The motivation for the company is giving the thing the agility, attention, and awareness that an expert pilot has,” Bry says. “That’s an extremely challenging thing to do. There’s a lot of context that we bring to bear when we’re flying.”
Flying autonomously is more difficult than driving because the hardware needs to be compact and light, and because even the slightest miscalculation can result in disaster. “There’s essentially no margin for error,” Bry says. “You can’t stop and turn everything off, because if you do that, you crash. In fact, if anything goes wrong on any part of the system, the most likely outcome is that you crash.”
The drone developed by Skydio uses a camera together with vision-processing software that lets the aircraft determine where it is in space, and to identify and avoid obstacles. Bry developed the algorithms that enable this with Abraham Bachrach, who is now Skydio’s chief technology officer, while both were students at MIT. The techniques they came up with made it possible for drones to navigate through unfamiliar indoor spaces safely and for a plane with a two-foot wingspan to weave its way around a busy garage without crashing.
Nick Roy, a professor of robotics who advised Bry and Bachrach at MIT, expects aerial vehicles to become more common for surveillance and inspection tasks. But he adds that reliable autopilot, which Skydio is a significant step toward, is a key missing piece of that picture. “If we want these things to provide all the services people are hoping for in terms of infrastructure inspection, precision agriculture, filming in various ways, that’s going to require autonomy,” Roy says. “It’s going to be really important.”
Today, most drones are either controlled remotely, or are only capable of basic automation. A few drones are starting to come with more advanced obstacle identification and avoidance, but none are as sophisticated as Skydio’s prototype. The latest drone from Chinese company DJI, the Phantom 4, uses several cameras to spot impediments, and it will override the controller’s actions if it seems likely to run into something. The Phantom 4 can also track moving objects using its vision system. But it doesn’t perform the kind of mapping and navigation that Skydio’s drone does.
“Navigation is absolutely crucial, especially in flight” says Lora Weiss, chief scientist of the Georgia Institute of Technology’s Institute for Intelligent Machines, a nonprofit that contracts with the U.S. Department of Defense on various projects involving automated vehicles.
Weiss is working on projects involving UAVs with even more advanced autonomy. Some of the systems she is developing are, for example, able to deviate from a given course if they spot something of interest, and then call for help from other aircraft with surveillance of the new target. “The nimbleness in navigation is really going to be crucial for where these things are going,” Weiss says.
How AI is reinventing what computers are
Three key ways artificial intelligence is changing what it means to compute.
These weird virtual creatures evolve their bodies to solve problems
They show how intelligence and body plans are closely linked—and could unlock AI for robots.
We reviewed three at-home covid tests. The results were mixed.
Over-the-counter coronavirus tests are finally available in the US. Some are more accurate and easier to use than others.
A horrifying new AI app swaps women into porn videos with a click
Deepfake researchers have long feared the day this would arrive.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.