We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

A View from Kristina Grifantini

How to Make UAVs Fully Autonomous

A smarter vision system could help robotic aircraft detect airborne obstacles.

  • July 15, 2009

Unmanned aerial vehicles (UAVs for short) have proved their usefulness as military tools. But most UAVs aren’t truly autonomous: they’re operated remotely by a human controller from the ground.

To become truly autonomous, UAVs will need to get far better at sensing obstacles and reacting in time to avoid a collision. This will be especially important if they are ever to operate in commercial space.

Sanjiv Singh, a professor and researcher at Carnegie Mellon University, has developed a new system to help UAVs do just this.

Since most UAVs are fairly small and lightweight, they can’t carry the heavy, power-hungry sensors that larger aircraft can use to detect other planes. So Singh and student Debadeepta Dey developed an algorithm that uses an ordinary camera and several software programs to detect potential obstacles.

Their sense-and-avoid system functions across a wide field of view (from up to three miles away) and in a wide range of weather conditions. It does this by finding contrasting points in a video image (such as a dark spot against white clouds) and tracking them to determine movement.

In the video below, the system outlines moving objects in red, such as a plane (distinguished by the green box). It also identifies the characteristic movement of dust–rather than a flying obstacle–on the lens (blue).

Click here to see a bigger version of the video.

“We have proved that sense and avoid for unmanned aerial vehicles using passive sensors is a very real possibility, and with some more time and maturity, this will evolve into a deployable standard technology,” says Dey, who presented details of the system at the International Conference on Field and Service Robotics yesterday.

The sense-and-avoid system can pick out a small, two-seater plane from five miles away, says Dey. So far, he and Singh have tested it from the ground using real aircraft. Currently, it produces some false positives (identifying bugs as planes, for example), but the researchers plan to couple a lidar sensor to the camera to improve it. By bouncing a laser beam off of the obstacle, the lidar will measure its distance to help determine whether it’s really a plane on a collision course or just an insect hitching a ride.

Want to go ad free? No ad blockers needed.

Become an Insider
Already an Insider? Log in.
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.