Algorithms Allow MAVs to Avoid Obstacles with Single Camera and Neuromorphic Hardware

Clever programming enables new outdoor capabilities for micro air vehicles

2 min read
Algorithms Allow MAVs to Avoid Obstacles with Single Camera and Neuromorphic Hardware

Yesterday, we posted about some dirt cheap micro air vehicles on Kickstarter. Cheap hardware is great, but to make it do cool stuff, you usually need expensive (or at least, very clever) software. Researchers at Cornell have come up with a way to enable robotic aircraft to navigate around outdoor obstacles using just a single camera and hardware that mimics neuron architecture.

So, why is perceiving obstacles extremely important for aerial robots, and why are current methods based on stereo vision fundamentally limited? Here's what the researchers have to say:

Perceiving obstacles is extremely important for an aerial robot in order to avoid collisions. Methods based on stereo vision are fundamentally limited by the finite baseline between the stereo pairs, and fail in textureless regions and in presence of specular reflections. Active range-finding devices are either designed for indoor low-light environments (e.g., the Kinect), or are too heavy for aerial applications. More importantly, they demand more onboard power, which is at a premium for aerial vehicles.

Nicely put. This is especially relevant for small and cheap robots, because all you need is a single camera, minimal processing power, and even more minimal battery power. 

The new algorithm works by taking a single still frame from a camera stream and classifying the image into areas that are safe for the robot to pass through, and areas that aren't. To do this quickly and efficiently, the researchers are running their algorithm on a neuromorphic hardware platform based on the collective firing of a network of artificial neurons. Obstacles are separated out from backgrounds using a series of taught visual cues (like the fact that straight lines appear to converge at a distance, or the size of familiar objects), and he final platform will be able to process several frames per second using less than one watt of power. The system works quite well in practice: in 53 autonomous flights in obstacle-rich environments, the robot succeeded in reaching its objective without crashing into anything or killing anyone, with the final two flights being messed up by gusts of wind (they're working on compensating for that). Here's some video:

It works indoors on an AR Drone, too, as shown in some earlier research:

And here's some much earlier research doing 3D obstacle avoidance from monocular images on a robot car, which looks like fun:

So what's next?

Saxena plans to improve the robot's ability to respond to environment variations such as winds, and enable it to detect and avoid moving objects, like real birds; for testing purposes, he suggests having people throw tennis balls at the flying vehicle.

Heck yeah! SIGN ME UP!

"Low-Power Parallel Algorithms for Single Image based Obstacle Avoidance in Aerial Robots," by Ian Lenz, Mevlana Gemici, and Ashutosh Saxena from Cornell University, was presented last month at IROS 2012 in Portugal.

[ Cornell MAV ] via [ Cornell ]

The Conversation (0)

The Bionic-Hand Arms Race

The prosthetics industry is too focused on high-tech limbs that are complicated, costly, and often impractical

12 min read
A photograph of a young woman with brown eyes and neck length hair dyed rose gold sits at a white table. In one hand she holds a carbon fiber robotic arm and hand. Her other arm ends near her elbow. Her short sleeve shirt has a pattern on it of illustrated hands.

The author, Britt Young, holding her Ottobock bebionic bionic arm.

Gabriela Hasbun. Makeup: Maria Nguyen for MAC cosmetics; Hair: Joan Laqui for Living Proof

In Jules Verne’s 1865 novel From the Earth to the Moon, members of the fictitious Baltimore Gun Club, all disabled Civil War veterans, restlessly search for a new enemy to conquer. They had spent the war innovating new, deadlier weaponry. By the war’s end, with “not quite one arm between four persons, and exactly two legs between six,” these self-taught amputee-weaponsmiths decide to repurpose their skills toward a new projectile: a rocket ship.

The story of the Baltimore Gun Club propelling themselves to the moon is about the extraordinary masculine power of the veteran, who doesn’t simply “overcome” his disability; he derives power and ambition from it. Their “crutches, wooden legs, artificial arms, steel hooks, caoutchouc [rubber] jaws, silver craniums [and] platinum noses” don’t play leading roles in their personalities—they are merely tools on their bodies. These piecemeal men are unlikely crusaders of invention with an even more unlikely mission. And yet who better to design the next great leap in technology than men remade by technology themselves?

Keep Reading ↓Show less