Header

UZH-Logo

Maintenance Infos

Dynamic obstacle avoidance for quadrotors with event cameras


Falanga, Davide; Kleber, Kevin; Scaramuzza, Davide (2020). Dynamic obstacle avoidance for quadrotors with event cameras. Science Robotics, 5(40):eaaz9712.

Abstract

Today’s autonomous drones have reaction times of tens of milliseconds, which is not enough for navigating fast in complex dynamic environments. To safely avoid fast moving objects, drones need low-latency sensors and algorithms. We departed from state-of-the-art approaches by using event cameras, which are bioinspired sensors with reaction times of microseconds. Our approach exploits the temporal information contained in the event stream to distinguish between static and dynamic objects and leverages a fast strategy to generate the motor commands necessary to avoid the approaching obstacles. Standard vision algorithms cannot be applied to event cameras because the output of these sensors is not images but a stream of asynchronous events that encode per-pixel intensity changes. Our resulting algorithm has an overall latency of only 3.5 milliseconds, which is sufficient for reliable detection and avoidance of fast-moving obstacles. We demonstrate the effectiveness of our approach on an autonomous quadrotor using only onboard sensing and computation. Our drone was capable of avoiding multiple obstacles of different sizes and shapes, at relative speeds up to 10 meters/second, both indoors and outdoors.

Abstract

Today’s autonomous drones have reaction times of tens of milliseconds, which is not enough for navigating fast in complex dynamic environments. To safely avoid fast moving objects, drones need low-latency sensors and algorithms. We departed from state-of-the-art approaches by using event cameras, which are bioinspired sensors with reaction times of microseconds. Our approach exploits the temporal information contained in the event stream to distinguish between static and dynamic objects and leverages a fast strategy to generate the motor commands necessary to avoid the approaching obstacles. Standard vision algorithms cannot be applied to event cameras because the output of these sensors is not images but a stream of asynchronous events that encode per-pixel intensity changes. Our resulting algorithm has an overall latency of only 3.5 milliseconds, which is sufficient for reliable detection and avoidance of fast-moving obstacles. We demonstrate the effectiveness of our approach on an autonomous quadrotor using only onboard sensing and computation. Our drone was capable of avoiding multiple obstacles of different sizes and shapes, at relative speeds up to 10 meters/second, both indoors and outdoors.

Statistics

Citations

Dimensions.ai Metrics
3 citations in Web of Science®
6 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

40 downloads since deposited on 27 Jan 2021
40 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Mechanical Engineering
Physical Sciences > Computer Science Applications
Physical Sciences > Control and Optimization
Physical Sciences > Artificial Intelligence
Language:English
Date:2020
Deposited On:27 Jan 2021 08:22
Last Modified:28 Jan 2021 21:00
Publisher:American Association for the Advancement of Science
ISSN:2470-9476
OA Status:Green
Publisher DOI:https://doi.org/10.1126/scirobotics.aaz9712
Other Identification Number:merlin-id:20313

Download

Green Open Access

Download PDF  'Dynamic obstacle avoidance for quadrotors with event cameras'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 7MB
View at publisher