Header

UZH-Logo

Maintenance Infos

ESIM: an Open Event Camera Simulator


Rebecq, Henri; Gehrig, Daniel; Scaramuzza, Davide (2018). ESIM: an Open Event Camera Simulator. In: Conference on Robot Learning (CoRL), Zurich, 2018., Zurich, 1 October 2018 - 5 October 2018.

Abstract

Event cameras are revolutionary sensors that work radically differently from standard cameras. Instead of capturing intensity images at a fixed rate, event cameras measure changes of intensity asynchronously, in the form of a stream of events, which encode per-pixel brightness changes. In the last few years, their outstanding properties (asynchronous sensing, no motion blur, high dynamic range) have led to exciting vision applications, with very low-latency and high robustness. However, these sensors are still scarce and expensive to get, slowing down progress of the research community. To address these issues, there is a huge demand for cheap, high-quality synthetic, labeled event for algorithm prototyping, deep learning and algorithm benchmarking. The development of such a simulator, however, is not trivial since event cameras work fundamentally differently from framebased cameras. We present the first event camera simulator that can generate a large amount of reliable event data. The key component of our simulator is a theoretically sound, adaptive rendering scheme that only samples frames when necessary, through a tight coupling between the rendering engine and the event simulator. We release an open source implementation of our simulator.

Abstract

Event cameras are revolutionary sensors that work radically differently from standard cameras. Instead of capturing intensity images at a fixed rate, event cameras measure changes of intensity asynchronously, in the form of a stream of events, which encode per-pixel brightness changes. In the last few years, their outstanding properties (asynchronous sensing, no motion blur, high dynamic range) have led to exciting vision applications, with very low-latency and high robustness. However, these sensors are still scarce and expensive to get, slowing down progress of the research community. To address these issues, there is a huge demand for cheap, high-quality synthetic, labeled event for algorithm prototyping, deep learning and algorithm benchmarking. The development of such a simulator, however, is not trivial since event cameras work fundamentally differently from framebased cameras. We present the first event camera simulator that can generate a large amount of reliable event data. The key component of our simulator is a theoretically sound, adaptive rendering scheme that only samples frames when necessary, through a tight coupling between the rendering engine and the event simulator. We release an open source implementation of our simulator.

Statistics

Downloads

5 downloads since deposited on 29 Oct 2019
2 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Language:English
Event End Date:5 October 2018
Deposited On:29 Oct 2019 14:38
Last Modified:27 Nov 2020 07:32
Publisher:s.n.
OA Status:Green
Official URL:http://rpg.ifi.uzh.ch/docs/CORL18_Rebecq.pdf
Other Identification Number:merlin-id:18694

Download

Green Open Access

Download PDF  'ESIM: an Open Event Camera Simulator'.
Preview
Content: Published Version
Filetype: PDF
Size: 1MB