Header

UZH-Logo

Maintenance Infos

VIMO: Simultaneous Visual Inertial Model-Based Odometry and Force Estimation


Nisar, Barza; Foehn, Philipp; Falanga, Davide; Scaramuzza, Davide (2020). VIMO: Simultaneous Visual Inertial Model-Based Odometry and Force Estimation. IEEE Robotics and Automation Letters, 4(3):2785-2792.

Abstract

In recent years, many approaches to visual-inertial odometry (VIO) have become available. However, they neither exploit the robot's dynamics and known actuation inputs, nor differentiate between the desired motion due to actuation and the unwanted perturbation due to external force. For many robotic applications, it is often essential to sense the external force acting on the system due to, for example, interactions, contacts, and disturbances. Adding a motion constraint to an estimator leads to discrepancy between the model-predicted motion and the actual motion. Our approach exploits this discrepancy and resolves it by simultaneously estimating the motion and external force. We propose a relative motion constraint combining the robot's dynamics and the external force in a preintegrated residual, resulting in a tightly coupled, sliding-window estimator exploiting all correlations among all variables. We implement our visual inertial model-based odometry system into a state-of-the-art VIO approach and evaluate it against the original pipeline without motion constraints both on simulated and real-world data. The results show that our approach increases the accuracy of the estimator up to 29% as compared to the original VIO, and it provides external force estimates at no extra computational cost. To the best of our knowledge, this is the first approach that exploits model dynamics by jointly estimating motion and external force. Our implementation will be made available open-source.

Abstract

In recent years, many approaches to visual-inertial odometry (VIO) have become available. However, they neither exploit the robot's dynamics and known actuation inputs, nor differentiate between the desired motion due to actuation and the unwanted perturbation due to external force. For many robotic applications, it is often essential to sense the external force acting on the system due to, for example, interactions, contacts, and disturbances. Adding a motion constraint to an estimator leads to discrepancy between the model-predicted motion and the actual motion. Our approach exploits this discrepancy and resolves it by simultaneously estimating the motion and external force. We propose a relative motion constraint combining the robot's dynamics and the external force in a preintegrated residual, resulting in a tightly coupled, sliding-window estimator exploiting all correlations among all variables. We implement our visual inertial model-based odometry system into a state-of-the-art VIO approach and evaluate it against the original pipeline without motion constraints both on simulated and real-world data. The results show that our approach increases the accuracy of the estimator up to 29% as compared to the original VIO, and it provides external force estimates at no extra computational cost. To the best of our knowledge, this is the first approach that exploits model dynamics by jointly estimating motion and external force. Our implementation will be made available open-source.

Statistics

Citations

Dimensions.ai Metrics
1 citation in Web of Science®
4 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

6 downloads since deposited on 27 Jan 2021
6 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Control and Systems Engineering
Physical Sciences > Biomedical Engineering
Physical Sciences > Human-Computer Interaction
Physical Sciences > Mechanical Engineering
Physical Sciences > Computer Vision and Pattern Recognition
Physical Sciences > Computer Science Applications
Physical Sciences > Control and Optimization
Physical Sciences > Artificial Intelligence
Language:English
Date:2020
Deposited On:27 Jan 2021 07:37
Last Modified:28 Jan 2021 21:00
Publisher:Institute of Electrical and Electronics Engineers
ISSN:2377-3766
OA Status:Green
Publisher DOI:https://doi.org/10.1109/lra.2019.2918689
Other Identification Number:merlin-id:20296

Download

Green Open Access

Download PDF  'VIMO: Simultaneous Visual Inertial Model-Based Odometry and Force Estimation'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 3MB
View at publisher