Header

UZH-Logo

Maintenance Infos

SIPEC: the deep-learning Swiss knife for behavioral data analysis


Marks, Markus; Qiuhan, Jin; Sturman, Oliver; von Ziegler, Lukas; Kollmorgen, Sepp; von der Behrens, Wolfger; Mante, Valerio; Bohacek, Johannes; Yanik, Mehmet Fatih (2020). SIPEC: the deep-learning Swiss knife for behavioral data analysis. bioRxiv 355115, University of Zurich.

Abstract

Analysing the behavior of individuals or groups of animals in complex environments is an important, yet difficult computer vision task. Here we present a novel deep learning architecture for classifying animal behavior and demonstrate how this end-to-end approach can significantly outperform pose estimation-based approaches, whilst requiring no intervention after minimal training. Our behavioral classifier is embedded in a first-of-its-kind pipeline (SIPEC) which performs segmentation, identification, pose-estimation and classification of behavior all automatically. SIPEC successfully recognizes multiple behaviors of freely moving mice as well as socially interacting nonhuman primates in 3D, using data only from simple mono-vision cameras in home-cage setups.

Abstract

Analysing the behavior of individuals or groups of animals in complex environments is an important, yet difficult computer vision task. Here we present a novel deep learning architecture for classifying animal behavior and demonstrate how this end-to-end approach can significantly outperform pose estimation-based approaches, whilst requiring no intervention after minimal training. Our behavioral classifier is embedded in a first-of-its-kind pipeline (SIPEC) which performs segmentation, identification, pose-estimation and classification of behavior all automatically. SIPEC successfully recognizes multiple behaviors of freely moving mice as well as socially interacting nonhuman primates in 3D, using data only from simple mono-vision cameras in home-cage setups.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

3 downloads since deposited on 16 Feb 2021
3 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Working Paper
Communities & Collections:07 Faculty of Science > Institute of Neuroinformatics
Dewey Decimal Classification:570 Life sciences; biology
Language:English
Date:2020
Deposited On:16 Feb 2021 07:19
Last Modified:16 Feb 2021 07:19
Series Name:bioRxiv
ISSN:2164-7844
OA Status:Green
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1101/2020.10.26.355115

Download

Green Open Access

Download PDF  'SIPEC: the deep-learning Swiss knife for behavioral data analysis'.
Preview
Content: Published Version
Filetype: PDF
Size: 25MB
View at publisher
Licence: Creative Commons: Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)