Navigation auf zora.uzh.ch

Search ZORA

ZORA (Zurich Open Repository and Archive)

A text and image analysis workflow using citizen science data to extract relevant social media records: Combining red kite observations from Flickr, eBird and iNaturalist

Hartmann, Maximilian C; Schott, Moritz; Dsouza, Alishiba; Metz, Yannick; Volpi, Michele; Purves, Ross S (2022). A text and image analysis workflow using citizen science data to extract relevant social media records: Combining red kite observations from Flickr, eBird and iNaturalist. Ecological Informatics, 71:101782.

Abstract

There is an urgent need to develop new methods to monitor the state of the environment. One potential approach is to use new data sources, such as User-Generated Content, to augment existing approaches. However, to date, studies typically focus on a single date source and modality. We take a new approach, using citizen science records recording sightings of red kites (Milvus milvus) to train and validate a Convolutional Neural Network (CNN) capable of identifying images containing red kites. This CNN is integrated in a sequential workflow which also uses an off-the-shelf bird classifier and text metadata to retrieve observations of red kites in the Chilterns, England. Our workflow reduces an initial set of more than 600,000 images to just 3065 candidate images. Manual inspection of these images shows that our approach has a precision of 0.658. A workflow using only text identifies 14% less images than that including image content analysis, and by combining image and text classifiers we achieve almost perfect precision of 0.992. Images retrieved from social media records complement those recorded by citizen scientists spatially and temporally, and our workflow is sufficiently generic that it can easily be transferred to other species.

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:07 Faculty of Science > Institute of Geography
Dewey Decimal Classification:910 Geography & travel
Scopus Subject Areas:Life Sciences > Ecology, Evolution, Behavior and Systematics
Physical Sciences > Ecology
Physical Sciences > Modeling and Simulation
Physical Sciences > Ecological Modeling
Physical Sciences > Computer Science Applications
Physical Sciences > Computational Theory and Mathematics
Physical Sciences > Applied Mathematics
Uncontrolled Keywords:Applied Mathematics, Computational Theory and Mathematics, Computer Science Applications, Ecological Modeling, Modeling and Simulation, Ecology, Ecology, Evolution, Behavior and Systematics
Language:English
Date:1 November 2022
Deposited On:11 Jan 2023 14:35
Last Modified:28 Oct 2024 02:41
Publisher:Elsevier
ISSN:1574-9541
OA Status:Hybrid
Publisher DOI:https://doi.org/10.1016/j.ecoinf.2022.101782
Download PDF  'A text and image analysis workflow using citizen science data to extract relevant social media records: Combining red kite observations from Flickr, eBird and iNaturalist'.
Preview
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution 4.0 International (CC BY 4.0)

Metadata Export

Statistics

Citations

Dimensions.ai Metrics
8 citations in Web of Science®
9 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

13 downloads since deposited on 11 Jan 2023
9 downloads since 12 months
Detailed statistics

Authors, Affiliations, Collaborations

Similar Publications