Navigation auf zora.uzh.ch

Search ZORA

ZORA (Zurich Open Repository and Archive)

Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS

Lokoč, Jakub; Andreadis, Stelios; Bailer, Werner; Duane, Aaron; Gurrin, Cathal; Ma, Zhixin; Messina, Nicola; Nguyen, Thao-Nhu; Peška, Ladislav; Rossetto, Luca; Sauter, Loris; Schall, Konstantin; Schoeffmann, Klaus; Khan, Omar Shahbaz; Spiess, Florian; Vadicamo, Lucia; Vrochidis, Stefanos (2023). Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS. Multimedia Systems, 29(6):3481-3504.

Abstract

This paper presents findings of the eleventh Video Browser Showdown competition, where sixteen teams competed in known-item and ad-hoc search tasks. Many of the teams utilized state-of-the-art video retrieval approaches that demonstrated high effectiveness in challenging search scenarios. In this paper, a broad survey of all utilized approaches is presented in connection with an analysis of the performance of participating teams. Specifically, both high-level performance indicators are presented with overall statistics as well as in-depth analysis of the performance of selected tools implementing result set logging. The analysis reveals evidence that the CLIP model represents a versatile tool for cross-modal video retrieval when combined with interactive search capabilities. Furthermore, the analysis investigates the effect of different users and text query properties on the performance in search tasks. Last but not least, lessons learned from search task preparation are presented, and a new direction for ad-hoc search based tasks at Video Browser Showdown is introduced.

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Software
Physical Sciences > Information Systems
Physical Sciences > Media Technology
Physical Sciences > Hardware and Architecture
Physical Sciences > Computer Networks and Communications
Scope:Discipline-based scholarship (basic research)
Language:English
Date:1 December 2023
Deposited On:19 Sep 2023 12:24
Last Modified:26 Feb 2025 02:41
Publisher:Springer
ISSN:0942-4962
OA Status:Green
Publisher DOI:https://doi.org/10.1007/s00530-023-01143-5
Other Identification Number:merlin-id:23967
Download PDF  'Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS'.
Preview
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution 4.0 International (CC BY 4.0)

Metadata Export

Statistics

Citations

Dimensions.ai Metrics
14 citations in Web of Science®
22 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

139 downloads since deposited on 19 Sep 2023
98 downloads since 12 months
Detailed statistics

Authors, Affiliations, Collaborations

Similar Publications