Publication:

On the User-centric Comparative Remote Evaluation of Interactive Video Search Systems

Date

Date

Date
2021
Journal Article
Published version

Citations

Citation copied

Rossetto, L., Gasser, R., Heller, S., Parian-Scherb, M., Sauter, L., Spiess, F., Schuldt, H., Peska, L., Souček, T., Kratochvil, M., Mejzlík, F., Veselý, P., & Lokoč, J. (2021). On the User-centric Comparative Remote Evaluation of Interactive Video Search Systems. IEEE MultiMedia, 28, 18–28. https://doi.org/10.1109/mmul.2021.3066779

Abstract

Abstract

Abstract

In the research of video retrieval systems, comparative assessments during dedicated retrieval competitions provide priceless insights into the performance of individual systems. The scope and depth of such evaluations are unfortunately hard to improve, due to the limitations by the set-up costs, logistics, and organization complexity of large events. We show that this easily impairs the statistical significance of the collected results, and the reproducibility of the competition outcomes. In this article, we present a methodology for

Additional indexing

Creators (Authors)

  • Rossetto, Luca
    affiliation.icon.alt
  • Gasser, Ralph
    affiliation.icon.alt
  • Heller, Silvan
    affiliation.icon.alt
  • Parian-Scherb, Mahnaz
    affiliation.icon.alt
  • Sauter, Loris
    affiliation.icon.alt
  • Spiess, Florian
    affiliation.icon.alt
  • Schuldt, Heiko
    affiliation.icon.alt
  • Peska, Ladislav
    affiliation.icon.alt
  • Souček, Tomáš
    affiliation.icon.alt
  • Kratochvil, Miroslav
    affiliation.icon.alt
  • Mejzlík, František
    affiliation.icon.alt
  • Veselý, Patrik
    affiliation.icon.alt
  • Lokoč, Jakub
    affiliation.icon.alt

Journal/Series Title

Journal/Series Title

Journal/Series Title

Volume

Volume

Volume
28

Number

Number

Number
4

Page range/Item number

Page range/Item number

Page range/Item number
18

Page end

Page end

Page end
28

Item Type

Item Type

Item Type
Journal Article

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Scope

Scope

Scope
Discipline-based scholarship (basic research)

Language

Language

Language
English

Publication date

Publication date

Publication date
2021

Date available

Date available

Date available
2022-01-05

ISSN or e-ISSN

ISSN or e-ISSN

ISSN or e-ISSN
1070-986X

OA Status

OA Status

OA Status
Green

Other Identification Number

Other Identification Number

Other Identification Number
merlin-id:20949

Official URL

Official URL

Official URL

Citations

Citation copied

Rossetto, L., Gasser, R., Heller, S., Parian-Scherb, M., Sauter, L., Spiess, F., Schuldt, H., Peska, L., Souček, T., Kratochvil, M., Mejzlík, F., Veselý, P., & Lokoč, J. (2021). On the User-centric Comparative Remote Evaluation of Interactive Video Search Systems. IEEE MultiMedia, 28, 18–28. https://doi.org/10.1109/mmul.2021.3066779

Green Open Access
Loading...
Thumbnail Image

Files

Files

Files
Files available to download:1

Files

Files

Files
Files available to download:1
Loading...
Thumbnail Image