Publication: Does Whisper Understand Swiss German? An Automatic, Qualitative, and Human Evaluation
Does Whisper Understand Swiss German? An Automatic, Qualitative, and Human Evaluation
Date
Date
Date
Citations
Dolev, E. L., Lutz, C. F., & Aepli, N. (2024). Does Whisper Understand Swiss German? An Automatic, Qualitative, and Human Evaluation. 28–40. https://doi.org/10.18653/v1/2024.vardial-1.3
Abstract
Abstract
Abstract
Whisper is a state-of-the-art automatic speech recognition (ASR) model (Radford et al., 2022). Although Swiss German dialects are allegedly not part of Whisper’s training data, preliminary experiments showed Whisper can transcribe Swiss German quite well, with the output being a speech translation into Standard German. To gain a better understanding of Whisper’s performance on Swiss German, we systematically evaluate it using automatic, qualitative, and human evaluation. We test its performance on three existing test sets: SwissDial (
Metrics
Downloads
Views
Additional indexing
Creators (Authors)
Event Title
Event Title
Event Title
Event Location
Event Location
Event Location
Event Country
Event Country
Event Country
Event Start Date
Event Start Date
Event Start Date
Event End Date
Event End Date
Event End Date
Page range/Item number
Page range/Item number
Page range/Item number
Page end
Page end
Page end
Item Type
Item Type
Item Type
In collections
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Language
Language
Language
Date available
Date available
Date available
OA Status
OA Status
OA Status
Free Access at
Free Access at
Free Access at
Publisher DOI
Metrics
Downloads
Views
Citations
Dolev, E. L., Lutz, C. F., & Aepli, N. (2024). Does Whisper Understand Swiss German? An Automatic, Qualitative, and Human Evaluation. 28–40. https://doi.org/10.18653/v1/2024.vardial-1.3
