Header

UZH-Logo

Maintenance Infos

Considerations for meaningful sign language machine translation based on glosses


Müller, Mathias; Jiang, Zifan; Moryossef, Amit; Rios, Annette; Ebling, Sarah (2022). Considerations for meaningful sign language machine translation based on glosses. ArXiv.org 15464, Cornell University.

Abstract

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In this paper, we review recent works on neural gloss translation. We find that limitations of glosses in general and limitations of specific datasets are not discussed in a transparent manner and that there is no common standard for evaluation.
To address these issues, we put forward concrete recommendations for future research on gloss translation. Our suggestions advocate awareness of the inherent limitations of gloss-based approaches, realistic datasets, stronger baselines and convincing evaluation.

Abstract

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In this paper, we review recent works on neural gloss translation. We find that limitations of glosses in general and limitations of specific datasets are not discussed in a transparent manner and that there is no common standard for evaluation.
To address these issues, we put forward concrete recommendations for future research on gloss translation. Our suggestions advocate awareness of the inherent limitations of gloss-based approaches, realistic datasets, stronger baselines and convincing evaluation.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

5 downloads since deposited on 13 Feb 2023
5 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Working Paper
Communities & Collections:06 Faculty of Arts > Institute of Computational Linguistics
Dewey Decimal Classification:000 Computer science, knowledge & systems
410 Linguistics
Uncontrolled Keywords:Computation and Language (cs.CL), Artificial Intelligence (cs.AI), FOS: Computer and information sciences, FOS: Computer and information sciences
Language:English
Date:2022
Deposited On:13 Feb 2023 16:31
Last Modified:22 Sep 2023 13:09
Publisher:arXiv
Series Name:ArXiv.org
ISSN:2331-8422
OA Status:Green
Publisher DOI:https://doi.org/10.48550/ARXIV.2211.15464
Official URL:https://arxiv.org/abs/2211.15464
  • Content: Published Version
  • Language: English