Publication: Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages
Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages
Date
Date
Date
Citations
Pelloni, O., Shaitarova, A., & Samardžić, T. (2022, December 11). Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages. 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi. https://aclanthology.org/2022.emnlp-main.503.pdf
Abstract
Abstract
Abstract
Pre-trained multilingual models, such as mBERT, XLM-R and mT5, are used to improve the performance on various tasks in low-resource languages via cross-lingual transfer. In this framework, English is usually seen as the most natural choice for a transfer language (for fine-tuning or continued training of a multilingual pre-trained model), but it has been revealed recently that this is often not the best choice. The success of cross-lingual transfer seems to depend on some properties of languages, which are currently hard to explain. S
Metrics
Downloads
Views
Additional indexing
Creators (Authors)
Event Title
Event Title
Event Title
Event Location
Event Location
Event Location
Event Country
Event Country
Event Country
Event Start Date
Event Start Date
Event Start Date
Event End Date
Event End Date
Event End Date
Item Type
Item Type
Item Type
In collections
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Language
Language
Language
Date available
Date available
Date available
OA Status
OA Status
OA Status
Free Access at
Free Access at
Free Access at
Metrics
Downloads
Views
Citations
Pelloni, O., Shaitarova, A., & Samardžić, T. (2022, December 11). Subword Evenness (SuE) as a Predictor of Cross-lingual Transfer to Low-resource Languages. 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi. https://aclanthology.org/2022.emnlp-main.503.pdf
