Fishel, Mark; Sennrich, Rico; Popović, Maja; Bojar, Ondřej (2012). TerrorCat: a translation error categorization-based MT quality metric. In: NAACL 2012 7th workshop on Statistical Machine Translation, Montreal, Canada, 7 June 2012 - 8 June 2012, 64-70.
We present TerrorCat, a submission to the WMT’12 metrics shared task. TerrorCat uses frequencies of automatically obtained translation error categories as base for pairwise comparison of translation hypotheses, which is in turn used to generate a score for every translation. The metric shows high overall correlation with human judgements on the system level and more modest results on the level of individual sentences.
We present TerrorCat, a submission to the WMT’12 metrics shared task. TerrorCat uses frequencies of automatically obtained translation error categories as base for pairwise comparison of translation hypotheses, which is in turn used to generate a score for every translation. The metric shows high overall correlation with human judgements on the system level and more modest results on the level of individual sentences.
| Item Type: | Conference or Workshop Item (Paper), refereed, original work |
|---|---|
| Communities & Collections: | 06 Faculty of Arts > Institute of Computational Linguistics |
| Dewey Decimal Classification: | 000 Computer science, knowledge & systems
410 Linguistics |
| Scopus Subject Areas: | Social Sciences & Humanities > Language and Linguistics
Physical Sciences > Computer Science Applications Social Sciences & Humanities > Linguistics and Language |
| Language: | English |
| Event End Date: | 8 June 2012 |
| Deposited On: | 13 Jul 2012 07:14 |
| Last Modified: | 30 Jul 2020 05:24 |
| Publisher: | Association for Computational Linguistics |
| ISBN: | 978-1-937284-20-6 |
| OA Status: | Green |
| Official URL: | http://www.aclweb.org/anthology-new/W/W12/W12-3105.pdf |
Fishel, Mark