Header

UZH-Logo

Maintenance Infos

Probing the lexicon in evaluating commercial MT systems


Volk, M (1997). Probing the lexicon in evaluating commercial MT systems. In: Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics. Madrid: European Chapter Meeting of the ACL, 112-119.

Abstract

In the past the evaluation of machine translation systems has focused on single system evaluations because there were only few systems available. But now there are several commercial systems for the same language pair. This requires new methods of comparative evaluation. In the paper we propose a black-box method for comparing the lexical coverage of MT systems. The method is based on lists of words from different frequency classes. It is shown how these word lists can be compiled and used for testing. We also present the results of using our method on 6 MT systems that translate between English and German.

Abstract

In the past the evaluation of machine translation systems has focused on single system evaluations because there were only few systems available. But now there are several commercial systems for the same language pair. This requires new methods of comparative evaluation. In the paper we propose a black-box method for comparing the lexical coverage of MT systems. The method is based on lists of words from different frequency classes. It is shown how these word lists can be compiled and used for testing. We also present the results of using our method on 6 MT systems that translate between English and German.

Statistics

Altmetrics

Downloads

2 downloads since deposited on 20 Jun 2009
0 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Book Section, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Computational Linguistics
Dewey Decimal Classification:000 Computer science, knowledge & systems
410 Linguistics
Language:English
Date:1997
Deposited On:20 Jun 2009 10:14
Last Modified:05 Apr 2016 13:15
Publisher:European Chapter Meeting of the ACL
Additional Information:ACL/EACL Joint Conference, Madrid, Spain July 7-12 1997
Publisher DOI:https://doi.org/10.3115/979617.979632

Download