Publication:

A Set of Recommendations for Assessing Human–Machine Parity in Language Translation

Date

Date

Date
2020
Journal Article
Published version

Citations

Citation copied

Läubli, S., Castilho, S., Neubig, G., Sennrich, R., Shen, Q., & Toral, A. (2020). A Set of Recommendations for Assessing Human–Machine Parity in Language Translation. Journal of Artificial Intelligence Research, 67, 653–672. https://doi.org/10.1613/jair.1.11371

Abstract

Abstract

Abstract

The quality of machine translation has increased remarkably over the past years, to the degree that it was found to be indistinguishable from professional human translation in a number of empirical investigations. We reassess Hassan et al.'s 2018 investigation into Chinese to English news translation, showing that the finding of human–machine parity was owed to weaknesses in the evaluation design—which is currently considered best practice in the field. We show that the professional human translations contained significantly fewer err

Metrics

Downloads

35 since deposited on 2020-06-23
Acq. date: 2025-11-14

Views

114 since deposited on 2020-06-23
Acq. date: 2025-11-14

Additional indexing

Creators (Authors)

  • Läubli, Samuel
  • Castilho, Sheila
  • Neubig, Graham
  • Shen, Qinlan
  • Toral, Antonio

Journal/Series Title

Journal/Series Title

Journal/Series Title

Volume

Volume

Volume
67

Page range/Item number

Page range/Item number

Page range/Item number
653

Page end

Page end

Page end
672

Item Type

Item Type

Item Type
Journal Article

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Keywords

Artificial Intelligence

Language

Language

Language
English

Publication date

Publication date

Publication date
2020-03-23

Date available

Date available

Date available
2020-06-23

Publisher

Publisher

Publisher

ISSN or e-ISSN

ISSN or e-ISSN

ISSN or e-ISSN
1076-9757

OA Status

OA Status

OA Status
Gold

Free Access at

Free Access at

Free Access at
DOI

Metrics

Downloads

35 since deposited on 2020-06-23
Acq. date: 2025-11-14

Views

114 since deposited on 2020-06-23
Acq. date: 2025-11-14

Citations

Citation copied

Läubli, S., Castilho, S., Neubig, G., Sennrich, R., Shen, Q., & Toral, A. (2020). A Set of Recommendations for Assessing Human–Machine Parity in Language Translation. Journal of Artificial Intelligence Research, 67, 653–672. https://doi.org/10.1613/jair.1.11371

Gold Open Access
Loading...
Thumbnail Image

Files

Files

Files
Files available to download:1

Files

Files

Files
Files available to download:1
Loading...
Thumbnail Image