Publication:

Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models

Date

Date

Date
2021
Conference or Workshop Item
Published version

Citations

Citation copied

Li, J., Ataman, D., & Sennrich, R. (2021). Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models. 8556–8562. https://aclanthology.org/2021.emnlp-main.673

Abstract

Abstract

Abstract

Multimodal machine translation (MMT) systems have been shown to outperform their text-only neural machine translation (NMT) counterparts when visual context is available. However, recent studies have also shown that the performance of MMT models is only marginally impacted when the associated image is replaced with an unrelated image or noise, which suggests that the visual context might not be exploited by the model at all. We hypothesize that this might be caused by the nature of the commonly used evaluation benchmark, also known as

Additional indexing

Creators (Authors)

Event Title

Event Title

Event Title
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

Event Location

Event Location

Event Location
Online and Punta Cana

Event Country

Event Country

Event Country
Dominican Republic

Event Start Date

Event Start Date

Event Start Date
2021-11-07

Event End Date

Event End Date

Event End Date
2021-11-11

Publisher

Publisher

Publisher
ACL Anthology

Page range/Item number

Page range/Item number

Page range/Item number
8556

Page end

Page end

Page end
8562

Item Type

Item Type

Item Type
Conference or Workshop Item

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Language

Language

Language
English

Date available

Date available

Date available
2021-11-08

OA Status

OA Status

OA Status
Green

Free Access at

Free Access at

Free Access at
Official URL

Official URL

Official URL

Official URL

Citations

Citation copied

Li, J., Ataman, D., & Sennrich, R. (2021). Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models. 8556–8562. https://aclanthology.org/2021.emnlp-main.673

Green Open Access
Loading...
Thumbnail Image

Files

Files

Files
Files available to download:1

Files

Files

Files
Files available to download:1
Loading...
Thumbnail Image