Header

UZH-Logo

Maintenance Infos

Cleaning the Europarl Corpus for Linguistic Applications


Graën, Johannes; Batinić, Dolores; Volk, Martin (2014). Cleaning the Europarl Corpus for Linguistic Applications. In: Konvens 2014, Hildesheim, 8 October 2014 - 10 October 2014, Stiftung Universität Hildesheim.

Abstract

We discovered several recurring errors in the current version of the Europarl Corpus originating both from the web site of the European Parliament and the corpus compilation based thereon. The most frequent error was incompletely extracted metadata leaving non-textual fragments within the textual parts of the corpus files. This is, on average, the case for every second speaker change.
We not only cleaned the Europarl Corpus by correcting several kinds of errors, but also aligned the speakers’ contributions of all available languages and compiled everything into a new XML-structured corpus. This facilitates a more sophisticated selection of data, e.g. querying the corpus for speeches by speakers of a particular political group or in particular language combinations.

Abstract

We discovered several recurring errors in the current version of the Europarl Corpus originating both from the web site of the European Parliament and the corpus compilation based thereon. The most frequent error was incompletely extracted metadata leaving non-textual fragments within the textual parts of the corpus files. This is, on average, the case for every second speaker change.
We not only cleaned the Europarl Corpus by correcting several kinds of errors, but also aligned the speakers’ contributions of all available languages and compiled everything into a new XML-structured corpus. This facilitates a more sophisticated selection of data, e.g. querying the corpus for speeches by speakers of a particular political group or in particular language combinations.

Statistics

Downloads

227 downloads since deposited on 30 Sep 2014
15 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Computational Linguistics
08 Research Priority Programs > Language and Space
Dewey Decimal Classification:000 Computer science, knowledge & systems
410 Linguistics
Uncontrolled Keywords:Europarl Corpus cleaning linguistic application fragments metadata quality query
Language:English
Event End Date:10 October 2014
Deposited On:30 Sep 2014 12:28
Last Modified:10 Aug 2021 16:18
Publisher:Stiftung Universität Hildesheim
OA Status:Green
Free access at:Official URL. An embargo period may apply.
Related URLs:http://www.uni-hildesheim.de/konvens2014/pages/Accepted%20submissions.html (Publisher)
  • Content: Accepted Version
  • Language: English