Header

UZH-Logo

Maintenance Infos

Cleaning the Europarl Corpus for Linguistic Applications


Graën, Johannes; Batinic, Dolores; Volk, Martin (2014). Cleaning the Europarl Corpus for Linguistic Applications. In: Konvens 2014, Hildesheim, 8 October 2014 - 10 October 2014.

Abstract

We discovered several recurring errors in the current version of the Europarl Corpus originating both from the web site of the European Parliament and the corpus compilation based thereon. The most frequent error was incompletely extracted metadata leaving non-textual fragments within the textual parts of the corpus files. This is, on average, the case for every second speaker change.
We not only cleaned the Europarl Corpus by correcting several kinds of errors, but also aligned the speakers’ contributions of all available languages and compiled every- thing into a new XML-structured corpus. This facilitates a more sophisticated selection of data, e.g. querying the corpus for speeches by speakers of a particular polit- ical group or in particular language combinations.

Abstract

We discovered several recurring errors in the current version of the Europarl Corpus originating both from the web site of the European Parliament and the corpus compilation based thereon. The most frequent error was incompletely extracted metadata leaving non-textual fragments within the textual parts of the corpus files. This is, on average, the case for every second speaker change.
We not only cleaned the Europarl Corpus by correcting several kinds of errors, but also aligned the speakers’ contributions of all available languages and compiled every- thing into a new XML-structured corpus. This facilitates a more sophisticated selection of data, e.g. querying the corpus for speeches by speakers of a particular polit- ical group or in particular language combinations.

Statistics

Downloads

43 downloads since deposited on 30 Sep 2014
33 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Computational Linguistics
08 University Research Priority Programs > Language and Space
Dewey Decimal Classification:000 Computer science, knowledge & systems
410 Linguistics
Uncontrolled Keywords:Europarl Corpus cleaning linguistic application fragments metadata quality query
Language:English
Event End Date:10 October 2014
Deposited On:30 Sep 2014 12:28
Last Modified:15 Dec 2017 08:06
Publisher:Stiftung Universität Hildesheim
Free access at:Official URL. An embargo period may apply.
Related URLs:http://www.uni-hildesheim.de/konvens2014/pages/Accepted%20submissions.html (Publisher)

Download

Download PDF  'Cleaning the Europarl Corpus for Linguistic Applications'.
Preview
Content: Accepted Version
Language: English
Filetype: PDF
Size: 162kB