Header

UZH-Logo

Maintenance Infos

DeInStance: Creating and Evaluating a German Corpus for Fine-Grained Inferred Stance Detection


Gohring, Anne; Klenner, Manfred; Conrad, Sophia (2021). DeInStance: Creating and Evaluating a German Corpus for Fine-Grained Inferred Stance Detection. In: 17th Conference on Natural Language Processing (KONVENS 2021), Düsseldorf, 6 September 2021 - 9 September 2021. ACL Anthology, 213-217.

Abstract

We introduce deInStance, a corpus of 1000 politicians’ answers in German (de) containing sentences labeled with explicitly expressed and inferred stances - pro and con relations - by 3 annotators. They achieved an acceptable inter-rater agreement given the inherent subjective nature of the task. A first baseline, a fine-tuned BERT-based token classifier, achieved F1-scores of around 70% . Our focus is on the difficult subclass of sentences comprising only non-polar words, but still with an (implicit) pro or con perspective of the writer.

Abstract

We introduce deInStance, a corpus of 1000 politicians’ answers in German (de) containing sentences labeled with explicitly expressed and inferred stances - pro and con relations - by 3 annotators. They achieved an acceptable inter-rater agreement given the inherent subjective nature of the task. A first baseline, a fine-tuned BERT-based token classifier, achieved F1-scores of around 70% . Our focus is on the difficult subclass of sentences comprising only non-polar words, but still with an (implicit) pro or con perspective of the writer.

Statistics

Downloads

27 downloads since deposited on 21 Oct 2021
11 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Computational Linguistics
Dewey Decimal Classification:000 Computer science, knowledge & systems
410 Linguistics
Language:English
Event End Date:9 September 2021
Deposited On:21 Oct 2021 13:01
Last Modified:06 Apr 2022 15:18
Publisher:ACL Anthology
Number of Pages:5
OA Status:Green
Free access at:Official URL. An embargo period may apply.
Official URL:https://aclanthology.org/2021.konvens-1.20
Project Information:
  • : FunderSNSF
  • : Grant ID105215_179302
  • : Project TitleSentimentinferenz: Perspektivierung und Quantifikation
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution 3.0 Unported (CC BY 3.0)