Permanent URL to this publication: http://dx.doi.org/10.5167/uzh-19095
Hess, M; Dowdall, J; Rinaldi, F (2002). The challenge of technical text. In: LREC-2002, Workshop on Question Answering: Strategy and Resources, Las Palmas, Spain, May 2002 - May 2002.
When evaluating and comparing Answer Extraction and Question Answering systems one can distinguish between scenarios for different information needs such as the “Fact Finding”, the “Problem Solving”, and the “Generic Information” scenarios. For each scenario, speciﬁc types of questions and speciﬁc types of texts have to be taken into account, each one causing speciﬁc problems. We argue that comparative evaluations of such systems should not be limited to a single type of information need and one speciﬁc text type. We use the example of technical manuals and a working Answer Extraction system, “ExtrAns”, to show that other, and important, problems will be encountered in the other cases. We also argue that the quality of the individual answers could be determined automatically through the parameters of correctness and succinctness, i.e. measures for recall and precision on the level of unifying predicates, against a (hand-crafted) gold standard of “ideal answers”.
|Item Type:||Conference or Workshop Item (Paper), refereed, original work|
|Communities & Collections:||06 Faculty of Arts > Institute of Computational Linguistics|
|DDC:||000 Computer science, knowledge & systems
|Event End Date:||May 2002|
|Deposited On:||21 Jul 2009 14:42|
|Last Modified:||17 Oct 2012 09:06|
Users (please log in): suggest update or correction for this item
Repository Staff Only: item control page