Permanent URL to this publication: http://dx.doi.org/10.5167/uzh-63315
Elbedweihy, Khadija; Wrigley, Stuart N; Ciravegna, Fabio; Reinhard, Dorothee; Bernstein, Abraham (2012). Evaluating semantic search systems to identify future directions of research. In: Second International Workshop on Evaluation of Semantic Technologies, Heraklion, Greece, 28 May 2012 - 28 May 2012, 25-36.
Recent work on searching the Semantic Web has yielded a wide range of approaches with respect to the style of input, the under- lying search mechanisms and the manner in which results are presented. Each approach has an impact upon the quality of the information re- trieved and the user’s experience of the search process. This highlights the need for formalised and consistent evaluation to benchmark the cov- erage, applicability and usability of existing tools and provide indications of future directions for advancement of the state-of-the-art. In this paper, we describe a comprehensive evaluation methodology which addresses both the underlying performance and the subjective usability of a tool. We present the key outcomes of a recently completed international evalu- ation campaign which adopted this approach and thus identify a number of new requirements for semantic search tools from both the perspective of the underlying technology as well as the user experience.
27 downloads since deposited on 10 Jul 2012
5 downloads since 12 months
|Item Type:||Conference or Workshop Item (Paper), refereed, original work|
|Communities & Collections:||03 Faculty of Economics > Department of Informatics|
|Dewey Decimal Classification:||000 Computer science, knowledge & systems|
|Event End Date:||28 May 2012|
|Deposited On:||10 Jul 2012 15:08|
|Last Modified:||13 Sep 2012 12:17|
|Series Name:||CEUR Workshop Proceedings|
|Other Identification Number:||merlin-id:6971|
Users (please log in): suggest update or correction for this item
Repository Staff Only: item control page