Header

UZH-Logo

Maintenance Infos

Evaluating semantic search tools using the SEALS platform


Wrigley, S N; Elbedweihy, K; Reinhardt, D; Bernstein, A; Ciravegna, F (2010). Evaluating semantic search tools using the SEALS platform. In: International Workshop on Evaluation of Semantic Technologies (IWEST 2010) Workshop, Shanghai, China, 8 November 2010 - 8 November 2010.

Abstract

In common with many state of the art semantic technologies, there is a lack of comprehensive, established evaluation mechanisms for semantic search tools. In this paper, we describe a new evaluation and benchmarking approach for semantic search tools using the infrastructure under development within the SEALS initiative. To our knowledge, it is the first effort to present a comprehensive evaluation methodology for semantic search tools. The paper describes the evaluation methodology including our two-phase approach in which tools are evaluated both in a fully automated fashion as well as within a user-based study. We also present and discuss preliminary results from the first SEALS evaluation campaign together with a discussion of some of the key findings.

Abstract

In common with many state of the art semantic technologies, there is a lack of comprehensive, established evaluation mechanisms for semantic search tools. In this paper, we describe a new evaluation and benchmarking approach for semantic search tools using the infrastructure under development within the SEALS initiative. To our knowledge, it is the first effort to present a comprehensive evaluation methodology for semantic search tools. The paper describes the evaluation methodology including our two-phase approach in which tools are evaluated both in a fully automated fashion as well as within a user-based study. We also present and discuss preliminary results from the first SEALS evaluation campaign together with a discussion of some of the key findings.

Statistics

Citations

Downloads

52 downloads since deposited on 24 Feb 2011
11 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Language:English
Event End Date:8 November 2010
Deposited On:24 Feb 2011 10:51
Last Modified:07 Dec 2017 07:04
Other Identification Number:1475

Download

Download PDF  'Evaluating semantic search tools using the SEALS platform'.
Preview
Filetype: PDF
Size: 395kB