Header

UZH-Logo

Maintenance Infos

Monitoring named entity recognition: the League Table


Rebholz-Schuhmann, Dietrich; Kafkas, Senay; Kim, Jee-hyub; Jimeno Yepes, Antonio; Lewin, Ian (2013). Monitoring named entity recognition: the League Table. Journal of Biomedical Semantics, 4(1):19.

Abstract

Background
Named entity recognition (NER) is an essential step in automatic text processing pipelines. A number of solutions have been presented and evaluated against gold standard corpora (GSC). The benchmarking against GSCs is crucial, but left to the individual researcher. Herewith we present a League Table web site, which benchmarks NER solutions against selected public GSCs, maintains a ranked list and archives the annotated corpus for future comparisons.
Results
The web site enables access to the different GSCs in a standardized format (IeXML). Upon submission of the annotated corpus the user has to describe the specification of the used solution and then uploads the annotated corpus for evaluation. The performance of the system is measured against one or more GSCs and the results are then added to the web site (“League Table”). It displays currently the results from publicly available NER solutions from the Whatizit infrastructure for future comparisons.
Conclusion
The League Table enables the evaluation of NER solutions in a standardized infrastructure and monitors the results long-term.

Abstract

Background
Named entity recognition (NER) is an essential step in automatic text processing pipelines. A number of solutions have been presented and evaluated against gold standard corpora (GSC). The benchmarking against GSCs is crucial, but left to the individual researcher. Herewith we present a League Table web site, which benchmarks NER solutions against selected public GSCs, maintains a ranked list and archives the annotated corpus for future comparisons.
Results
The web site enables access to the different GSCs in a standardized format (IeXML). Upon submission of the annotated corpus the user has to describe the specification of the used solution and then uploads the annotated corpus for evaluation. The performance of the system is measured against one or more GSCs and the results are then added to the web site (“League Table”). It displays currently the results from publicly available NER solutions from the Whatizit infrastructure for future comparisons.
Conclusion
The League Table enables the evaluation of NER solutions in a standardized infrastructure and monitors the results long-term.

Statistics

Citations

3 citations in Web of Science®
1 citation in Scopus®
Google Scholar™

Altmetrics

Downloads

115 downloads since deposited on 15 Oct 2013
29 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, not refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Language:English
Date:September 2013
Deposited On:15 Oct 2013 14:24
Last Modified:08 Aug 2017 03:28
Publisher:BioMed Central
ISSN:2041-1480
Free access at:PubMed ID. An embargo period may apply.
Publisher DOI:https://doi.org/10.1186/2041-1480-4-19
PubMed ID:24034148

Download

Preview Icon on Download
Preview
Content: Accepted Version
Filetype: PDF
Size: 132kB
View at publisher
Preview Icon on Download
Preview
Content: Published Version
Filetype: PDF
Size: 229kB
Licence: Creative Commons: Attribution 2.0 Generic (CC BY 2.0)

Article Networks

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations