Monitoring named entity recognition: the League Table
AuthorRebholz-Schuhmann, D; Kafkas, S; Kim, J-H; Yepes, AJ; Lewin, I
Source TitleJournal of Biomedical Semantics
PublisherBIOMED CENTRAL LTD
University of Melbourne Author/sJimeno Yepes, Antonio
AffiliationComputing and Information Systems
Document TypeJournal Article
CitationsRebholz-Schuhmann, D., Kafkas, S., Kim, J. -H., Yepes, A. J. & Lewin, I. (2013). Monitoring named entity recognition: the League Table. JOURNAL OF BIOMEDICAL SEMANTICS, 4 (1), https://doi.org/10.1186/2041-1480-4-19.
Access StatusOpen Access
BACKGROUND: Named entity recognition (NER) is an essential step in automatic text processing pipelines. A number of solutions have been presented and evaluated against gold standard corpora (GSC). The benchmarking against GSCs is crucial, but left to the individual researcher. Herewith we present a League Table web site, which benchmarks NER solutions against selected public GSCs, maintains a ranked list and archives the annotated corpus for future comparisons. RESULTS: The web site enables access to the different GSCs in a standardized format (IeXML). Upon submission of the annotated corpus the user has to describe the specification of the used solution and then uploads the annotated corpus for evaluation. The performance of the system is measured against one or more GSCs and the results are then added to the web site ("League Table"). It displays currently the results from publicly available NER solutions from the Whatizit infrastructure for future comparisons. CONCLUSION: The League Table enables the evaluation of NER solutions in a standardized infrastructure and monitors the results long-term. For access please go to http://wwwdev.ebi.ac.uk/Rebholz-srv/calbc/assessmentGSC/. CONTACT: firstname.lastname@example.org.
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References