Exploiting Wikipedia as External Knowledge for Named Entity Recognition
Published 1 June 2007
Jun’ichi Kazama, Kentaro Torisawa
Citations277
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is demonstrated using the CoNLL 2003 dataset that the Wikipedia category labels extracted by such a simple method actually improve the accuracy of NER.
Abstract
We explore the use of Wikipedia as external knowledge to improve named entity recognition (NER). Our method retrieves the corresponding Wikipedia entry for each candidate word sequence and extracts a category label from the first sentence of the entry, which can be thought of as a definition part. These category labels are used as features in a CRF-based NE tagger. We demonstrate using the CoNLL 2003 dataset that the Wikipedia category labels extracted by such a simple method actually improve the accuracy of NER.
Keywords
Computer ScienceSocial Sciences
Proceedings of the IEEEA tutorial on hidden Markov models and selected applications in speech recognition
22,785 Citations1989L. R. Rabiner
ScholarlyCommons (University of Pennsylvania)Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
12,978 Citations2001John Lafferty, Andrew McCallum +1 more
This work presents iterative parameter estimation algorithms for conditional random fields and compares the performance of the resulting models to HMMs and MEMMs on synthetic and natural-language data.
Artificial IntelligenceUnsupervised named-entity extraction from the Web: An experimental study
1,128 Citations2005Oren Etzioni, Michael Cafarella +6 more
An overview of KnowItAll's novel architecture and design principles is presented, emphasizing its distinctive ability to extract information without any hand-labeled training examples, and three distinct ways to address this challenge are presented and evaluated.
Using Encyclopedic Knowledge for Named Entity Disambiguation
812 Citations2006Răzvan Bunescu, Marius Paşca
A disambiguation SVM kernel is trained to exploit the high coverage and rich structure of the knowledge encoded in an online encyclopedia and significantly outperforms a less informed baseline.
Machine LearningAn Algorithm that Learns What's in a Name
784 Citations1999Daniel M. Bikel, Richard Schwartz +1 more
IdentiFinderTM, a hidden Markov model that learns to recognize and classify names, dates, times, and numerical quantities, is evaluated and is competitive with approaches based on handcrafted rules on mixed case text and superior on text where case information is not available.
MADOC (University of Mannheim)WikiRelate! computing semantic relatedness using wikipedia
759 Citations2006Michael Strube, Simone Paolo Ponzetto
This work presents experiments on using Wikipedia for computing semantic relatedness and compares it to WordNet on various benchmarking datasets, and shows that Wikipedia outperforms WordNet when applied to the largest available dataset designed for that purpose.
Learning dictionaries for information extraction by multi-level bootstrapping
688 Citations1999Ellen Riloff, Rosie Jones
A multilevel bootstrapping algorithm is presented that generates both the semantic lexicon and extraction patterns simultaneously simultaneously and produces high-quality dictionaries for several semantic categories.
A bootstrapping method for learning semantic lexicons using extraction pattern contexts
369 Citations2002M. Thelen, Ellen Riloff
The semantic lexicons produced by Basilisk have higher precision than those produced by previous techniques, with several categories showing substantial improvement.
Exploiting semantic role labeling, WordNet and Wikipedia for coreference resolution
256 Citations2006Simone Paolo Ponzetto, Michael Strube
An extension of a machine learning based coreference resolution system which uses features induced from different semantic knowledge sources, which represent knowledge mined from WordNet and Wikipedia, as well as information about semantic role labels is presented.
Lecture notes in computer scienceUnsupervised Named-Entity Recognition: Generating Gazetteers and Resolving Ambiguity
232 Citations2006David R. Nadeau, Peter D. Turney +1 more
This paper proposes a named-entity recognition (NER) system that addresses two major limitations frequently discussed in the field: first, the system requires no human intervention such as manually labeling training data or creating gazetteers, and second, it can handle more than the three classicalnamed-entity types.
Extended Named Entity Hierarchy
227 Citations2002Satoshi Sekine, Kiyoshi Sudo +1 more
A Named Entity hierarchy which contains about 150 NE types is proposed and it is proposed that this resource for any application should be provided.
A proposal to automatically build and maintain gazetteers for Named Entity Recognition by using Wikipedia
119 Citations2006Antonio Toral, Rafael Muñoz
TUbilio (Technical University of Darmstadt)Analyzing and accessing Wikipedia as a lexical semantic resource
86 Citations2007Torsten Zesch, Iryna Gurevych +1 more
This work introduces a general purpose, high performance Java-based Wikipedia API that overcomes limitations and is available for research purposes at http://www.ukp.tu-darmstadt.
A context pattern induction method for named entity extraction
71 Citations2006Partha Talukdar, Thorsten Brants +2 more
A novel context pattern induction method is presented for information extraction, specifically named entity extraction, that extended several classes of seed entity lists into much larger high-precision lists and improved the accuracy of a conditional random field-based named entity tagger.
A New Perceptron Algorithm for Sequence Labeling with Non-Local Features
38 Citations2007Jun’ichi Kazama, Kentaro Torisawa
This work proposes a new perceptron algorithm that can use non-local features whose values are determined from the sequence and the labels and presents experimental results from the CoNLL 2003 named entity recognition (NER) task.
Biblos-e Archivo (Universidad Autónoma de Madrid)From Wikipedia to Semantic Relationships: a Semi-automated Annotation Approach
30 Citations2006María Ruiz-Casado, Enrique Alfonseca +1 more
Proceedings of the First Workshop on Semantic Wikis - From Wiki to Semantics co-located with the ESWC2006 Budva, Montenegro, June 12, 2006.