Language independent NER using a maximum entropy tagger
Published 1 January 2003Open access
James Curran, Stephen Clark
Citations249
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper demonstrates that a maximum entropy tagger can effectively encode such information and identify named entities with very high accuracy.
Abstract
Named Entity Recognition (NER) systems need to integrate a wide variety of information for optimal performance. This paper demonstrates that a maximum entropy tagger can effectively encode such information and identify named entities with very high accuracy. The tagger uses features which can be obtained for a variety of languages and works effectively not only for English, but also for other languages such as German and Dutch.
Keywords
Computer Science
arXiv (Cornell University)Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
1,574 Citations2002Erik F. Tjong Kim Sang
Named entity recognition using an HMM-based chunk tagger
718 Citations2001Guodong Zhou, Jian Su
A Hidden Markov Model and an HMM-based chunk tagger is proposed, from which a named entity (NE) recognition system is built to recognize and classify names, times and numerical quantities, and the NER problem can be resolved effectively.
A maximum entropy approach to named entity recognition
467 Citations1999Ralph Grishman, Andrew Borthwick
This thesis describes a novel statistical named-entity recognition system known as MENE (Maximum Entropy Named Entity), and demonstrates the trans-lingual portability of the system, which was competitive with the best systems built by native Japanese speakers despite the fact that the author speaks no Japanese.
Ranking algorithms for named-entity extraction
241 Citations2001Michael Collins
Algorithms which rerank the top N hypotheses from a maximum-entropy tagger, the application being the recovery of named-entity boundaries in a corpus of web data, using the voted perceptron algorithm.
Named Entity Extraction using AdaBoost
185 Citations2002Xavier Carreras, Lluı́s Màrquez +1 more
This paper presents a Named Entity Extraction (NEE) system for the CoNLL 2002 competition, which makes use of binary AdaBoost classifiers.
Investigating GIS and smoothing for maximum entropy taggers
102 Citations2003James Curran, Stephen Clark
It is shown analytically and empirically that the correction feature, assumed to be required for the correctness of GIS, is unnecessary, and the use of a Gaussian prior and a simple cutoff for smoothing is explored.
Markov models for language-independent named entity recognition
78 Citations2002Robert Malouf
This report describes the application of Markov models to the problem of language-independent named entity recognition for the CoNLL-2002 shared task.
New models for improving supertag disambiguation
36 Citations1999John Chen, Srinivas Bangalore +1 more
Contextual models are presented, which exploit a variety of features in order to improve supertag performance, and class-based models, which assign sets of supertags to words inorder to substantially improve accuracy with only a slight increase in ambiguity.
A very very large corpus doesn't always yield reliable estimates
27 Citations2002James Curran, Miles Osborne
This work empirically investigates the convergence behaviour of unigram probability estimates on a one billion word corpus and concludes that simply relying upon large corpora is not in itself sufficient: one must pay attention to the statistical modelling as well.
Statistical named entity recognizer adaptation
20 Citations2002John D. Burger, John C. Henderson +1 more
The NER task involves both identification of spans of text referring to named entities, and categorization of these entities into classes based on the role they fill in context.
Learning with multiple stacking for named entity recognition
16 Citations2002Koji Tsukamoto, Yutaka Mitsuishi +1 more
A learning method using multiple stacking for named entity recognition which employs stacked learners using the tags predicted by the lower level learners to improve a base system.