Large-Scale Named Entity Disambiguation Based on Wikipedia Data
Published 1 June 2007
Silviu Cucerzan
Citations1,072
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Through a process of maximizing the agreement between the contextual information extracted from Wikipedia and the context of a document, as well as the agreement among the category tags associated with the candidate entities, the implemented system shows high disambiguation accuracy on both news stories and Wikipedia articles.
Abstract
This paper presents a large-scale system for the recognition and semantic disambiguation of named entities based on information extracted from a large encyclopedic collection and Web search results. It describes in detail the disambiguation paradigm employed and the information extraction process from Wikipedia. Through a process of maximizing the agreement between the contextual information extracted from Wikipedia and the context of a document, as well as the agreement among the category tags associated with the candidate entities, the implemented system shows high disambiguation accuracy on both news stories and Wikipedia articles. 1 Introduction and Related Work
Keywords
Computer ScienceSocial Sciences
Automatic acquisition of hyponyms from large text corpora
3,283 Citations1992Marti A. Hearst
A set of lexico-syntactic patterns that are easily recognizable, that occur frequently and across text genre boundaries, and that indisputably indicate the lexical relation of interest are identified.
Computing semantic relatedness using Wikipedia-based explicit semantic analysis
1,990 Citations2007Evgeniy Gabrilovich, Shaul Markovitch
This work proposes Explicit Semantic Analysis (ESA), a novel method that represents the meaning of texts in a high-dimensional space of concepts derived from Wikipedia that results in substantial improvements in correlation of computed relatedness scores with human judgments.
Message Understanding Conference-6
1,365 Citations1996Ralph Grishman, Beth Sundheim
MUC-6 introduced several innovations over prior MUCs, most notably in the range of different tasks for which evaluations were conducted and the motivations for the new format.
Using Encyclopedic Knowledge for Named Entity Disambiguation
812 Citations2006Răzvan Bunescu, Marius Paşca
A disambiguation SVM kernel is trained to exploit the high coverage and rich structure of the knowledge encoded in an online encyclopedia and significantly outperforms a less informed baseline.
MADOC (University of Mannheim)WikiRelate! computing semantic relatedness using wikipedia
759 Citations2006Michael Strube, Simone Paolo Ponzetto
This work presents experiments on using Wikipedia for computing semantic relatedness and compares it to WordNet on various benchmarking datasets, and shows that Wikipedia outperforms WordNet when applied to the largest available dataset designed for that purpose.
Entity-based cross-document coreferencing using the Vector Space Model
533 Citations1998Amit Bagga, Breck Baldwin
A cross-document coreference resolution algorithm which uses the Vector Space Model to resolve ambiguities between people having the same name and this algorithm is compared to the scoring algorithm used in the MUC-6 (within document) coreference task.
One sense per discourse
524 Citations1992William A. Gale, Kenneth Church +1 more
An experiment confirmed the hypothesis that if a polysemous word such as sentence appears two or more times in a well-written discourse, it is extremely likely that they will all share the same sense and found that the tendency to share sense in the same discourse is extremely strong.
Unsupervised personal name disambiguation
310 Citations2003Gideon Mann, David Yarowsky
This paper presents a set of algorithms for distinguishing personal names with multiple real referents in text, based on little or no supervision, using an unsupervised clustering technique over a rich feature space of biographic facts, which are automatically extracted via a language-independent bootstrapping process.
The SENSEVAL-3 English Lexical Sample Task
227 Citations2004Rada Mihalcea, Timothy Chklovski +1 more
The task definition, resources, participating systems, and comparative results for the English lexical sample task, which was organized as part of the SENSEVAL-3 evaluation exercise, are presented.
Lecture notes in computer scienceDisambiguating Geographic Names in a Historical Digital Library
208 Citations2001David A. Smith, Gregory Crane
The toponym-disambiguation system in the Perseus digital library is described and its performance is evaluated to show that it performs at a high level of precision and recall with a gazetteer an order of magnitude larger than most other applications.
Computers and the HumanitiesFramework and Results for English SENSEVAL
191 Citations2000Adam Kilgarriff, Joseph Rosenzweig
The exercise identifies the state-of-the-art for fine-grained word sense disambiguation, where training data is available, as 74–78% correct, with a number of algorithms approaching this level of performance.
Disambiguation of proper names in text
182 Citations1997Nina Wacholder, Yael Ravin +1 more
The types of ambiguity that make the discovery of proper names difficult in text are analyzed, and the heuristics used to disambiguate names in Nominator, a fully-implemented module for proper name recognition developed at the IBM T. J. Watson Research Center are described.
SENSEVAL-2: Overview
144 Citations2001Philip Edmonds, Scott Cotton
This paper gives an overview of SENSEVAL-2, discussing the evaluation exercise, the tasks, the scoring system, and the results, and some recommendations for future evaluation exercises.
Journal of the American Society for Information ScienceGIPSY: Automated geographic indexing of text documents
105 Citations1994Allison Woodruff, Christian Plaunt
An algorithm which automatically extracts geopositional coordinate index terms from text to support georeferenced document indexing and retrieval is presented.
ScholarWorks@UMassAmherst (University of Massachusetts Amherst)An Exploration of Entity Models, Collective Classification and Relation Description
36 Citations2004Hema Raghavan, James Allan +1 more
This paper explores the middle ground using a representation which is term entity models, in which questions about structured data may be posed and answered, but the complexities and task-specific restrictions of ontologies are avoided.
Identifying and grounding descriptions of places.
35 Citations2006Simon Overell, Stefan Rüger
The plans to apply the co-occurrence models generated with Wikipedia to solve the problem of disambiguating place names in text using supervised learning techniques are outlined.
A method of geographical name extraction from Japanese text for thematic geographical search
18 Citations1999Yasusi Kanada
A text retrieval method called the thematic geographical search method has been developed and applied to a Japanese encyclopedia called the World Encyclopædia, which depends on features of the Japanese language, but the strategy and most of the techniques can be applied to texts in English or other languages.