IdentityRank: Named entity disambiguation in the news domain
Expert Systems with ApplicationsPublished 17 February 2012
Norberto Fernández, Jesús Arias Fisteus, Luis Sánchez Fernández, Gonzalo López
Citations15
SJR quartileQ1
SJR score1.85
SNIP2.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The IdentityRank algorithm, designed to address the problem of named entity disambiguation in news items, is described and developed as part of the EU-funded project News Engine Web Services.
Abstract
News companies produce news items that describe events that happen in the world. These news items usually contain mentions to persons, organizations, locations and other types of named entities that are involved in the events being described. These named entities may have an ambiguous meaning, which impacts the performance of free-text information retrieval systems. In this paper the IdentityRank algorithm, designed to address the problem of named entity disambiguation in news items, is described. It has been developed as part of the EU-funded project News Engine Web Services (NEWS) and is specifically designed to operate within the editorial environment of a news company. The algorithm was implemented and evaluated using several corpora of actual news items, achieving an average accuracy of around 96%.
Keywords
Computer Science
The PageRank Citation Ranking : Bringing Order to the Web
12,645 Citations1999Lawrence M. Page, Sergey Brin +2 more
This paper describes PageRank, a mathod for rating Web pages objectively and mechanically, effectively measuring the human interest and attention devoted to them, and shows how to efficiently compute PageRank for large numbers of pages.
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
Ontological Engineering: with examples from the areas of Knowledge Management, e-Commerce and the Semantic Web
1,156 Citations2004Asuncíon Gómez-Pérez, Mariano Fernández‐López +1 more
Large-Scale Named Entity Disambiguation Based on Wikipedia Data
1,072 Citations2007Silviu Cucerzan
Through a process of maximizing the agreement between the contextual information extracted from Wikipedia and the context of a document, as well as the agreement among the category tags associated with the candidate entities, the implemented system shows high disambiguation accuracy on both news stories and Wikipedia articles.
Numerical Methods Using MATLAB
1,062 Citations1998John H. Mathews, Kurtis D. Fink
Using Encyclopedic Knowledge for Named Entity Disambiguation
812 Citations2006Răzvan Bunescu, Marius Paşca
A disambiguation SVM kernel is trained to exploit the high coverage and rich structure of the knowledge encoded in an online encyclopedia and significantly outperforms a less informed baseline.
Choice Reviews OnlineThe Oxford handbook of computational linguistics
719 Citations2003
This collection of invited papers covers a lot of ground in its nearly 800 pages, so any review of reasonable length will necessarily be selective, but there are a number of features that make the book as a whole a comparatively easy and thoroughly rewarding read.
Entity-based cross-document coreferencing using the Vector Space Model
533 Citations1998Amit Bagga, Breck Baldwin
A cross-document coreference resolution algorithm which uses the Vector Space Model to resolve ambiguities between people having the same name and this algorithm is compared to the scoring algorithm used in the MUC-6 (within document) coreference task.
Overview of the TAC 2010 Knowledge Base Population Track
419 Citations2010Heng Ji, Ralph Grishman +3 more
An overview of the task definition and annotation challenges associated with KBP2010 is provided and the evaluation results and lessons that are learned are discussed based on detailed analysis.
IEEE Transactions on Knowledge and Data EngineeringAn Adaptation of the Vector-Space Model for Ontology-Based Information Retrieval
417 Citations2007Pablo Castells, Miriam Fernández +1 more
A model for the exploitation of ontology-based knowledge bases to improve search over large document repositories and is combined with conventional keyword-based retrieval to achieve tolerance to knowledge base incompleteness.
Entity Disambiguation for Knowledge Base Population
343 Citations2010Mark Dredze, Paul McNamee +3 more
This work presents a state of the art system for entity disambiguation that not only addresses challenges but also scales to knowledge bases with several million entries using very little resources.
Unsupervised personal name disambiguation
310 Citations2003Gideon Mann, David Yarowsky
This paper presents a set of algorithms for distinguishing personal names with multiple real referents in text, based on little or no supervision, using an unsupervised clustering technique over a rich feature space of biographic facts, which are automatically extracted via a language-independent bootstrapping process.
Word Sense Disambiguation: The State of the Art
293 Citations2005Nancy Ide, Jean Véronis
Corva provide information about relationships among words, most notably synonymy, and have become a primary source of information for WSD; this development is outlined below.
Name disambiguation in author citations using a K-way spectral clustering method
273 Citations2005Hui Han, Hongyuan Zha +1 more
An unsupervised learning approach using K-way spectral clustering that disambiguates authors in citations is proposed that utilizes three types of citation attributes: co-author names, paper titles, and publication venue titles.
Journal of Web SemanticsSemantically enhanced Information Retrieval: An ontology-based approach
252 Citations2010Miriam Fernández, Iván Cantador +4 more
The major contribution of this work is an innovative, comprehensive semantic search model, which extends the classic IR model, addresses the challenges of the massive and heterogeneous Web environment, and integrates the benefits of both keyword and semantic-based search.
BioinformaticsDisambiguating proteins, genes, and RNA in text: a machine learning approach
225 Citations2001Vasileios Hatzivassiloglou, Pablo Duboue +1 more
Three machine learning algorithms and several extended ways for defining contextual features for disambiguation are examined, and a fully unsupervised manner for obtaining training examples is proposed.
PageRank on semantic networks, with application to word sense disambiguation
211 Citations2004Rada Mihalcea, Paul Tarau +1 more
A new open text word sense disambiguation method that combines the use of logical inferences with PageRank-style algorithms applied on graphs extracted from natural language documents is presented.
Lecture notes in computer scienceName Discrimination by Clustering Similar Contexts
136 Citations2005Ted Pedersen, Amruta Purandare +1 more
This paper presents an unsupervised approach that resolves name ambiguity by clustering the instances of a given name into groups, each of which is associated with a distinct underlying entity.
Learning to Link Entities with Knowledge Base
130 Citations2010Zhicheng Zheng, Fangtao Li +2 more
This paper proposes a learning to rank algorithm that effectively utilizes the relationship information among the candidates when ranking and achieves 18.5% improvement in terms of accuracy over the classification models for those entities which have corresponding entries in the Knowledge Base.
Entity Linking Leveraging Automatically Generated Annotation
130 Citations2010Wei Zhang, Jian Su +2 more
This paper proposes to use additional information sources from Wikipedia to find more name variations for entity linking task and presents a novel method to automatically generate a large scale corpus annotation for ambiguous mentions leveraging on their unambiguous synonyms in the document collection.
Unsupervised Name Disambiguation via Social Network Similarity
126 Citations2005Bradley Malin
Unsupervised methods which simultaneously learn the number of entities represented by a particular name and which observations correspond to the same entity are investigated, suggesting methods which measure similarity based on community, rather than exact, similarity provide more robust disambiguation capability.
Lecture notes in computer scienceOntology-Driven Automatic Entity Disambiguation in Unstructured Text
118 Citations2006Joseph Hassell, Boanerges Aleman-Meza +1 more
The applicability of the novel method, which utilizes background knowledge in the form of a populated ontology, is demonstrated by disambiguating names of researchers appearing in a collection of DBWorld posts using a large scale, real-world ontology extracted from the DBLP bibliography website.
WePS-3 Evaluation Campaign: Overview of the Web People Search Clustering and Attribute Extraction Tasks.
75 Citations2010Javier Artiles, Andrew Borthwick +3 more
The definition, resources, evaluation methodology and results for the clustering and attribute extraction tasks for the Web People Search Evaluation campaign are presented.
Theory and applications of categoriesLCC Approaches to Knowledge Base Population at TAC 2010.
67 Citations2010John Lehmann, Sean Monahan +3 more
The design and implementation of LCC’s systems which participated in the tasks of Entity Linking, Slot Filling, and the new task of SurpriseSlot Filling are described.
Structural Semantic Relatedness: A Knowledge-Based Method to Named Entity Disambiguation
58 Citations2010Xianpei Han, Jun Zhao
This paper proposes a knowledge-based method, called Structural Semantic Relatedness (SSR), which can enhance the named entity disambiguation by capturing and leveraging the structural semantic knowledge in multiple knowledge sources.
Towards Robust Unsupervised Personal Name Disambiguation
57 Citations2007Ying Chen, James Martin
From these experiments, it is found that the use of robust syntactic and semantic features can significantly improve the state of the art for disambiguation performance for personal names for both Chinese and English.
Disambiguating toponyms in news
54 Citations2005Eric Garbin, Inderjeet Mani
This research aimed at the problem of disambiguating toponyms (place names) in terms of a classification derived by merging information from two publicly available gazetteers by using unsupervised machine learning to develop disambigsuation rules.
New Techniques for Disambiguation in Natural Language and Their Application to Biological Text
49 Citations2004Filip Ginter, Jorma Boberg +2 more
A new family of classifiers based on ordering and weighting the feature vectors obtained from word counts and word co-occurrence in the text are introduced, and it is shown that correct setting of the context length is important and also problem-dependent in the classification accuracy.
Lecture notes in computer scienceTowards Semantic Search
37 Citations2008Ricardo Baeza‐Yates, Massimiliano Ciaramita +2 more
This extended abstract presents how to understand semantic search, the Web and the current challenges, and how to use shallow semantics to improve Web search and, ultimately, better search.
Lecture notes in computer scienceNEWS: Bringing Semantic Web Technologies into News Agencies
26 Citations2006Norberto Fernández, José María Blázquez +7 more
The aims and main achievements of the NEWS project, that was just completed, are described and the usage of Semantic Web technologies could help news agencies in achieving that objective.
Expert Systems with ApplicationsThe NEWS ontology: Design and applications
25 Citations2010Norberto Fernández, Damaris Fuentes +2 more
The NEWS ontology, its intended uses in the context of the production and distribution processes of a news agency, and the NEWSPlugin, a Protege extension developed to partially automate its maintenance are described.
Lecture notes in computer scienceAn Approach to Web-Scale Named-Entity Disambiguation
24 Citations2009Luís Sarmento, Alexander Kehlenbeck +2 more
It is shown that on web collections, NED becomes increasingly difficult as the corpus size increases, not only because of the challenge of scaling the NED algorithm, but also because new and surprising facets of entities become visible in the data.
Web Person Name Disambiguation by Relevance Weighting of Extended Feature Sets.
24 Citations2010Chong Long, Lei Shi
The method focuses on two aspects: the extended feature sets, and feature relevance weighting, and it is shown that the system based on the approach has generated the best results among all the WePS-3’s submissions.
Lecture notes in computer scienceNamed Entity Disambiguation: A Hybrid Statistical and Rule-Based Incremental Approach
24 Citations2008Hien Nguyen, Tru H. Cao
A novel method for detecting proper names in a text and linking them to the right entities in Wikipedia, containing two phases, containing some heuristics and patterns to narrow down the candidates, and the vector space model to rank the ambiguous cases to choose the right candidate.
Lecture notes in computer scienceIdentityRank: Named Entity Disambiguation in the Context of the NEWS Project
22 Citations2007Norberto Fernández, José María Blázquez +2 more
The IdentityRank algorithm, developed as part of the EU-funded project NEWS to address the problem of named entity disambiguation in the context of semantic annotation of news items, provides a ranking of the candidate instances within an ontology which can be associated to a certain entity.
Expert Systems with ApplicationsBioDR: Semantic indexing networks for biomedical document retrieval
21 Citations2009Anália Lourenço, Rafael Carreira +8 more
This work proposes BioDR, a novel approach that allows the semantic indexing of the results of a query, by identifying relevant terms in the documents by identifying specific biological terms from Named Entity Recognition.
Communications in computer and information scienceSemantic Relatedness Approach for Named Entity Disambiguation
18 Citations2010Anna Lisa Gentile, Ziqi Zhang +2 more
This work addresses the problem of giving a sense to proper names in a text, that is, automatically associating words representing Named Entities with their referents, based on Semantic Relatedness Scores obtained with a graph based model over Wikipedia.
Lecture notes in computer scienceA Knowledge-Based Approach to Named Entity Disambiguation in News Articles
13 Citations2007Hien Nguyen, Tru H. Cao
This paper proposes a new approach that is not limited to some entity classes and does not require well-structured texts, and exploits relations between co-occurring entities in a text as defined in a knowledge base for disambiguation.
Biomedical Term Disambiguation: An Application to Gene-Protein Name Disambiguation
12 Citations2006Hisham Al-Mubaid, Ping Chen
The technique is effective in disambiguating gene and protein names, achieving impressive accuracy, precision, and recall, with accuracy approaching about 90%, and outperforming the recently published results on this problem.
Expert Systems with ApplicationsUnderstanding the role of conceptual relations in Word Sense Disambiguation
12 Citations2011David Fernández-Amorós, Rubén Heradio
It is concluded that conceptual relations provide a source of information that is insufficient by itself to achieve good disambiguation results, but can, however, be a very accurate heuristic in a combined system.
Name Disambiguation Using Semantic Association Clustering
11 Citations2009Hai Jin, Li Huang +1 more
This paper presents an approach, named as Semantic Association based Name Disambiguation method (SAND), to solve person name ambiguity, to explore the semantic association of name entities and cluster name entities according to their associations.
Ontology based entity disambiguation with natural language patterns
10 Citations2009Joachim Kleb, Raphael Volz
This work introduces a novel approach to dis-ambiguate names using ontologies, natural language text patterns and a customisable ranking algorithm, and demonstrates the utility of the results with a geographic news reader.
Resources for Named Entity Recognition and Resolution in News Wires
9 Citations2010Rosa Stern, Benoît Sagot
NP, the named entity module embedded in the SXPipe shallow processing chain, is described and a freely available and manually developped annotated corpus designed for the evaluation of named entity recognition and resolution tools is introduced.
Perron-Frobenius theory: a new proof of the basics
8 Citations1994G. W. Stewart
This note presents a new proof of basic Perron{Frobenius theory of irreducible nonnegative matrices}, and shows that the theory is able to be applied to matrices of different types.
Expert Systems with ApplicationsCombining multiple disambiguation methods for gene mention normalization
5 Citations2010Xia Ning, Hongfei Lin +2 more
This work employs an information retrieval based method which extracts gene mention's semantic profile from PubMed abstracts for gene mention disambiguation and extracts features from gene mention detection system's outcome to build a false positive filter according to Wikipedia's retrieved documents.