Improvements in automatic thesaurus extraction
Published 1 January 2002Open access
James Curran, Marc Moens
Citations213
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An approximation algorithm is proposed, based on canonical attributes and coarse- and fine-grained matching, that reduces the time complexity and execution time of thesaurus extraction with only a marginal performance penalty.
Abstract
The use of semantic resources is common in modern NLP systems, but methods to extract lexical semantics have only recently begun to perform well enough for practical use. We evaluate existing and new similarity metrics for thesaurus extraction, and experiment with the tradeoff between extraction performance and efficiency. We propose an approximation algorithm, based on canonical attributes and coarse-and fine-grained matching, that reduces the time complexity and execution time of thesaurus extraction with only a marginal performance penalty.
Keywords
Computer Science
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
An Information-Theoretic Definition of Similarity
3,662 Citations1998Dekang Lin
This work presents an informationtheoretic definition of similarity that is applicable as long as there is a probabilistic model and demonstrates how this definition can be used to measure the similarity in a number of different domains.
Automatic acquisition of hyponyms from large text corpora
3,283 Citations1992Marti A. Hearst
A set of lexico-syntactic patterns that are easily recognizable, that occur frequently and across text genre boundaries, and that indisputably indicate the lexical relation of interest are identified.
Class-based n -gram models of natural language
2,893 Citations1992Peter F. Brown, P.V. deSouza +3 more
This work addresses the problem of predicting a word from previous words in a sample of text and discusses n-gram models based on classes of words, finding that these models are able to extract classes that have the flavor of either syntactically based groupings or semanticallybased groupings, depending on the nature of the underlying statistics.
Automatic retrieval and clustering of similar words
1,555 Citations1998Dekang Lin
A word similarity measure based on the distributional pattern of words allows the automatically constructed thesaurus to be significantly closer to WordNet than Roget Thesaurus is.
Distributional clustering of English words
994 Citations1993Fernando Pereira, Naftali Tishby +1 more
Explorations in Automatic Thesaurus Discovery
757 Citations1994Gregory Grefenstette
The aim of this monograph is to provide a catalog of words and phrases used in ThesaurusGeneration, as well as some examples of other writers' work, which have been used in similar contexts.
Distributional clustering of words for text classification
683 Citations1998Lee D. Baker, Andrew Kachites McCallum
This paper describes the application of Distributional Clustering to document classi(cid:12)cation and shows that it can reduce the feature dimensionality by three orders of magnitude and lose only 2% accuracy, better than Latent Semantic In-dexing, class-based clustering, feature selection by mutual information, or Markov-blanket-based feature selection.
Deriving concept hierarchies from text
613 Citations1999Mark Sanderson, Bruce Croft
This paper presents a means of automatically deriving a hierarchical organization of concepts from a set of documents without use of training data or standard clustering techniques, using a type of co-occurrence known as subsumption.
Proceedings of the 17th international conference on Computational linguistics -Automatic retrieval and clustering of similar words
550 Citations1998Dekang Lin
Automatic construction of a hypernym-labeled noun hierarchy from text
373 Citations1999Sharon A. Caraballo
This work goes a step further by automatically creating not just clusters of related words, but a hierarchy of nouns and their hypernyms, akin to the hand-built hierarchy in WordNet.
Cambridge University Press eBooksThesaurus of English Words and Phrases
199 Citations2014Peter Mark Roget
Thesaurus of English words and phrases is a collection ofverbs, idioms and phrases used in everyday usage to describe English phrases and words.
Computational LinguisticsClass-Based Probability Estimation Using a Semantic Hierarchy
124 Citations2002Stephen Clark, David Weir
This article concerns the estimation of a particular kind of probability, namely, the probability of a noun sense appearing as a particular argument of a predicate, and a procedure is developed that uses a chi-square test to determine a suitable level of generalization.
Synonymy in collocation extraction
107 Citations2001Darren Pearce
The use of WordNet is described in a new technique for collocation extraction based on restrictions on the possible substitutions for synonyms within candidate phrases, which is followed by a detailed description of the new approach and results.
Robust, applied morphological generation
81 Citations2000Guido Minnen, John M. Carroll +1 more
A fast and robust morphological generator for English based on finite-state techniques that generates a word form given a specification of the lemma, part-of-speech, and the type of inflection required is presented.
A cluster-based approach to thesaurus construction
64 Citations1988Carolyn J. Crouch
This paper describes one approach to the automatic generation of global thesauri, based on the discrimination value model of Salton, Yang, and Yu and on an appropriate clustering algorithm, which has been implemented and applied to two document collections.
Edinburgh Research Archive (University of Edinburgh)Environmental Determinants of Lexical Processing Effort
64 Citations2000Scott A. McDonald
This model provides an integrated account of both context-dependent and context-independent processing behaviour, offers an objective alternative to the influential spreading activation model of contextual facilitation, and invites reinterpretation of a number of controversial issues in the literature.
Scaling context space
61 Citations2001James Curran, Marc Moens
This work uses thesaurus extraction with a range of context extracting tools to demonstrate the interaction between context quantity, time and size on a corpus of 300 million words.
Lecture notes in computer scienceAutomatic detection of thesaurus relations for information retrieval applications
43 Citations1997Gerda Ruge
This article explains how implicit semantic knowledge can be transformed to an explicit one and evaluates of quality and performance of the approach are very encouraging.
Class-based probability estimation using a semantic hierarchy
28 Citations2001Stephen Clark, David Weir
This paper concerns the acquisition of a particular kind of lexical knowledge, namely the knowledge of which noun senses can fill argument slots of predicates, and classes from a semantic hierarchy are used to estimate the probabilities.
Construction of a dynamic Thesaurus and its use for associated information retrieval
18 Citations1989Haruo Kimoto, Toshiaki Iwadera
An information retrieval system based on a dynamic thesaurus was developed utilizing the connectionist approach, in which both a high recall rate and a high precision rate were achieved.