Introduction to the special issue on word sense disambiguation: the state of the art
Published 1 March 1998
Nancy Ide, Jean Véronis
Citations668
SJR quartileQ1
SJR score1.15
SNIP4.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Compte tenu du progres effectue recemment dans le domaine de la desambiguisation du sens des mots, les As. font ici le point sur l'etat de la recherche dans ce domaine depuis ces 50 dernieres annees et considerent les prochaines etapes a franchir. Dans un 1 e r temps, ils passent en revue les principales approches de la desambiguisation du sens des mots : des premieres tentatives effectuees dans le cadre de la traduction automatique aux methodes actuelles basees sur les corpus, en passant par les methodes basees sur l'intelligence artificielle et les methodes utilisant des bases de connaissance. Dans un 2 n d temps, ils examinent les problemes laisses en suspens (le role du contexte, la division des sens, l'evaluation des resultats) et proposent quelques orientations pour la recherche future
Keywords
Computer Science
Bulletin of Mathematical BiologyA logical calculus of the ideas immanent in nervous activity
17,984 Citations1943Warren S. McCulloch, Walter Pitts
Psychological ReviewThe perceptron: A probabilistic model for information storage and organization in the brain.
11,746 Citations1958Frank F. Rosenblatt
This article will be concerned primarily with the second and third questions, which are still subject to a vast amount of speculation, and where the few relevant facts currently supplied by neurophysiology have not yet been integrated into an acceptable theory.
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Psychological ReviewA spreading-activation theory of semantic processing.
8,093 Citations1975Allan M. Collins, Elizabeth F. Loftus
The present paper shows how the extended theory can account for results of several production experiments by Loftus, Juola and Atkinson's multiple-category experiment, Conrad's sentence-verification experiments, and several categorization experiments on the effect of semantic relatedness and typicality by Holyoak and Glass, Rips, Shoben, and Smith, and Rosch.
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
International Journal of LexicographyIntroduction to WordNet: An On-line Lexical Database<sup>*</sup>
4,207 Citations1990George A. Miller, Richard Beckwith +3 more
Standard alphabetical procedures for organizing lexical information put together words that are spelled alike and scatter words with similar or related meanings haphazardly through the list.
BiometrikaTHE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS
3,227 Citations1953I. J. Good
Journal of Experimental PsychologyFacilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations.
2,944 Citations1971David E. Meyer, Roger W. Schvaneveldt
The results of both experiments support a retrieval model involving a dependence between separate successive decisions about whether each of the two strings is a word.
Class-based n -gram models of natural language
2,893 Citations1992Peter F. Brown, P.V. deSouza +3 more
This work addresses the problem of predicting a word from previous words in a sample of text and discusses n-gram models based on classes of words, finding that these models are able to extract classes that have the flavor of either syntactically based groupings or semanticallybased groupings, depending on the nature of the underlying statistics.
The Generative Lexicon
2,675 Citations1995James Pustejovsky
It is argued that lexical decomposition is possible if it is performed generatively and a theory of lexical inheritance is outlined, which provides the necessary principles of global organization for the lexicon, enabling us to fully integrate the authors' natural language lexicon into a conceptual whole.
Unsupervised word sense disambiguation rivaling supervised methods
2,408 Citations1995David Yarowsky
An unsupervised learning algorithm for sense disambiguation that, when trained on unannotated English text, rivals the performance of supervised techniques that require time-consuming hand annotations.
arXiv (Cornell University)Using Information Content to Evaluate Semantic Similarity in a Taxonomy
2,147 Citations1995Philip Resnik
Journal of Verbal Learning and Verbal BehaviorA spreading activation theory of memory
2,125 Citations1983John R. Anderson
Automatic sense disambiguation using machine readable dictionaries
1,756 Citations1986Michael Lesk
This procedure uses available dictionaries, so that it will process any text; and uses solely the immediate context to decide which sense of a word is intended (in written English).
Language and Cognitive ProcessesContextual correlates of semantic similarity
1,584 Citations1991George A. Miller, Walter G. Charles
Automatic word sense discrimination
1,286 Citations1998Hinrich Schütze
This paper presents context-group discrimination, a disambiguation algorithm based on clustering that demonstrates good performance of context- group discrimination for a sample of natural and artificial ambiguous words.
Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project
1,281 Citations1990Douglas B. Lenat, Ramanathan V. Guha
This review has been difficult for me to write, because my thoughts about Cyc have changed a great deal since I first read the book in the spring of 1990, and my thoughts about the project today have changed a great deal.
Distributional clustering of English words
994 Citations1993Fernando Pereira, Naftali Tishby +1 more
Lexical cohesion computed by thesaural relations as an indicator of the structure of text
941 Citations1991Jane Morris, Graeme Hirst
Proceedings of the IEEEContinuous speech recognition by statistical methods
901 Citations1976F. Jelinek
Experimental results are presented that indicate the power of the methods and concern modeling of a speaker and of an acoustic processor, extraction of the models' statistical parameters and hypothesis search procedures and likelihood computations of linguistic decoding.
Systems Research and Behavioral ScienceWord concepts: A theory and simulation of some basic semantic capabilities
760 Citations1967M. Ross Quillian
The design principles embodied in the memory model together with some of the methods used by the program constitute a theory of how human memory for semantic and other conceptual material may be formatted, organized, and used.
Word-sense disambiguation using statistical models of Roget's categories trained on large corpora
670 Citations1992David Yarowsky
A program that disambiguates English word senses in unrestricted text using statistical models of the major Roget's Thesaurus categories, enabling training on unrestricted monolingual text without human intervention.
ArXiv.orgAn Empirical Study of Smoothing Techniques for Language Modeling
633 Citations1996Stanley F. Chen, Joshua Goodman
Cognitive PsychologyAutomatic access of the meanings of ambiguous words in context: Some limitations of knowledge-based processing
626 Citations1982Mark S. Seidenberg, Michael K. Tanenhaus +2 more
The results suggest that meaning access is an automatic process which is unaffected by knowledge-based (“top-down”) processing, and whether selective or multiple access of meaning is observed largely depends on the structure of the ambiguous word, not the nature of the context.
A semantic concordance
616 Citations1993George A. Miller, Claudia Leacock +2 more
A semantic concordance is a textual corpus and a lexicon so combined that every substantive word in the text is linked to its appropriate sense in the lexicon.
Language<b>Survey of the state of the art in human language technology</b> . Ed. by Giovanni Varile, Antonio Zampolli, Ronald Cole, Joseph Mariani, Hans Uszkoreit, Annie Zaenen, and Victor Zue. (Studies in natural language processing.) Cambridge: Cambridge University Press. Pp. xx, 513. Cloth $49.95.
604 Citations2000Kay Cohen
NatureRace, Language and Culture
572 Citations1940
A selection of his briefer but not, therefore, less weighty contributions to anthropology in the course of his long career is reprinted.
Elsevier eBooksReadings in Speech Recognition
572 Citations1990
This chapter discusses four main approaches to speech recognition: template-based, knowledge-Based, Stochastic, connectionist, and connectionist.
Multi-paragraph segmentation of expository text
558 Citations1994Marti A. Hearst
TextTiling, an algorithm for partitioning expository texts into coherent multi-paragraph discourse units which reflect the subtopic structure of the texts, is described and shown to produce segmentation that corresponds well to human judgments of the major subtopic boundaries of thirteen lengthy texts.
Proceedings of the Workshop
556 Citations1978Malcolm J. Bowman, Wayne E. Esaias
A universal, concise definition of an oceanic front is difficult to set down because the nature of fronts are best perceived through a community of characteristics.
Computers and the HumanitiesA method for disambiguating word senses in a large corpus
534 Citations1992William A. Gale, Kenneth Church +1 more
The proposed method was designed to disambiguate senses that are usually associated with different topics using a Bayesian argument that has been applied successfully in related tasks such as author identification and information retrieval.
One sense per discourse
524 Citations1992William A. Gale, Kenneth Church +1 more
An experiment confirmed the hypothesis that if a polysemous word such as sentence appears two or more times in a well-written discourse, it is extremely likely that they will all share the same sense and found that the tendency to share sense in the same discourse is extremely strong.
Communications of the ACMThe teachable language comprehender
487 Citations1969M. Ross Quillian
The memory structure and comprehension process of TLC allow new factual assertions and capabilities for relating text to such stored assertions to generalize automatically and provide a large increment in TLC's effective knowledge of the world and in its overall ability to comprehend text.
Tagging English text with a probabilistic model
478 Citations1994Bernard Mérialdo
Cambridge University Press eBooksSemantic Interpretation and the Resolution of Ambiguity
474 Citations1987Graeme Hirst
Using WordNet to disambiguate word senses for text retrieval
441 Citations1993Ellen M. Voorhees
The IS-A links define a generalization/specialization hierarchy that is not sufficient to reliably select the correct sense of a noun from the set of fine sense distinctions in WordNet; and missing correct matches because of incorrect sense resolution has a much more deleterious effect on retrieval performance than does making spurious matches.
Computational LinguisticsUsing corpus statistics and WordNet relations for sense identification
441 Citations1998Claudia Leacock, George A. Miller +1 more
A statistical classifier is described that combines topical context with local cues to identify a word sense and is used to disambiguate a noun, a verb, and an adjective.
Cognitive ScienceMassively Parallel Parsing: A Strongly Interactive Model of Natural Language Interpretation*
432 Citations1985David L. Waltz, Jordan Pollack
This work describes a parallel model for the representation of context and of the priming of concepts in a natural language processing system with modular knowledge sources but strongly interactive processing.
ScholarlyCommons (University of Pennsylvania)Selection and information: a class-based approach to lexical relationships
432 Citations1993Philip Resnik
A new, information-theoretic account of selectional constraints is proposed, which assumes that lexical items are organized in a conceptual taxonomy according to class membership, where classes are defined simply as sets rather than in terms of explicit features or properties.
Integrating multiple knowledge sources to disambiguate word sense
410 Citations1996Hwee Tou Ng, Hian Beng Lee
This approach integrates a diverse set of knowledge sources to disambiguate word sense, including part of speech of neighboring words, morphological form, the unordered set of surrounding words, local collocations, and verb-object syntactic relation.
ACM Transactions on Information SystemsLexical ambiguity and information retrieval
407 Citations1992Robert Krovetz, W. Bruce Croft
An analysis of lexical ambiguity in information retrieval test collections and experiments to determine the utility of word meanings for separating relevant from nonrelevant documents show that there is considerable ambiguity even in a specialized database.
arXiv (Cornell University)Multi-Paragraph Segmentation of Expository Text
392 Citations1994Marti A. Hearst
Computers and the Humanities"I Don’t Believe in Word Senses"
387 Citations1997Adam Kilgarriff
It is suggested, by contrast, that wordsenses exist only relative to a task, and whether and how word sense ambiguity is infact a problem for current NLP applications is explored.
One sense per collocation
384 Citations1993David Yarowsky
This paper shows that for certain definitions of collocation, a polysemous word exhibits essentially only one sense per collocation and utilizes this property in a disambiguation algorithm that achieves precision of 92% using combined models of very local context.
Word-sense disambiguation using statistical methods
369 Citations1991Peter F. Brown, Stephen A. Della Pietra +2 more
A statistical technique for assigning senses to words is described, which incorporated into the statistical machine translation system the error rate of the system decreased by thirteen percent.
Decision lists for lexical ambiguity resolution
362 Citations1994David Yarowsky
This paper presents a statistical decision procedure for lexical ambiguity resolution that exploits both local syntactic patterns and more distant collocational evidence, generating an efficient, effective, and highly perspicuous recipe for resolving a given ambiguity.
Word sense disambiguation for free-text indexing using a massive semantic network
355 Citations1993Michael Sussna
This work investigates using the massive Word Net semantic network for disambiguation during document indexing to improve precision and improvement in disamblguation compared with chance.
Cognitive ScienceConnectionist models and their properties
345 Citations1982Jerome A. Feldman, D.H. Ballard
Text, speech and language technologyA Preferential, Pattern-Seeking, Semantics for Natural Language Inference
337 Citations2007Yorick Wilks
TINA: a natural language system for spoken language applications
327 Citations1992Stephanie Seneff
A new natural language system, TINA, has been developed for applications involving spoken language tasks that provides an automatic sentence generation capability that has been effective for identifying overgeneralization problems as well as in producing a word-pair language model for a recognizer.
Journal of Verbal Learning and Verbal BehaviorSemantic priming without association: A second look
309 Citations1984Stephen J. Lupker
Progress in Speech Synthesis
304 Citations1997Jan P. H. van Santen, Joseph P. Olive +2 more
This chapter discusses Speech Models and Speech Synthesis, which aims to bridge the gap between Speech Science and SpeechApplications and Speech applications and speech models and speech Synthesis.
MPG.PuRe (Max Planck Society)Morphology the Descriptive Analysis of Words
299 Citations1949Eugene A. Nida
The Journal of General PsychologyThe Meaning-Frequency Relationship of Words
269 Citations1945George Kingsley Zipf
Word sense disambiguation using a second language monolingual corpus
268 Citations1994Ido Dagan, Alon Itai
Memory & CognitionSemantic facilitation without association in a lexical decision task
263 Citations1977Ira Fischler
It was concluded that the encoding of a word can be facilitated by the prior processing of a semantically related word.
Using a semantic concordance for sense identification
251 Citations1994George A. Miller, Martin Chodorow +3 more
This paper proposes benchmarks for systems of automatic sense identification using a textual corpus in which open-class words had been tagged both syntactically and semantically to explore three statistical strategies for sense identification: a guessing heuristic, a most-frequent heuristic; and a co-occurrence heuristic.
Computer Speech & LanguageA comparison of the enhanced Good-Turing and deleted estimation methods for estimating probabilities of English bigrams
240 Citations1991Kenneth Church, William A. Gale
The enhanced Good-Turing method is introduced, which is three to four times as efficient in its use of data as the enhanced deleted estimate method and provides accurate predictions of the variances of the standard probabilities estimated from the test corpus.
Extracting semantic hierarchies from a large on-line dictionary
225 Citations1985Martin Chodorow, Roy J. Byrd +1 more
Automatic and semi-automatic procedures for extracting and organizing semantic feature information implicit in dictionary definitions are described and two head-finding heuristics are described for locating the genus terms in noun and verb definitions.
Journal of Verbal Learning and Verbal BehaviorThe range of automatic spreading activation in word priming
210 Citations1983Annette M.B. de Groot
Word-sense disambiguation using decomposable models
206 Citations1994Rebecca Bruce, Janyce Wiebe
This paper describes a method for formulating probabilistic models that use multiple contextual features for word-sense disambiguation, without requiring untested assumptions regarding the form of the model.
Comlex Syntax
205 Citations1994Ralph Grishman, Catherine Macleod +1 more
The design of Comlex Syntax is described, a computational lexicon providing detailed syntactic information for approximately 38,000 English headwords, and the types of errors which arise in creating such a lexicon are considered.
Introduction to EuroWordNet
195 Citations1998Piek Vossen
Communications of the ACMAn intelligent analyzer and understander of English
191 Citations1975Yorick Wilks
A working analysis and generation program for natural language, which handles paragraph length input, which is contrasted: with syntax oriented linguistic approaches, and with theorem proving approaches to the understanding problem.
Text, speech and language technologyDisambiguating Noun Groupings with Respect to WordNet Senses
186 Citations1999Philip Resnik
A method for automatic sense disambiguation of nouns appearing within sets of related nouns — the kind of data one finds in on-line thesauri, or as the output of distributional clustering algorithms.
Studies in linguistics and philosophyProviding Machine Tractable Dictionary Tools
186 Citations1993Yorick Wilks
Elsevier eBooksLexical Ambiguity Resolution
176 Citations1988
This book collects much of the best research currently available on the problem of lexical ambiguity resolution in the processing of human language from a valuable source book for cognitive scientists in AI, psycholinguistics, neuropsychology, or theoretical linguistics
Estimating upper and lower bounds on the performance of word-sense disambiguation programs
176 Citations1992William A. Gale, Kenneth Church +1 more
This paper will attempt to establish upper and lower bounds on the level of performance that can be expected in an evaluation, and finds that the upper bound is very dependent on the instructions given to the judges.
Two languages are more informative than one
167 Citations1991Ido Dagan, Alon Itai +1 more
A new approach for resolving lexical ambiguities in one language using statistical data on lexical relations in another language using a statistical model for the selection mechanism is presented.
Word sense disambiguation with very large neural networks extracted from machine readable dictionaries
160 Citations1990Jean Véronis, Nancy Ide
This paper describes a means for automatically building very large neural networks (VLNNs) from definition texts in machine-readable dictionaries, and demonstrates the use of these networks for word sense disambiguation.
Lexical disambiguation using simulated annealing
159 Citations1992Jim Cowie, Joe Guthrie +1 more
Corpus-based statistical sense resolution
155 Citations1993Claudia Leacock, Geoffrey G. Towell +1 more
Three corpus-based statistical sense resolution methods studied here attempt to infer the correct sense of a polysemous word by using knowledge about patterns of word cooccurrences, based on Bayesian decision theory, neural, networks, and content vectors.
Computers & Mathematics with ApplicationsThe existential graphs
151 Citations1992Don D. Roberts
This introduction to Charles S. Pierce's elegant logic diagrams explains the elements and operations of the Alpha and Beta parts of the system, which constitute a complete and consistent treatment of elementary logic.
Morgan Kaufmann Publishers Inc. eBooksLexical Ambiguity Resolution: Perspectives from Psycholinguistics, Neuropsychology, and Artificial Intelligence
135 Citations1988Steven L. Small, Garrison W. Cottrell +1 more
A cognitive science perspective arising out of the conjunction of work and approaches from neuropsychology, psycholinguistics, and artificial intelligence is proposed, encouraging a closer cooperation and collaboration among these fields.
Electric words dictionaries, computers, and meanings
134 Citations1996Yorick Wilks, Brian M. Slator +1 more
Journal of Memory and LanguageContext effects in word identification
132 Citations1985Walter Kintsch, Ernest F. Mross
The Structure of the Merriam-Webster Pocket Dictionary
131 Citations1980R Amsler
The structure of a dictionary, in this case the Merriam-Webster Pocket Dictionary (1970 edition), has been revealed through a series of computational operations augmented with human interpretation, and the dictionary is shown to have a fundamentally taxonomic organization for nouns and verbs.
Kluwer international series in engineering and computer scienceNaive Semantics for Natural Language Understanding
128 Citations1988Kathleen Dahlgren
The author explains how the realist Basis of NS and Kind Terms, as well as the Commonsense Knowledge used in the Preference Strategy, contributed to the development of Naive Semantics in Cognitive Psychology.
CogPrints (Cogprints)Similarity-based Word Sense Disambiguation
122 Citations1998Yael Karov, Shimon Edelman
Contextual word similarity and estimation from sparse data
122 Citations1993Ido Dagan, Shaul Marcus +1 more
A method is presented that makes local analogies between each specific unobserved cooccurrence and other cooccurrences that contain similar words, as determined by an appropriate word similarity metric, and may provide an alternative to class based models.
Similarity-based estimation of word cooccurrence probabilities
119 Citations1994Ido Dagan, Fernando Pereira +1 more
A probabilistic word association model based on distributional word similarity is described, and it is applied to improving probability estimates for unseen word bigrams in a variant of Katz's back-off model.
Semantics and The Lexicon
115 Citations1993James Pustejovsky
Cambridge University Press eBooksComputational Lexical Semantics
112 Citations1995Patrick Saint‐Dizier, Patrick Saint‐Dizier +21 more
Computational Lexical Semantics is one of the first volumes to provide models for the creation of various kinds of computerized lexicons for the automatic treatment of natural language, with applications to machine translation, automatic indexing, and database front-ends, knowledge extraction, among other things.
Co-occurrence vectors from corpora vs. distance vectors from dictionaries
112 Citations1994Yoshiki Niwa, Yoshihiko Nitta
Experimental results suggest that distance vectors contain some different semantic information from co-occurrence vectors, compared with other experimental results, which suggest that word sense disambiguation is affected by distance vectors.
A Perspective on Word Sense Disambiguation Methods and Their Evaluation
112 Citations1997Philip Resnik
This position paper makes several specific proposals to the community regarding improved evaluation criteria, common training and testing resources, and the definition of sense inventories about the state of the art in automatic word sense disambiguation.
Semantically significant patterns in dictionary definitions
100 Citations1986Judith Markowitz, Thomas Ahlswede +1 more
Methods for finding taxonomy and set-membership relationships, recognizing nouns that ordinarily represent human beings, and identifying active and stative verbs and adjectives are described.
Disambiguating prepositional phrase attachments by using on-line dictionary definitions
98 Citations1987Karen Jensen, Jean-Louis Binot
Kluwer international series in engineering and computer scienceNatural Language Processing: The PLNLP Approach
97 Citations1993Karen Jensen, George E. Heidorn +1 more
The reader is presented with the theory and application of a working, real-world, domain-free NLP system, and attempts to bridge the gap between computational and theoretical models of linguistic structure.
International Joint Conference on Artificial IntelligenceFOUL-UP: A Program that Figures Out Meanings of Words from Context.
97 Citations1977Richard Granger
Curriculum revision in UME radiology education creates both challenges and opportunities and this paper explores these issues in the context of the current paradigm change in medical education.
Computational LinguisticsTools and methods for computational lexicology
95 Citations1987Roy J. Byrd, Nicoletta Calzolari +4 more
This paper presents a set of tools and methods for acquiring, manipulating, and analyzing machine-readable dictionaries, and describes existing facilities and results they have produced as well as planned enhancements to those facilities, particularly in the area of managing associations involving the senses of polysemous words.
Text, speech and language technologyWhat is the Role of NLP in Text Retrieval?
91 Citations1999Karen Spärck Jones
It is concluded that LMI is not needed for effective retrieval, but has other important roles within information-selection systems.
Work on Statistical Methods for Word Sense Disambiguation
91 Citations1992William A. Gale, Kenneth Church +1 more
…