Sense discrimination with parallel corpora
Published 1 January 2002Open access
Nancy Ide, Tomaž Erjavec, Dan Tufiş
Citations101
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An experiment that uses translation equivalents derived from parallel corpora to determine sense distinctions that can be used for automatic sense-tagging and other disambiguation tasks shows that sense distinctions derived from cross-lingual information are at least as reliable as those made by human annotators.
Abstract
This paper describes an experiment that uses translation equivalents derived from parallel corpora to determine sense distinctions that can be used for automatic sense-tagging and other disambiguation tasks. Our results show that sense distinctions derived from cross-lingual information are at least as reliable as those made by human annotators. Because our approach is fully automated through all its steps, it could provide means to obtain large samples of "sense-tagged" data without the high cost of human annotation.
Keywords
Computer Science
International Journal of LexicographyIntroduction to WordNet: An On-line Lexical Database<sup>*</sup>
4,207 Citations1990George A. Miller, Richard Beckwith +3 more
Standard alphabetical procedures for organizing lexical information put together words that are spelled alike and scatter words with similar or related meanings haphazardly through the list.
arXiv (Cornell University)Assessing agreement on classification tasks: the kappa statistic
2,092 Citations1996Jean Carletta
Computers and the HumanitiesA method for disambiguating word senses in a large corpus
534 Citations1992William A. Gale, Kenneth Church +1 more
The proposed method was designed to disambiguate senses that are usually associated with different topics using a Bayesian argument that has been applied successfully in related tasks such as author identification and information retrieval.
Word sense disambiguation using a second language monolingual corpus
268 Citations1994Ido Dagan, Alon Itai
Decision Support SystemsPartitioning-based clustering for Web document categorization
261 Citations1999Daniel Boley, Maria Gini +7 more
Two new clustering algorithms are introduced that can effectively cluster documents, even in the presence of a very high dimensional feature space, and do not require pre-specified ad hoc distance functions and are capable of automatically discovering document similarities or associations.
Natural Language EngineeringDistinguishing systems and distinguishing senses: new evaluation methods for Word Sense Disambiguation
231 Citations1999Philip Resnik, David Yarowsky
A new in-depth empirical study of translingually-based sense inventories and distance measures, using statistics collected from native-speaker annotations of 222 polysemous contexts across 12 languages, shows that monolingual sense distinctions at most levels of granularity can be effectively captured by translations into some set of second languages.
Two languages are more informative than one
167 Citations1991Ido Dagan, Alon Itai +1 more
A new approach for resolving lexical ambiguities in one language using statistical data on lexical relations in another language using a statistical model for the selection mechanism is presented.
Computers and the HumanitiesThe Bible as a Parallel Corpus: Annotating the ‘Book of 2000 Tongues’
127 Citations1999Philip Resnik, Mari Broman Olsen +1 more
A project to annotate biblical texts in order to create an aligned multilingual Bible corpus for linguistic research, particularly computational linguistics, including automatically creating and evaluating translation lexicons and semantically tagged texts is reported on.
A Perspective on Word Sense Disambiguation Methods and Their Evaluation
112 Citations1997Philip Resnik
This position paper makes several specific proposals to the community regarding improved evaluation criteria, common training and testing resources, and the definition of sense inventories about the state of the art in automatic word sense disambiguation.
A Case Study on Inter-Annotator Agreement for Word Sense Disambiguation
69 Citations1999Hwee Tou Ng, Chung Yong Lim +1 more
This paper examines th~s msue by comparing the agreement rate on a large corpus of more than 30,000 sense-tagged instances of the WORDNET Semcor corpus and the DSO corpus, which has been independently tagged by two separate groups of human annotators.
Taking the load off the conference chairs-towards a digital paper-routing assistant
46 Citations1999David Yarowsky, Radu Florian
A system for the automatic routing of submitted papers to reviewers and area committees is described and evaluated, without the need for any human annotation from the reviewers or the program chair, and achieves system accuracy approaching that of several human judges on the same task.
The MULTEXT East corpus
42 Citations1998Tomaž Erjavec, Nancy Ide
The MULTEXT-East multilingual corpus, which comprises marked-up texts in the six languages totaling approximately 2 million words and a small speech corpus, is introduced.
Computers and the HumanitiesCross-Lingual Sense Determination: Can It Work?
37 Citations2000Nancy Ide
Automatic Sense Tagging Using Parallel Corpora.
25 Citations2001Nancy Ide, Tomaž Erjavec +1 more
An analysis of translation equivalents in six languages from different language families extracted from an on-line parallel corpus of George Orwell’s Nineteen Eighty-Four shows that sense distinctions derived from crosslingual information correspond to those made by human annotators, especially at the coarse-grained level.
International Journal of Speech TechnologyRevealing Translators' Knowledge: Statistical Methods in Constructing Practical Translation Lexicons for Language and Speech Processing
15 Citations2002Dan Tufiş, Ana Maria Barbu
A program is described that exploits the knowledge embedded in the parallel corpora and produces a set of translation equivalents (a translation lexicon) using almost no linguistic knowledge, relying on statistical evidence and some simplifying assumptions.
Automatic Construction of Translation Lexicons
5 Citations2001Dan Tufiş, Ana-maria Barbu
A statistical approach to automatic extraction of translation lexicons from parallel corpora such that expressions appearing in corresponding parts of the two texts are reciprocal translations, and the method is faster and at least as accurate as any similar algorithm the authors know of.