Learning Bilingual Lexicons from Monolingual Corpora
Published 1 June 2008
Aria Haghighi, Percy Liang, Taylor Berg-Kirkpatrick, Dan Klein
Citations312
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown that high-precision lexicons can be learned in a variety of language pairs and from a range of corpus types.
Abstract
We present a method for learning bilingual translation lexicons from monolingual corpora. Word types in each language are characterized by purely monolingual features, such as context counts and orthographic substrings. Translations are induced using a generative model based on canonical correlation analysis, which explains the monolingual lexicons in terms of latent matchings. We show that high-precision lexicons can be learned in a variety of language pairs and from a range of corpus types. 1
Keywords
Computer Science
Naval Research Logistics QuarterlyThe Hungarian method for the assignment problem
12,574 Citations1955Harold W. Kuhn
Neural ComputationCanonical Correlation Analysis: An Overview with Application to Learning Methods
3,304 Citations2004David R. Hardoon, Sándor Szedmák +1 more
A general method using kernel canonical correlation analysis to learn a semantic representation to web images and their associated text and compares orthogonalization approaches against a standard cross-representation retrieval technique known as the generalized vector space model is presented.
Europarl: A Parallel Corpus for Statistical Machine Translation
3,106 Citations2005Philipp Koehn
A corpus of parallel text in 11 languages from the proceedings of the European Parliament is collected and its acquisition and application as training data for statistical machine translation (SMT) is focused on.
Theoretical Computer ScienceThe complexity of computing the permanent
2,759 Citations1979Leslie G. Valiant
It is shown that the permanent function of (0, 1)-matrices is a complete problem for the class of counting problems associated with nondeterministic polynomial time computations.
Unsupervised word sense disambiguation rivaling supervised methods
2,408 Citations1995David Yarowsky
An unsupervised learning algorithm for sense disambiguation that, when trained on unannotated English text, rivals the performance of supervised techniques that require time-consuming hand annotations.
Lecture notes in computer sciencePharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models
634 Citations2004Philipp Koehn
Pharaoh, a freely available decoder for phrase-based statistical machine translation models is described, which is the implement at ion of an efficient dynamic programming search algorithm with lattice generation and XML markup for external components.
A Probabilistic Interpretation of Canonical Correlation Analysis
435 Citations2005Francis Bach, Michael I. Jordan
A probabilistic interpretation of canonical correlation (CCA) analysis as a latent variable model for two Gaussian random vectors for Fisher linear discriminant analysis within the CCA framework is given.
Scalable inference and training of context-rich syntactic translation models
418 Citations2006Michel Galley, Jonathan Graehl +5 more
This paper takes the framework for acquiring multi-level syntactic translation rules of (Galley et al., 2004) from aligned tree-string pairs, and presents two main extensions of their approach: instead of merely computing a single derivation that minimally explains a sentence pair, a large number of derivations that include contextually richer rules, and account for multiple interpretations of unaligned words.
Automatic tagging of Arabic text
311 Citations2004Mona Diab, Kadri Hacıoğlu +1 more
A Support Vector Machine (SVM) based approach to automatically tokenize, tag and annotate base phrases (BPs) in Arabic text and adapt highly accurate tools that have been developed for English text and apply them to Arabic text.
Learning a translation lexicon from monolingual corpora
226 Citations2002Philipp Koehn, Kevin Knight
This paper presents work on the task of constructing a word-level translation lexicon purely from unrelated monolingual corpora and combines various clues such as cognates, similar context, preservation of word similarity, and word frequency to create a German-English noun lexicon.
Columbia Academic Commons (Columbia University)Compiling Bilingual Lexicon Entries From a Non-Parallel English-Chinese Corpus
139 Citations1995Pascale Fung
A novel context heterogeneity similarity measure between words and their translations in helping to compile bilingual lexicon entries from a non-parallel English-Chinese corpus is proposed and it is suggested that words with productive context in one language translate to words withproductive context in another language.
Annealing structural bias in multilingual weighted grammar induction
77 Citations2006Noah A. Smith, Jason Eisner
This work shows how a structural locality bias can improve the accuracy of state-of-the-art dependency grammar induction models trained by EM from unannotated examples, and annealing the free parameter that controls this bias achieves further improvements.
Agreement-Based Learning
40 Citations2007Percy Liang, Dan Klein +1 more
An objective function is proposed for the approach, EM-style algorithms for parameter estimation are derived, and their effectiveness on three challenging real-world learning tasks is demonstrated.