Statistical machine translation
ACM Computing SurveysPublished 1 August 2008
Adam Lopez
Citations406
SJR quartileQ1
SJR score5.80
SNIP11.03
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This survey presents a tutorial overview of the state of the art of statistical machine translation, describing the context of the current research and an overview of the main subproblems: translation modeling, parameter estimation, and decoding.
Abstract
Statistical machine translation (SMT) treats the translation of natural language as a machine learning problem. By examining many samples of human-produced translation, SMT algorithms automatically learn how to translate. SMT has made tremendous strides in less than two decades, and new ideas are constantly introduced. This survey presents a tutorial overview of the state of the art. We describe the context of the current research and then move to a formal problem description and an overview of the main subproblems: translation modeling, parameter estimation, and decoding. Along the way, we present a taxonomy of some different approaches within these areas. We conclude with an overview of evaluation and a discussion of future directions.
Keywords
Computer Science
Journal of the Royal Statistical Society Series B (Statistical Methodology)Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm
49,657 Citations1977A. P. Dempster, N. M. Laird +1 more
Choice Reviews OnlineArtificial intelligence: a modern approach
22,205 Citations1995Stuart Russell, Peter Norvig +2 more
Mathematics and Computers in SimulationIntroduction to automata theory, languages and computation
10,827 Citations1981
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
Building a Large Annotated Corpus of English: The Penn Treebank
7,528 Citations1993Mitchell P. Marcus
IEEE Transactions on Information TheoryError bounds for convolutional codes and an asymptotically optimum decoding algorithm
6,705 Citations1967Andrew J. Viterbi
The upper bound is obtained for a specific probabilistic nonsequential decoding algorithm which is shown to be asymptotically optimum for rates above R_{0} and whose performance bears certain similarities to that of sequential decoding algorithms.
Moses
4,868 Citations2007Philipp Koehn, Richard Zens +12 more
An open-source toolkit for statistical machine translation whose novel contributions are support for linguistically motivated factors, confusion network decoding, and efficient data formats for translation models and language models.
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
4,165 Citations2000Daniel Jurafsky, James Martin
This book takes an empirical approach to language processing, based on applying statistical and other machine-learning algorithms to large corpora, to demonstrate how the same algorithm can be used for speech recognition and word-sense disambiguation.
The mathematics of statistical machine translation: parameter estimation
4,125 Citations1993Peter F. Brown, Vincent J. Della Pietra +2 more
It is reasonable to argue that word-by-word alignments are inherent in any sufficiently large bilingual corpus, given a set of pairs of sentences that are translations of one another.
Computational LinguisticsA Systematic Comparison of Various Statistical Alignment Models
3,928 Citations2003Franz Josef Och, Hermann Ney
An important result is that refined alignment models with a first-order dependence and a fertility model yield significantly better results than simple heuristic models.
Statistical phrase-based translation
3,268 Citations2003Philipp Koehn, Franz Josef Och +1 more
The empirical results suggest that the highest levels of performance can be obtained through relatively simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting of phrase translation.
Computational LinguisticsA maximum entropy approach to natural language processing
3,120 Citations1996Adam Berger, Vincent J. Della Pietra +1 more
A maximum-likelihood approach for automatically constructing maximum entropy models is presented and how to implement this approach efficiently is described, using as examples several problems in natural language processing.
Europarl: A Parallel Corpus for Statistical Machine Translation
3,106 Citations2005Philipp Koehn
A corpus of parallel text in 11 languages from the proceedings of the European Parliament is collected and its acquisition and application as training data for statistical machine translation (SMT) is focused on.
Class-based n -gram models of natural language
2,893 Citations1992Peter F. Brown, P.V. deSouza +3 more
This work addresses the problem of predicting a word from previous words in a sample of text and discusses n-gram models based on classes of words, finding that these models are able to extract classes that have the flavor of either syntactically based groupings or semanticallybased groupings, depending on the nature of the underlying statistics.
ACM SIGACT NewsIntroduction to the Theory of Computation
2,792 Citations1996Michael Sipser
Throughout the book, Sipser builds students' knowledge of conceptual tools used in computer science, the aesthetic sense they need to create elegant systems, and the ability to think through problems on their own.
Minimum error rate training in statistical machine translation
2,766 Citations2003Franz Josef Och
It is shown that significantly better results can often be obtained if the final evaluation criterion is taken directly into account as part of the training procedure.
A Study of Translation Edit Rate with Targeted Human Annotation
2,402 Citations2006Matthew Snover, Bonnie J. Dorr +3 more
A new, intuitive measure for evaluating machine translation output that avoids the knowledge intensiveness of more meaning-based approaches, and the labor-intensiveness of human judgments is defined.
Computer Speech & LanguageAn empirical study of smoothing techniques for language modeling
2,077 Citations1999Stanley F. Chen, Joshua Goodman
Journal of the American Statistical AssociationStatistical Methods for Speech Recognition
1,988 Citations1999Don X. Sun, Frederick Jelinek
The speech recognition problem hidden Markov models the acoustic model basic language modelling the Viterbi search hypothesis search on a tree and the fast match elements of information theory.
A statistical approach to machine translation
1,699 Citations1990Peter F. Brown, John Cocke +6 more
The application of the statistical approach to translation from French to English and preliminary results are described and the results are given.
Automatic evaluation of machine translation quality using n-gram co-occurrence statistics
1,605 Citations2002George R. Doddington
NIST commissioned NIST to develop an MT evaluation facility based on the IBM work, which is now available from NIST and serves as the primary evaluation measure for TIDES MT research.
Statistical Significance Tests for Machine Translation Evaluation.
1,465 Citations2004Philipp Koehn
The Annals of Mathematical StatisticsGeneralized Iterative Scaling for Log-Linear Models
1,203 Citations1972J. N. Darroch, D. Ratcliff
Computational LinguisticsHierarchical Phrase-Based Translation
1,164 Citations2007David Chiang
A statistical machine translation model that uses hierarchical phrasesphrases that contain subphrasing that is formally a synchronous context-free grammar but is learned from a parallel text without any syntactic annotations is presented.
A hierarchical phrase-based model for statistical machine translation
1,161 Citations2005David Chiang
The model is formally a synchronous context-free grammar but is learned from a bitext without any syntactic information, which can be seen as a shift to the formal machinery of syntax-based translation systems without any linguistic commitment.
Discriminative training and maximum entropy models for statistical machine translation
1,044 Citations2001Franz Josef Och, Hermann Ney
A framework for statistical machine translation of natural languages based on direct maximum entropy models, which contains the widely used source-channel approach as a special case and shows that a baseline statistical machinetranslation system is significantly improved using this approach.
A program for aligning sentences in bilingual corpora
956 Citations1993William A. Gale, Kenneth Church
This paper will describe a method and a program for aligning sentences based on a simple statistical model of character lengths, which uses the fact that longer sentences in one language tend to be translated into longer sentence in the other language, and that shorter sentences tend to been translated into shorter sentences.
Computational LinguisticsThe Alignment Template Approach to Statistical Machine Translation
933 Citations2004Franz Josef Och, Hermann Ney
A phrase-based statistical machine translation approach the alignment template approach is described, which allows for general many-to-many relations between words and is easier to extend than classical statistical machinetranslation systems.
Cambridge University Press eBooksStatistical Machine Translation
850 Citations2009Philipp Koehn
This introductory text to statistical machine translation (SMT) provides all of the theories and methods needed to build a statistical machine translator, such as Google Language Tools and Babelfish, and the companion website provides open-source corpora and tool-kits.
HMM-based word alignment in statistical translation
829 Citations1996Stephan Vogel, Hermann Ney +1 more
A new model for word alignment in statistical translation using a first-order Hidden Markov model for the word alignment problem as they are used successfully in speech recognition for the time alignment problem.
An empirical study of smoothing techniques for language modeling
754 Citations1996Stanley F. Chen, Joshua Goodman
A syntax-based statistical translation model
736 Citations2001Kenji Yamada, Kevin Knight
This model transforms a source-language parse tree into a target-language string by applying stochastic operations at each node, and produces word alignments that are better than those produced by IBM Model 5.
Tree-Adjoining Grammars
715 Citations1997Aravind K. Joshi, Yves Schabes
A tree generating system called tree-adjoining grammar (TAG) is described and a number of formal results have been established for TAGs, which are of interest to researchers in formal languages and automata, including those interested in tree grammars and tree automata.
Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics
712 Citations2004Chin-Yew Lin, Franz Josef Och
Two new objective automatic evaluation methods for machine translation based on longest common subsequence between a candidate translation and a set of reference translations and relaxes strict n-gram matching to skip-bigram matching are described.
Computer Speech & LanguageApplications of stochastic context-free grammars using the Inside-Outside algorithm
666 Citations1991Kimia Bazargan Lari, S. Young
Two applications in speech recognition of the use of stochastic context-free grammars trained automatically via the Inside-Outside Algorithm, used to model VQ encoded speech for isolated word recognition and compared directly to HMMs used for the same task are described.
Lecture notes in computer sciencePharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models
634 Citations2004Philipp Koehn
Pharaoh, a freely available decoder for phrase-based statistical machine translation models is described, which is the implement at ion of an efficient dynamic programming search algorithm with lattice generation and XML markup for external components.
Re-evaluating the Role of Bleu in Machine Translation Research
621 Citations2006Chris Callison-Burch, Miles Osborne +1 more
It is shown that an improved Bleu score is neither necessary nor sufficient for achieving an actual improvement in translation quality, and two significant counterexamples to Bleu’s correlation with human judgments of quality are given.
Clause restructuring for statistical machine translation
619 Citations2005Michael Collins, Philipp Koehn +1 more
The reordering approach is applied as a pre-processing step in both the training and decoding phases of a phrase-based statistical MT system, showing an improvement from 25.2% Bleu score for a baseline system to 26.8% Blee score for the system with reordering.
Large Language Models in Machine Translation
550 Citations2007Thorsten Brants, Ashok C. Popat +3 more
Systems, methods, and computer program products for machine translation are provided for backoff score determination as a function of a backoff factor and a relative frequency of a corresponding backoff n-gram in the corpus.
Paraphrasing with bilingual parallel corpora
547 Citations2005Colin Bannard, Chris Callison-Burch
This work defines a paraphrase probability that allows paraphrases extracted from a bilingual parallel corpus to be ranked using translation probabilities, and shows how it can be refined to take contextual information into account.
Computational LinguisticsThe Web as a Parallel Corpus
525 Citations2003Philip Resnik, Noah A. Smith
The use of supervised learning based on structural features of documents to improve classification performance, a new content-based measure of translational equivalence, and adaptation of the system to take advantage of the Internet Archive for mining parallel text from the Web on a large scale are presented.
Edinburgh Research Explorer (University of Edinburgh)Factored Translation Models
509 Citations2007Philipp Koehn, Hieu Hoang
In a number of experiments, it is shown that factored translation models lead to better translation performance, both in terms of automatic scores, as well as more grammatical coherence.
Inducing multilingual text analysis tools via robust projection across aligned corpora
497 Citations2001David Yarowsky, Grace Ngai +1 more
Noise-robust tagger, bracketer and lemmatizer training procedures capable of accurate system bootstrapping from noisy and incomplete initial projections are presented, which significantly exceeds that obtained by direct annotation projection.
RWTH Publications (RWTH Aachen)Improved Alignment Models for Statistical Machine Translation
482 Citations1999Franz Josef Och, Christoph Tillmann +1 more
Improved alignment models for statistical machine translation are described and experimental results are presented using the Verbmobil task (German-English, 6000word vocabulary) which is a limited-domain spoken-language task.
Tagging English text with a probabilistic model
478 Citations1994Bernard Mérialdo
A phrase-based, joint probability model for statistical machine translation
475 Citations2002Daniel Marcu, William Wong
A joint probability model for statistical machine translation is presented, which automatically learns word and phrase equivalents from bilingual corpora, which is more accurate than translations produced using IBM Model 4.
What's in a Translation Rule
465 Citations2004Michel Galley, Mark Hopkins +2 more
The theory is used to introduce a linear algorithm that can be used to derive from word-aligned, parallel corpora the minimal set of syntactically motivated transformation rules that explain human translation data.
Learning structured prediction models
462 Citations2005Ben Taskar, Vassil Chatalbashev +2 more
This work considers large margin estimation in a broad range of prediction models where inference involves solving combinatorial optimization problems, for example, weighted graph-cuts or matchings, and relies on the expressive power of convex optimization problems to compactly capture inference or solution optimality in structured prediction models.
Alignment by agreement
433 Citations2006Percy Liang, Ben Taskar +1 more
An unsupervised approach to symmetric word alignment in which two simple asymmetric models are trained jointly to maximize a combination of data likelihood and agreement between the models.
ScholarlyCommons (University of Pennsylvania)Maximum entropy models for natural language ambiguity resolution
432 Citations1998Adwait Ratnaparkhi, Mitchell P. Marcus
This thesis demonstrates that several important kinds of natural language ambiguities can be resolved to state-of-the-art accuracies using a single statistical modeling technique based on the principle of maximum entropy.
Scalable inference and training of context-rich syntactic translation models
418 Citations2006Michel Galley, Jonathan Graehl +5 more
This paper takes the framework for acquiring multi-level syntactic translation rules of (Galley et al., 2004) from aligned tree-string pairs, and presents two main extensions of their approach: instead of merely computing a single derivation that minimally explains a sentence pair, a large number of derivations that include contextually richer rules, and account for multiple interpretations of unaligned words.
(Meta-) evaluation of machine translation
385 Citations2007Chris Callison-Burch, Cameron Shaw Fordyce +3 more
An extensive human evaluation was carried out not only to rank the different MT systems, but also to perform higher-level analysis of the evaluation process, revealing surprising facts about the most commonly used methodologies.
Computer Speech & LanguageThe estimation of stochastic context-free grammars using the Inside-Outside algorithm
380 Citations1990Kimia Bazargan Lari, S. Young
A novel pre-training algorithm is described which can give significant computational savings and the need for controlling the way that non-terminals are allocated to hidden processes is discussed and a solution is presented in the form of a grammar minimization procedure.
Dependency treelet translation
380 Citations2005Chris Quirk, Arul Menezes +1 more
An efficient decoder is described and it is shown that using these tree-based models in combination with conventional SMT models provides a promising approach that incorporates the power of phrasal SMT with the linguistic generality available in a parser.
Lecture notes in computer sciencePhrase-Based Statistical Machine Translation
365 Citations2002Richard Zens, Franz Josef Och +1 more
A translation model that is based on bilingual phrases to explicitly model the local context is presented and it is shown that this model performs better than the single-word based model.
Improving Statistical Machine Translation Using Word Sense Disambiguation
350 Citations2007Marine Carpuat, Dekai Wu
This paper investigates a new strategy for integrating WSD into an SMT system, that performs fully phrasal multi-word disambiguation, and provides the first known empirical evidence that lexical semantics are indeed useful for SMT, despite claims to the contrary.
Journal of the ACMSyntax-Directed Transduction
340 Citations1968Philip Lewis, Richard E. Stearns
Some special conditions are investigated under which syntax-directed translations can be performed on (deterministic) pushdown machines and some time bounds for translations on Turing machines are derived.
Natural Language EngineeringBootstrapping parsers via syntactic projection across parallel texts
339 Citations2005Rebecca Hwa, Philip Resnik +3 more
Using parallel text to help solving the problem of creating syntactic annotation in more languages by annotating the English side of a parallel corpus, project the analysis to the second language, and train a stochastic analyzer on the resulting noisy annotations.
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)Minimum Bayes-risk decoding for statistical machine translation
330 Citations2004Shankar Kumar, Bill Byrne
The results show that MBR decoding can be used to tune statistical MT performance for specific loss functions, and a hierarchy of loss functions that incorporate different levels of linguistic information from word strings, word-to-word alignments from an MT system, and syntactic structure from parse-trees of source and target language sentences.
Better<i>k</i>-best parsing
300 Citations2005Liang Huang, David Chiang
It is shown how the improved output of the efficient algorithms for k-best trees in the framework of hypergraph parsing has the potential to improve results from parse reranking systems and other applications.
Computational LinguisticsThe mathematics of statistical machine translation
299 Citations1993F BrownPeter, PietraVincent J. Della +2 more
A series of five statistical models of the translation process are described and algorithms for estimating the parameters of these models given a set of pairs of sentences that are translations are given.
Identifying word correspondence in parallel texts
297 Citations1991William A. Gale, Kenneth Church
Researchers in both machine translation and bilingual lexicography have recently become interested in studying parallel texts, bodies of text which are available in multiple languages and who outline a self-organizing method for using these parallel texts to build a machine translation system.
Improved statistical machine translation using paraphrases
295 Citations2006Chris Callison-Burch, Philipp Koehn +1 more
This work shows how techniques from paraphrasing can be used to deal with otherwise unknown source language phrases and shows that augmenting a state-of-the-art SMT system with paraphrases leads to significantly improved coverage and translation quality.
Synchronous tree-adjoining grammars
293 Citations1990Stuart M. Shieber, Yves Schabes
A variant of TAGs is presented, called synchronous TAGs, which characterize correspondences between languages, to allow TAGs to be used beyond their role in syntax proper.
Forest Rescoring: Faster Decoding with Integrated Language Models
290 Citations2007Liang Huang, David Chiang
This work develops faster approaches for efficient decoding based on k-best parsing algorithms and demonstrates their effectiveness on both phrase-based and syntax-based MT systems.
Word Sense Disambiguation Improves Statistical Machine Translation
277 Citations2007Yee Seng Chan, Hwee Tou Ng +1 more
It is shown for the first time that integrating a WSD system improves the performance of a state-of-the-art statistical MT system on an actual translation task, and the improvement is statistically significant.
Manual and automatic evaluation of machine translation between European languages
276 Citations2006Philipp Koehn, Christof Monz
This work evaluated machine translation performance for six European language pairs that participated in a shared task: translating French, German, Spanish texts to English and back.
Computational LinguisticsModels of Translational Equivalence among Words
269 Citations2000I. Dan Melamed
This article presents methods for biasing statistical translation models to reflect bitext properties, and shows how a statistical translation model can take advantage of preexisting knowledge that might be available about particular language pairs.
An end-to-end discriminative approach to machine translation
265 Citations2006Percy Liang, Alexandre Bouchard‐Côté +2 more
A perceptron-style discriminative approach to machine translation in which large feature sets can be exploited and a novel way to introduce learning into the initial phrase extraction process, which has previously been entirely heuristic.
Characterizing structural descriptions produced by various grammatical formalisms
262 Citations1987K. Vijay‐Shanker, David Weir +1 more
It is found that several of the formalisms considered can be seen as being closely related since they have derivation tree sets with the same structure as those produced by Context-Free Grammars.
North American Chapter of the Association for Computational LinguisticsA Smorgasbord of Features for Statistical Machine Translation
260 Citations2004Franz Josef Och, Daniel Gildea +11 more
A methodology for rapid experimentation in statistical machine translation which is used to add a large number of features to a baseline system exploiting features from a wide range of levels of syntactic representation is described.
Decoding complexity in word-replacement translation models
259 Citations1999Kevin Knight
Computational LinguisticsWord Reordering and a Dynamic Programming Beam Search Algorithm for Statistical Machine Translation
257 Citations2003Christoph Tillmann, Hermann Ney
A novel technique to restrict the possible word reorderings between source and target language in order to achieve an efficient search algorithm for statistical machine translation based on dynamic programming (DP).
Maximum entropy based phrase reordering model for statistical machine translation
254 Citations2006Deyi Xiong, Qun Liu +1 more
A novel reordering model for phrase-based statistical machine translation (SMT) that uses a maximum entropy (MaxEnt) model to predicate reorderings of neighbor blocks (phrase pairs) that obtains significant improvements in BLEU score on the NIST MT-05 and IWSLT-04 tasks.
Evaluation of Machine Translation and its Evaluation
253 Citations2006Joseph Turian, Luke Shea +1 more
The unigram-based F-measure has significantly higher correlation with human judgments than recently proposed alternatives and has an intuitive graphical interpretation, which can facilitate insight into how MT systems might be improved.
Inducing multilingual POS taggers and NP bracketers via robust projection across aligned corpora
247 Citations2001David Yarowsky, Grace Ngai
This paper investigates the potential for projecting linguistic annotations including part-of-speech tags and base noun phrase bracketings from one language to another via automatically word-aligned parallel corpora.
Fast decoding and optimal decoding for machine translation
234 Citations2001Ulrich Germann, Michael Jahr +3 more
This paper compares the speed and output quality of a traditional stack-based decoding algorithm with two new decoders: a fast greedy decoder and a slow but optimal decoder that treats decoding as an integer-programming optimization problem.
Precision and recall of machine translation
227 Citations2003I. Dan Melamed, Ryan Green +1 more
Machine translation can be evaluated using precision, recall, and the F-measure, which have significantly higher correlation with human judgments than recently proposed alternatives.
Chinese Syntactic Reordering for Statistical Machine Translation
216 Citations2007Chao Wang, Michael J. Collins +1 more
A set of syntactic reordering rules that exploit systematic differences between Chinese and English word order are described, which are used as a preprocessor for both training and test sentences, transforming Chinese sentences to be much closer to English in terms of their word order.
A comparison of alignment models for statistical machine translation
214 Citations2000Franz Josef Och, Hermann Ney
The quality of an alignment model is proposed to be measured using the quality of the Viterbi alignment compared to a manually-produced alignment and a refined annotation scheme to produce suitable reference alignments is described.
Computational LinguisticsMeasuring Word Alignment Quality for Statistical Machine Translation
208 Citations2007Alexander Fraser, Daniel Marcu
This paper explains the state of affairs of the alignment task and presents steps towards measuring alignment quality in a way which is predictive of statistical machine translation performance.
Discriminative Reranking for Machine Translation
207 Citations2004Libin Shen, Anoop Sarkar +1 more
This paper describes the application of discriminative reranking techniques to the problem of machine translation and introduces two novel perceptroninspired reranking algorithms that improve on the quality of machinetranslation over the baseline system based on evaluation using the BLEU metric.
An evaluation exercise for word alignment
205 Citations2003Rada Mihalcea, Ted Pedersen
The task definition, resources, participating systems, and comparative results for the shared task on word alignment, which was organized as part of the HLT/NAACL 2003 Workshop on Building and Using Parallel Texts, are presented.
Empirical Methods in Natural Language ProcessingImproving Translation Quality by Discarding Most of the Phrasetable
201 Citations2007Howard Johnson, Joel Martin +2 more
It is possible to reduce the bulk of phrasetables for Statistical Machine Translation using a technique based on the significance testing of phrase pair co-occurrence in the parallel corpus and an improvement in BLEU is obtained at the same time although the effect is less pronounced if state-of-the-art phrasetic smoothing is employed.
A statistical parser for Czech
197 Citations1999Michael Collins, Lance Ramshaw +2 more
This paper considers statistical parsing of Czech, which differs radically from English in at least two respects: (1) it is a highly inflected language, and (2) it has relatively free word order.
An efficient method for determining bilingual word classes
197 Citations1999Franz Josef Och
A method to determine bilingual word classes suitable for statistical machine translation is described, an optimization criterion based on a maximum-likelihood approach is developed and a clustering algorithm is described.
ScholarlyCommons (University of Pennsylvania)The Convergence of Mildly Context-Sensitive Grammar Formalisms
191 Citations1990Aravind K. Joshi, K. Vijay‐Shanker +1 more
North American Chapter of the Association for Computational LinguisticsImprovements in Phrase-Based Statistical Machine Translation
186 Citations2004Richard Zens, Hermann Ney
A highly efficient monotone search algorithm with a complexity linear in the input sentence length is described and translated results for three tasks: Verbmobil, Xerox and the Canadian Hansards are presented.
Online Large-Margin Training for Statistical Machine Translation
184 Citations2007Taro Watanabe, Jun Suzuki +2 more
Experiments on Arabic-toEnglish translation indicated that a model trained with sparse binary features outperformed a conventional SMT system with a small number of features.
Improving statistical MT through morphological analysis
170 Citations2005Sharon Goldwater, David McClosky
This work shows that using morphological analysis to modify the Czech input can improve a Czech-English machine translation system, and investigates several different methods of incorporating morphological information, and shows that a system that combines these methods yields the best results.
Phrasal cohesion and statistical machine translation
169 Citations2002Heidi Fox
It is demonstrated that while there are cases where coherence is poor, there are many regularities which can be exploited by a statistical machine translation system.
Journal of Computer and System SciencesSyntax directed translations and the pushdown assembler
167 Citations1969Alfred V. Aho, Jeffrey D. Ullman
It is shown that there exists an infinite hierarchy of syntax-directed translations according to the number of nonterminals allowed on the right side of productions of the underlying context-free grammar.
A discriminative matching approach to word alignment
166 Citations2005Ben Taskar, Simon Lacoste-Julien +1 more
This work presents a discriminative, large-margin approach to feature-based matching for word alignment, which achieves AER performance close to IBM Model 4, in much less time.
Exploiting Syntactic Structure for Language Modeling
164 Citations1998Ciprian Chelba, Frederick Jelinek
Computational LinguisticsStatistical Machine Translation with Scarce Resources Using Morpho-syntactic Information
163 Citations2004Sonja Nießen, Hermann Ney
The construction of hierarchical lexicon models on the basis of equivalence classes of words are proposed and sentence-level restructuring transformations which aim at the assimilation of word order in related sentences are introduced.
A polynomial-time algorithm for statistical machine translation
155 Citations1996Dekai Wu
A polynomial-time algorithm for statistical machine translation that employs the stochastic bracketing transduction grammar (SBTG) model to replace earlier word alignment channel models, while retaining a bigram language model.
Machine TranslationGood applications for crummy machine translation
153 Citations1993Kenneth Church, Eduard Hovy
It is concluded that it is difficult to identify a satisfying evaluation paradigm that will make sense over all possible applications and it is probably wise to identify the application first, and then it will be in a much better position to address evaluation questions.
…