The Hiero machine translation system
Published 1 January 2005Open access
David Chiang, Adam Lopez, Nitin Madnani, Christof Monz, Philip Resnik, Michael Subotin
Citations47
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new hierarchical phrase-based statistical machine translation system (Chiang, 2005), presenting recent extensions to the original proposal, new evaluation results in a community-wide evaluation, and a novel technique for fine-grained comparative analysis of MT systems are discussed.
Abstract
Hierarchical organization is a well known property of language, and yet the notion of hierarchical structure has been largely absent from the best performing machine translation systems in recent community-wide evaluations. In this paper, we discuss a new hierarchical phrase-based statistical machine translation system (Chiang, 2005), presenting recent extensions to the original proposal, new evaluation results in a community-wide evaluation, and a novel technique for fine-grained comparative analysis of MT systems.
Keywords
Computer Science
Statistical phrase-based translation
3,268 Citations2003Philipp Koehn, Franz Josef Och +1 more
The empirical results suggest that the highest levels of performance can be obtained through relatively simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting of phrase translation.
Minimum error rate training in statistical machine translation
2,766 Citations2003Franz Josef Och
It is shown that significantly better results can often be obtained if the final evaluation criterion is taken directly into account as part of the training procedure.
Computer Speech & LanguageAn empirical study of smoothing techniques for language modeling
2,077 Citations1999Stanley F. Chen, Joshua Goodman
Maximum Entropy Model for Part-Of-Speech Tagging
1,276 Citations1996Adwait Ratnaparkhi
A statistical model which trains from a corpus annotated with Part Of Speech tags and assigns them to previously unseen text with state of the art accuracy and discusses the corpus consistency problems discovered during the implementation of these features.
A hierarchical phrase-based model for statistical machine translation
1,161 Citations2005David Chiang
The model is formally a synchronous context-free grammar but is learned from a bitext without any syntactic information, which can be seen as a shift to the formal machinery of syntax-based translation systems without any linguistic commitment.
Discriminative training and maximum entropy models for statistical machine translation
1,044 Citations2001Franz Josef Och, Hermann Ney
A framework for statistical machine translation of natural languages based on direct maximum entropy models, which contains the widely used source-channel approach as a special case and shows that a baseline statistical machinetranslation system is significantly improved using this approach.
Improved statistical alignment models
1,015 Citations2000Franz Josef Och, Hermann Ney
It is shown that models with a first-order dependence and a fertility model lead to significantly better results than the simple models IBM-1 or IBM-2, which are not able to go beyond zero-order dependencies.
Computational LinguisticsThe Alignment Template Approach to Statistical Machine Translation
933 Citations2004Franz Josef Och, Hermann Ney
A phrase-based statistical machine translation approach the alignment template approach is described, which allows for general many-to-many relations between words and is easier to extend than classical statistical machinetranslation systems.
Stochastic inversion transduction grammars and bilingual parsing of parallel corpora
861 Citations1997Dekai Wu
Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics
712 Citations2004Chin-Yew Lin, Franz Josef Och
Two new objective automatic evaluation methods for machine translation based on longest common subsequence between a candidate translation and a set of reference translations and relaxes strict n-gram matching to skip-bigram matching are described.
Lecture notes in computer sciencePharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models
634 Citations2004Philipp Koehn
Pharaoh, a freely available decoder for phrase-based statistical machine translation models is described, which is the implement at ion of an efficient dynamic programming search algorithm with lattice generation and XML markup for external components.
A phrase-based, joint probability model for statistical machine translation
475 Citations2002Daniel Marcu, William Wong
A joint probability model for statistical machine translation is presented, which automatically learns word and phrase equivalents from bilingual corpora, which is more accurate than translations produced using IBM Model 4.
Journal of the ACMSyntax-Directed Transduction
340 Citations1968Philip Lewis, Richard E. Stearns
Some special conditions are investigated under which syntax-directed translations can be performed on (deterministic) pushdown machines and some time bounds for translations on Turing machines are derived.
North American Chapter of the Association for Computational LinguisticsA Smorgasbord of Features for Statistical Machine Translation
260 Citations2004Franz Josef Och, Daniel Gildea +11 more
A methodology for rapid experimentation in statistical machine translation which is used to add a large number of features to a baseline system exploiting features from a wide range of levels of syntactic representation is described.
Evaluation of Machine Translation and its Evaluation
253 Citations2006Joseph Turian, Luke Shea +1 more
The unigram-based F-measure has significantly higher correlation with human judgments than recently proposed alternatives and has an intuitive graphical interpretation, which can facilitate insight into how MT systems might be improved.
Precision and recall of machine translation
227 Citations2003I. Dan Melamed, Ryan Green +1 more
Machine translation can be evaluated using precision, recall, and the F-measure, which have significantly higher correlation with human judgments than recently proposed alternatives.
Phrasal cohesion and statistical machine translation
169 Citations2002Heidi Fox
It is demonstrated that while there are cases where coherence is poor, there are many regularities which can be exploited by a statistical machine translation system.
Journal of Computer and System SciencesSyntax directed translations and the pushdown assembler
167 Citations1969Alfred V. Aho, Jeffrey D. Ullman
It is shown that there exists an infinite hierarchy of syntax-directed translations according to the number of nonterminals allowed on the right side of productions of the underlying context-free grammar.
A polynomial-time algorithm for statistical machine translation
155 Citations1996Dekai Wu
A polynomial-time algorithm for statistical machine translation that employs the stochastic bracketing transduction grammar (SBTG) model to replace earlier word alignment channel models, while retaining a bigram language model.
A decoder for syntax-based statistical MT
142 Citations2001Kenji Yamada, Kevin Knight
The model has been extended to incorporate phrasal translations as presented here, and the decoder obtained better results than IBM Model 4 in a Chinese-to-English translation system.
Evaluating translational correspondence using annotation projection
114 Citations2001Rebecca Hwa, Philip Resnik +2 more
An empirical study that quantifies the degree to which syntactic dependencies are preserved when parses are projected directly from English to Chinese and shows that although the direct correspondence assumption is often too restrictive, a small set of principled, elementary linguistic transformations can boost the quality of the projected Chinese parses by 76% relative to the unimproved baseline.
Feature-rich statistical translation of noun phrases
106 Citations2003Philipp Koehn, Kevin Knight
A dedicated noun phrase translation subsystem is built that improves over the currently best general statistical machine translation methods by incorporating special modeling and special features.
The CMU Statistical Machine Translation System
89 Citations2003Stephan Vogel, Ying Zhang +5 more
This paper describes the components of a statistical machine translation system that combines phrase-to-phrase translations extracted from a bilingual corpus using different alignment approaches and shows how a manual lexicon can be incorporated into the statistical system in an optimized way.
Pattern visualization for machine translation output
7 Citations2005Adam Lopez, Philip Resnik
This work describes a method for identifying systematic patterns in translation data using part-of-speech tag sequences and incorporates this analysis into a diagnostic tool intended for developers of machine translation systems.