Improving Arabic-Chinese statistical machine translation using English as pivot language
Published 1 January 2009Open access
Nizar Habash, Jun Hu
Citations51
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A comparison of two approaches for Arabic-Chinese machine translation using English as a pivot language: sentence pivoting and phrase-table pivoting shows that using Englishas a pivot in either approach outperforms direct translation from Arabic to Chinese.
Abstract
We present a comparison of two approaches for Arabic-Chinese machine translation using English as a pivot language: sentence pivoting and phrase-table pivoting. Our results show that using English as a pivot in either approach outperforms direct translation from Arabic to Chinese. Our best result is the phrase-pivot system which scores higher than direct translation by 1.1 BLEU points. An error analysis of our best system shows that we successfully handle many complex Arabic-Chinese syntactic variations.
Keywords
Computer ScienceBiochemistry, Genetics and Molecular Biology
Computational LinguisticsA Systematic Comparison of Various Statistical Alignment Models
3,928 Citations2003Franz Josef Och, Hermann Ney
An important result is that refined alignment models with a first-order dependence and a fertility model yield significantly better results than simple heuristic models.
Minimum error rate training in statistical machine translation
2,766 Citations2003Franz Josef Och
It is shown that significantly better results can often be obtained if the final evaluation criterion is taken directly into account as part of the training procedure.
Lecture notes in computer sciencePharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models
634 Citations2004Philipp Koehn
Pharaoh, a freely available decoder for phrase-based statistical machine translation models is described, which is the implement at ion of an efficient dynamic programming search algorithm with lattice generation and XML markup for external components.
Lattice-based minimum error rate training for statistical machine translation
352 Citations2008Wolfgang Macherey, Franz Josef Och +2 more
A novel algorithm is presented that allows for efficiently constructing and representing the exact error surface of all translations that are encoded in a phrase lattice and is used to train the feature function weights of a phrase-based statistical machine translation system.
Text, speech and language technologyOn Arabic Transliteration
309 Citations2007Nizar Habash, Abdelhadi Soudi +1 more
This chapter introduces the transliteration scheme used to represent Arabic characters in this book and presents guidelines for Arabic pronunciation using this transliterations scheme.
Improved statistical machine translation using paraphrases
295 Citations2006Chris Callison-Burch, Philipp Koehn +1 more
This work shows how techniques from paraphrasing can be used to deal with otherwise unknown source language phrases and shows that augmenting a state-of-the-art SMT system with paraphrases leads to significantly improved coverage and translation quality.
Chinese Syntactic Reordering for Statistical Machine Translation
216 Citations2007Chao Wang, Michael J. Collins +1 more
A set of syntactic reordering rules that exploit systematic differences between Chinese and English word order are described, which are used as a preprocessor for both training and test sentences, transforming Chinese sentences to be much closer to English in terms of their word order.
Machine TranslationPivot language approach for phrase-based statistical machine translation
213 Citations2007Hua Wu, Haifeng Wang
This paper proposes a novel method for phrase-based statistical machine translation based on the use of a pivot language, using BLEU as a metric, that significantly outperforms the standard model trained on a small bilingual corpus.
A Comparison of Pivot Methods for Phrase-Based Statistical Machine Translation
181 Citations2007Masao Utiyama, Hitoshi Isahara
The phrase translation strategy significantly outperformed the sentence translation strategy and its relative performance was 0.92 to 0.97 compared to directly trained SMT systems.
Morphological analysis for statistical machine translation
177 Citations2004Young‐Suk Lee
A novel morphological analysis technique which induces a morphological and syntactic symmetry between two languages with highly asymmetrical morphological structures to improve statistical machine translation qualities.
Interpreting BLEU/NIST Scores: How Much Improvement Do We Need to Have a Better System?
165 Citations2004Ying Zhang, Stephan Vogel +1 more
A novel method of calculating the confidence intervals for BLEU/NIST scores using bootstrapping is reported, which can determine whether two MT systems are significantly different from each other.
Rule-based translation with statistical phrase-based post-editing
150 Citations2007Michel Simard, Nicola Ueffing +2 more
A machine translation system based on an automatic post-editing strategy: initially translate the input text into the target-language using a rule-based MT system, then automatically post-edit the output using a statistical phrase-based system.
Distortion models for statistical machine translation
124 Citations2006Yaser Al-Onaizan, Kishore Papineni
A new distortion model is proposed that can be used with existing phrase-based SMT decoders to address n-gram language model limitations and a novel metric to measure word order similarity (or difference) between any pair of languages based on word alignments is proposed.
Inducing translation lexicons via diverse similarity measures and bridge languages
89 Citations2002Charles Schafer, David Yarowsky
The algorithm successfully combines temporal occurrence similarity across dates in news corpora, wide and local cross-language context similarity, weighted Levenshtein distance, relative frequency and burstiness similarity measures to induce translation lexicons between two distant languages without the need for either parallel bilingual corpora or a direct bilingual seed dictionary.
Syntactic preprocessing for statistical machine translation.
85 Citations2007Nizar Habash
Combination of Arabic preprocessing schemes for statistical machine translation
84 Citations2006Fatiha Sadat, Nizar Habash
This paper studies the effect of different word-level preprocessing schemes for Arabic on the quality of phrase-based statistical machine translation and presents and evaluates different methods for combining pre processing schemes resulting in improved translation quality.
Improving Word Alignment with Bridge Languages
53 Citations2007Shankar Kumar, Franz Josef Och +1 more
An approach to improve Statistical Machine Translation performance using multi-lingual, parallel, sentence-aligned corpora in several bridge languages and experiments are presented showing that multilingual, parallel text in Spanish, French, Russian, and Chinese can be utilized in this framework to improve translation performance on an Arabic-to-English task.
Text-Translation Alignment: Three Languages Are Better Than Two.
43 Citations1999Michel Simard
Experiments on a trilingual corpus demonstrate that this bilingual texttranslation alignment method can be adapted to deal with more than two versions of a text and yields better bilingual alignments than can be obtained with bilingual textalignment methods.
Context-dependent phrasal translation lexicons for statistical machine translation
29 Citations2007Marine Carpuat, Dekai Wu
It is argued here that it is necessary to design a contextdependent lexicon that is specifically matched to a given phrase-based SMT model, rather than simply incorporating an independently built and tested WSD module.
Syntax-enhanced n-gram-based SMT.
24 Citations2007Josep Crego, José Bernardo Mariño Acebal
Leveraging multiple languages to improve statistical MT word alignments
12 Citations2005Karim Filali, Jeffrey A. Bilmes
A new multilingual statistical MT word alignment model based on a simple extension of the IBM and HMM models and a two-step alignment procedure that shows a 7% relative improvement over a state of the art alignment model.
Aspect marker generation in English-to-Chinese machine translation.
8 Citations2007Yang Ye, Karl-Michael Schneider +1 more