Fully Automatic Compilation of Portuguese-English and Portuguese-Spanish Parallel Corpora

Published 1 January 2011

Wilker Aziz, Lucia Specia

Citations18

TL;DR

This paper reports the fully automatic compilation of parallel cor- pora for Brazilian Portuguese, where scientific news texts available in Brazilian Por- tuguese, English and Spanish are automatically crawled from a multilingual Brazilian magazine.

Abstract

This paper reports the fully automatic compilation of parallel cor- pora for Brazilian Portuguese. Scientific news texts available in Brazilian Por- tuguese, English and Spanish are automatically crawled from a multilingual Brazilian magazine. The texts are then automatically aligned at document- and sentence-level. The resulting corpora contain about 2,700 parallel documents totaling over 150,000 aligned sentences each. The quality of the corpora and their usefulness are tested in an experiment with machine translation.

Keywords

Computer Science

BLEU

21,523 Citations2001Kishore Papineni, Salim Roukos +2 more

This work proposes a method of automatic machine translation evaluation that is quick, inexpensive, and language-independent, that correlates highly with human evaluation, and that has little marginal cost per run.

View PDF

Moses

4,868 Citations2007Philipp Koehn, Richard Zens +12 more

An open-source toolkit for statistical machine translation whose novel contributions are support for linguistically motivated factors, confusion network decoding, and efficient data formats for translation models and language models.

View PDF

The mathematics of statistical machine translation: parameter estimation

4,125 Citations1993Peter F. Brown, Vincent J. Della Pietra +2 more

It is reasonable to argue that word-by-word alignments are inherent in any sufficiently large bilingual corpus, given a set of pairs of sentences that are translations of one another.

Statistical phrase-based translation

3,268 Citations2003Philipp Koehn, Franz Josef Och +1 more

The empirical results suggest that the highest levels of performance can be obtained through relatively simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting of phrase translation.

View PDF

A hierarchical phrase-based model for statistical machine translation

1,161 Citations2005David Chiang

The model is formally a synchronous context-free grammar but is learned from a bitext without any syntactic information, which can be seen as a shift to the formal machinery of syntax-based translation systems without any linguistic commitment.

View PDF

Machine TranslationAutomatic induction of bilingual resources from aligned parallel corpora: application to shallow-transfer machine translation

39 Citations2006Helena de Medeiros Caseli, Maria das Graças Volpe Nunes +1 more

A methodology to build automatically both bilingual dictionaries and shallow-transfer rules by extracting knowledge from word-aligned parallel corpora processed with shallow monolingual resources (morphological analysers, and part-of-speech taggers) is described.

The Prague Bulletin of Mathematical LinguisticsCombining Content-Based and URL-Based Heuristics to Harvest Aligned Bitexts from Multilingual Sites with Bitextor

38 Citations2010Miquel Esplà-Gomis, Mikel L. Forcada

The free/open-source tool Bitextor is described, created to harvest aligned bitexts from these multilingual websites, which may be used to train corpus-based machine translation systems.

View PDF

Towards better machine translation quality for the German--English language pairs

31 Citations2008Philipp Koehn, Abhishek Arun +1 more

The Edinburgh submissions to the shared task of the Third Workshop on Statistical Machine Translation (WMT-2008) incorporate recent advances to the open source Moses system, leading to substantial improvements on the German--English and English--German language pairs.

View PDF

A Program for Aligning English and Norwegian Sentences

19 Citations1995Knut Hofland

Building a Spanish-Portuguese parallel corpus for statistical machine translation

4 Citations2008Wilker Aziz, Thiago Alexandre Salgueiro Pardo +1 more

The efforts to build a parallel corpus for the Brazilian Portuguese and European Spanish languages are described, representing a first step towards the development of translation models for this language pair.