Investigating Backtranslation in Neural Machine Translation

Please use this identifier to cite or link to this item:
Información del item - Informació de l'item - Item information
Title: Investigating Backtranslation in Neural Machine Translation
Authors: Poncelas, Alberto | Shterionov, Dimitar | Way, Andy | Maillette de Buy Wenniger, Gideon | Passban, Peyman
Keywords: Machine Translation
Knowledge Area: Lenguajes y Sistemas Informáticos
Issue Date: 2018
Publisher: European Association for Machine Translation
Citation: Poncelas, Alberto, et al. “Investigating Backtranslation in Neural Machine Translation”. In: Pérez-Ortiz, Juan Antonio, et al. (Eds.). Proceedings of the 21st Annual Conference of the European Association for Machine Translation: 28-30 May 2018, Universitat d'Alacant, Alacant, Spain, pp. 249-258
Abstract: A prerequisite for training corpus-based machine translation (MT) systems – either Statistical MT (SMT) or Neural MT (NMT) – is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT has been shown in many studies to outperform SMT, but mostly when large parallel corpora are available; in cases where data is limited, SMT can still outperform NMT. Recently researchers have shown that back-translating monolingual data can be used to create synthetic parallel corpora, which in turn can be used in combination with authentic parallel data to train a high-quality NMT system. Given that large collections of new parallel text become available only quite rarely, back-translation has become the norm when building state-of-the-art NMT systems, especially in resource-poor scenarios. However, we assert that there are many unknown factors regarding the actual effects of back-translated data on the translation capabilities of an NMT model. Accordingly, in this work we investigate how using back-translated data as a training corpus – both as a separate standalone dataset as well as combined with human-generated parallel data – affects the performance of an NMT model. We use incrementally larger amounts of back-translated data to train a range of NMT systems for German-to-English, and analyse the resulting translation performance.
Sponsor: This research has been supported by the ADAPT Centre for Digital Content Technology which is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund. This work has also received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 713567.
ISBN: 978-84-09-01901-4
Language: eng
Type: info:eu-repo/semantics/conferenceObject
Rights: © 2018 The authors. This article is licensed under a Creative Commons 3.0 licence, no derivative works, attribution, CC-BY-ND.
Peer Review: si
Publisher version:
Appears in Collections:Congresos - EAMT2018 - Proceedings
Research funded by the EU

Files in This Item:
Files in This Item:
File Description SizeFormat 
ThumbnailEAMT2018-Proceedings_27.pdf1,7 MBAdobe PDFOpen Preview

This item is licensed under a Creative Commons License Creative Commons