Data selection for NMT using Infrequent n-gram Recovery

Empreu sempre aquest identificador per citar o enllaçar aquest ítem
Información del item - Informació de l'item - Item information
Títol: Data selection for NMT using Infrequent n-gram Recovery
Autors: Parcheta, Zuzanna | Sanchis-Trilles, Germán | Casacuberta, Francisco
Paraules clau: Machine Translation
Àrees de coneixement: Lenguajes y Sistemas Informáticos
Data de publicació: 2018
Editor: European Association for Machine Translation
Citació bibliogràfica: Parcheta, Zuzanna; Sanchis-Trilles, Germán; Casacuberta, Francisco. “Data selection for NMT using Infrequent n-gram Recovery”. In: Pérez-Ortiz, Juan Antonio, et al. (Eds.). Proceedings of the 21st Annual Conference of the European Association for Machine Translation: 28-30 May 2018, Universitat d'Alacant, Alacant, Spain, pp. 219-227
Resum: Neural Machine Translation (NMT) has achieved promising results comparable with Phrase-Based Statistical Machine Translation (PBSMT). However, to train a neural translation engine, much more powerful machines are required than those required to develop translation engines based on PBSMT. One solution to reduce the training cost of NMT systems is the reduction of the training corpus through data selection (DS) techniques. There are many DS techniques applied in PBSMT which bring good results. In this work, we show that the data selection technique based on infrequent n-gram occurrence described in (Gascó et al., 2012) commonly used for PBSMT systems also works well for NMT systems. We focus our work on selecting data according to specific corpora using the previously mentioned technique. The specific-domain corpora used for our experiments are IT domain and medical domain. The DS technique significantly reduces the execution time required to train the model between 87% and 93%. Also, it improves translation quality by up to 2.8 BLEU points. The improvements are obtained with just a small fraction of the data that accounts for between 6% and 20% of the total data.
ISBN: 978-84-09-01901-4
Idioma: eng
Tipus: info:eu-repo/semantics/conferenceObject
Drets: © 2018 The authors. This article is licensed under a Creative Commons 3.0 licence, no derivative works, attribution, CC-BY-ND.
Revisió científica: si
Versió de l'editor:
Apareix a la col·lecció: Congresos - EAMT2018 - Proceedings

Arxius per aquest ítem:
Arxius per aquest ítem:
Arxiu Descripció Tamany Format  
ThumbnailEAMT2018-Proceedings_24.pdf1,56 MBAdobe PDFObrir Vista prèvia

Aquest ítem està subjecte a una llicència de Creative Commons Llicència Creative Commons Creative Commons