Reading Comprehension of Machine Translation Output: What Makes for a Better Read?
Please use this identifier to cite or link to this item:
http://hdl.handle.net/10045/76032
Title: | Reading Comprehension of Machine Translation Output: What Makes for a Better Read? |
---|---|
Authors: | Castilho, Sheila | Guerberof Arenas, Ana |
Keywords: | Machine Translation |
Knowledge Area: | Lenguajes y Sistemas Informáticos |
Issue Date: | 2018 |
Publisher: | European Association for Machine Translation |
Citation: | Castilho, Sheila; Guerberof Arenas, Ana. “Reading Comprehension of Machine Translation Output: What Makes for a Better Read?”. In: Pérez-Ortiz, Juan Antonio, et al. (Eds.). Proceedings of the 21st Annual Conference of the European Association for Machine Translation: 28-30 May 2018, Universitat d'Alacant, Alacant, Spain, pp. 79-88 |
Abstract: | This paper reports on a pilot experiment that compares two different machine translation (MT) paradigms in reading comprehension tests. To explore a suitable methodology, we set up a pilot experiment with a group of six users (with English, Spanish and Simplified Chinese languages) using an English Language Testing System (IELTS), and an eye-tracker. The users were asked to read three texts in their native language: either the original English text (for the English speakers) or the machine-translated text (for the Spanish and Simplified Chinese speakers). The original texts were machine-translated via two MT systems: neural (NMT) and statistical (SMT). The users were also asked to rank satisfaction statements on a 3-point scale after reading each text and answering the respective comprehension questions. After all tasks were completed, a post-task retrospective interview took place to gather qualitative data. The findings suggest that the users from the target languages completed more tasks in less time with a higher level of satisfaction when using translations from the NMT system. |
Sponsor: | This research was supported by the Edge Research Fellowship programme that has received funding from the European Unions Horizon 2020 and innovation programme under the Marie Sklodowska-Curie grant agreement No. 713567, and by the ADAPT Centre for Digital Content Technology, funded under the SFI Research Centres Programme (Grant 13/RC/2106) and co-funded under the European Regional Development Fund. |
URI: | http://hdl.handle.net/10045/76032 |
ISBN: | 978-84-09-01901-4 |
Language: | eng |
Type: | info:eu-repo/semantics/conferenceObject |
Rights: | © 2018 The authors. This article is licensed under a Creative Commons 3.0 licence, no derivative works, attribution, CC-BY-ND. |
Peer Review: | si |
Publisher version: | http://eamt2018.dlsi.ua.es/proceedings-eamt2018.pdf |
Appears in Collections: | EAMT2018 - Proceedings Research funded by the EU |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
EAMT2018-Proceedings_10.pdf | 1,61 MB | Adobe PDF | Open Preview | |
This item is licensed under a Creative Commons License