Stand-off Annotation of Web Content as a Legally Safer Alternative to Crawling for Distribution
Please use this identifier to cite or link to this item:
http://hdl.handle.net/10045/62549
Title: | Stand-off Annotation of Web Content as a Legally Safer Alternative to Crawling for Distribution |
---|---|
Authors: | Forcada, Mikel L. | Esplà-Gomis, Miquel | Pérez-Ortiz, Juan Antonio |
Research Group/s: | Transducens |
Center, Department or Service: | Universidad de Alicante. Departamento de Lenguajes y Sistemas Informáticos |
Keywords: | Bitext | Parallel text | Stand-off annotation | Legal issues | Statistical machine translation |
Knowledge Area: | Lenguajes y Sistemas Informáticos |
Issue Date: | 2016 |
Publisher: | University of Latvia |
Citation: | Baltic Journal of Modern Computing. 2016, 4(2): 152-164 |
Abstract: | Sentence-aligned web-crawled parallel text or bitext is frequently used to train statistical machine translation systems. To that end, web-crawled sentence-aligned bitext sets are sometimes made publicly available and distributed by translation technologies practitioners. Contrary to what may be commonly believed, distribution of web-crawled text is far from being free from legal implications, and may sometimes actually violate the usage restrictions. As the distribution and availability of sentence-aligned bitext is key to the development of statistical machine translation systems, this paper proposes an alternative: instead of copying and distributing copies of web content in the form of sentence-aligned bitext, one could distribute a legally safer stand-off annotation of web content, that is, files that identify where the aligned sentences are, so that end users can use this annotation to privately recrawl the bitexts. The paper describes and discusses the legal and technical aspects of this proposal, and outlines an implementation. |
Sponsor: | Funding from the European Union Seventh Framework Programme FP7/2007-2013 under grant agreement PIAP-GA-2012-324414 (Abu-MaTran) is acknowledged. |
URI: | http://hdl.handle.net/10045/62549 |
ISSN: | 2255-8942 (Print) | 2255-8950 (Online) |
Language: | eng |
Type: | info:eu-repo/semantics/article |
Rights: | Creative Commons Attribution-ShareAlike 4.0 International license |
Peer Review: | si |
Publisher version: | http://www.bjmc.lu.lv/ |
Appears in Collections: | INV - TRANSDUCENS - Artículos de Revistas Research funded by the EU |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
2016_Forcada_etal_BalticJModernComputing.pdf | 216,07 kB | Adobe PDF | Open Preview | |
This item is licensed under a Creative Commons License