Automatic detection of inconsistencies between numerical scores and textual feedback in peer-assessment processes with machine learning
Por favor, use este identificador para citar o enlazar este ítem:
http://hdl.handle.net/10045/93789
Registro completo de metadatos
Campo DC | Valor | Idioma |
---|---|---|
dc.contributor | Reconocimiento de Formas e Inteligencia Artificial | es_ES |
dc.contributor.author | Rico-Juan, Juan Ramón | - |
dc.contributor.author | Gallego, Antonio-Javier | - |
dc.contributor.author | Calvo-Zaragoza, Jorge | - |
dc.contributor.other | Universidad de Alicante. Departamento de Lenguajes y Sistemas Informáticos | es_ES |
dc.date.accessioned | 2019-07-04T10:24:00Z | - |
dc.date.available | 2019-07-04T10:24:00Z | - |
dc.date.issued | 2019-10 | - |
dc.identifier.citation | Computers & Education. 2019, 140: 103609. doi:10.1016/j.compedu.2019.103609 | es_ES |
dc.identifier.issn | 0360-1315 (Print) | - |
dc.identifier.issn | 1873-782X (Online) | - |
dc.identifier.uri | http://hdl.handle.net/10045/93789 | - |
dc.description.abstract | The use of peer assessment for open-ended activities has advantages for both teachers and students. Teachers might reduce the workload of the correction process and students achieve a better understanding of the subject by evaluating the activities of their peers. In order to ease the process, it is advisable to provide the students with a rubric over which performing the assessment of their peers; however, restricting themselves to provide only numerical scores is detrimental, as it prevents providing valuable feedback to others peers. Since this assessment produces two modalities of the same evaluation, namely numerical score and textual feedback, it is possible to apply automatic techniques to detect inconsistencies in the evaluation, thus minimizing the teachers' workload for supervising the whole process. This paper proposes a machine learning approach for the detection of such inconsistencies. To this end, we consider two different approaches, each of which is tested with different algorithms, in order to both evaluate the approach itself and find appropriate models to make it successful. The experiments carried out with 4 groups of students and 2 types of activities show that the proposed approach is able to yield reliable results, thus representing a valuable approach for ensuring a fair operation of the peer assessment process. | es_ES |
dc.description.sponsorship | The present work was supported through "Redes-I3CE de investigación en docencia universitaria" programme from "Instituto de Ciencias de la Educación de la Universidad de Alicante" (Ref.: REDES-I3CE-2018-4302). | es_ES |
dc.language | eng | es_ES |
dc.publisher | Elsevier | es_ES |
dc.rights | © 2019 Elsevier Ltd. | es_ES |
dc.subject | Peer assessment | es_ES |
dc.subject | Open-ended works | es_ES |
dc.subject | Computer-aided assessment | es_ES |
dc.subject | Machine learning | es_ES |
dc.subject | Natural language processing | es_ES |
dc.subject.other | Lenguajes y Sistemas Informáticos | es_ES |
dc.title | Automatic detection of inconsistencies between numerical scores and textual feedback in peer-assessment processes with machine learning | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.peerreviewed | si | es_ES |
dc.identifier.doi | 10.1016/j.compedu.2019.103609 | - |
dc.relation.publisherversion | https://doi.org/10.1016/j.compedu.2019.103609 | es_ES |
dc.rights.accessRights | info:eu-repo/semantics/openAccess | es_ES |
Aparece en las colecciones: | INV - GRFIA - Artículos de Revistas |
Archivos en este ítem:
Archivo | Descripción | Tamaño | Formato | |
---|---|---|---|---|
2019_Rico-Juan_etal_CompEdu_final.pdf | Versión final (acceso restringido) | 880,17 kB | Adobe PDF | Abrir Solicitar una copia |
2019_Rico-Juan_etal_CompEdu_accepted.pdf | Accepted Manuscript (acceso abierto) | 1,17 MB | Adobe PDF | Abrir Vista previa |
Todos los documentos en RUA están protegidos por derechos de autor. Algunos derechos reservados.