Statistical semi-supervised system for grading multiple peer-reviewed open-ended works

Please use this identifier to cite or link to this item: http://hdl.handle.net/10045/77831
Información del item - Informació de l'item - Item information
Title: Statistical semi-supervised system for grading multiple peer-reviewed open-ended works
Authors: Rico Juan, Juan Ramón | Gallego, Antonio-Javier | Valero Mas, José Javier | Calvo-Zaragoza, Jorge
Research Group/s: Reconocimiento de Formas e Inteligencia Artificial
Center, Department or Service: Universidad de Alicante. Departamento de Lenguajes y Sistemas Informáticos
Keywords: Computer-aided assessment | Automated grading | Open-ended works
Knowledge Area: Lenguajes y Sistemas Informáticos
Issue Date: Nov-2018
Publisher: Elsevier
Citation: Computers & Education. 2018, 126: 264-282. doi:10.1016/j.compedu.2018.07.017
Abstract: In the education context, open-ended works generally entail a series of benefits as the possibility of develop original ideas and a more productive learning process to the student rather than closed-answer activities. Nevertheless, such works suppose a significant correction workload to the teacher in contrast to the latter ones that can be self-corrected. Furthermore, such workload turns to be intractable with large groups of students. In order to maintain the advantages of open-ended works with a reasonable amount of correction effort, this article proposes a novel methodology: students perform the corrections using a rubric (closed Likert scale) as a guideline in a peer-review fashion; then, their markings are automatically analyzed with statistical tools to detect possible biased scorings; finally, in the event the statistical analysis detects a biased case, the teacher is required to intervene to manually correct the assignment. This methodology has been tested on two different assignments with two heterogeneous groups of people to assess the robustness and reliability of the proposal. As a result, we obtain values over 95% in the confidence of the intra-class correlation test (ICC) between the grades computed by our proposal and those directly resulting from the manual correction of the teacher. These figures confirm that the evaluation obtained with the proposed methodology is statistically similar to that of the manual correction of the teacher with a remarkable decrease in terms of effort.
Sponsor: This work has been supported by the Vicerrectorado de Calidad e Innovación Educativa-Instituto de Ciencias de la Educación of the Universidad de Alicante (2016-17 edition) through the Programa de Redes-I3CE de investigación en docencia universitaria (ref. 3690).
URI: http://hdl.handle.net/10045/77831
ISSN: 0360-1315 (Print) | 1873-782X (Online)
DOI: 10.1016/j.compedu.2018.07.017
Language: eng
Type: info:eu-repo/semantics/article
Rights: © 2018 Elsevier Ltd.
Peer Review: si
Publisher version: https://doi.org/10.1016/j.compedu.2018.07.017
Appears in Collections:INV - GRFIA - Artículos de Revistas

Files in This Item:
Files in This Item:
File Description SizeFormat 
Thumbnail2018_Rico-Juan_etal_CompEdu_final.pdfVersión final (acceso restringido)2,76 MBAdobe PDFOpen    Request a copy
Thumbnail2018_Rico-Juan_etal_CompEdu_accepted.pdfEmbargo 36 meses (acceso abierto: 20 jul. 2021)1,32 MBAdobe PDFOpen    Request a copy


Items in RUA are protected by copyright, with all rights reserved, unless otherwise indicated.