Statistical semi-supervised system for grading multiple peer-reviewed open-ended works
Empreu sempre aquest identificador per citar o enllaçar aquest ítem
http://hdl.handle.net/10045/77831
Títol: | Statistical semi-supervised system for grading multiple peer-reviewed open-ended works |
---|---|
Autors: | Rico-Juan, Juan Ramón | Gallego, Antonio-Javier | Valero-Mas, Jose J. | Calvo-Zaragoza, Jorge |
Grups d'investigació o GITE: | Reconocimiento de Formas e Inteligencia Artificial |
Centre, Departament o Servei: | Universidad de Alicante. Departamento de Lenguajes y Sistemas Informáticos |
Paraules clau: | Computer-aided assessment | Automated grading | Open-ended works |
Àrees de coneixement: | Lenguajes y Sistemas Informáticos |
Data de publicació: | de novembre-2018 |
Editor: | Elsevier |
Citació bibliogràfica: | Computers & Education. 2018, 126: 264-282. doi:10.1016/j.compedu.2018.07.017 |
Resum: | In the education context, open-ended works generally entail a series of benefits as the possibility of develop original ideas and a more productive learning process to the student rather than closed-answer activities. Nevertheless, such works suppose a significant correction workload to the teacher in contrast to the latter ones that can be self-corrected. Furthermore, such workload turns to be intractable with large groups of students. In order to maintain the advantages of open-ended works with a reasonable amount of correction effort, this article proposes a novel methodology: students perform the corrections using a rubric (closed Likert scale) as a guideline in a peer-review fashion; then, their markings are automatically analyzed with statistical tools to detect possible biased scorings; finally, in the event the statistical analysis detects a biased case, the teacher is required to intervene to manually correct the assignment. This methodology has been tested on two different assignments with two heterogeneous groups of people to assess the robustness and reliability of the proposal. As a result, we obtain values over 95% in the confidence of the intra-class correlation test (ICC) between the grades computed by our proposal and those directly resulting from the manual correction of the teacher. These figures confirm that the evaluation obtained with the proposed methodology is statistically similar to that of the manual correction of the teacher with a remarkable decrease in terms of effort. |
Patrocinadors: | This work has been supported by the Vicerrectorado de Calidad e Innovación Educativa-Instituto de Ciencias de la Educación of the Universidad de Alicante (2016-17 edition) through the Programa de Redes-I3CE de investigación en docencia universitaria (ref. 3690). |
URI: | http://hdl.handle.net/10045/77831 |
ISSN: | 0360-1315 (Print) | 1873-782X (Online) |
DOI: | 10.1016/j.compedu.2018.07.017 |
Idioma: | eng |
Tipus: | info:eu-repo/semantics/article |
Drets: | © 2018 Elsevier Ltd. |
Revisió científica: | si |
Versió de l'editor: | https://doi.org/10.1016/j.compedu.2018.07.017 |
Apareix a la col·lecció: | INV - GRFIA - Artículos de Revistas |
Arxius per aquest ítem:
Arxiu | Descripció | Tamany | Format | |
---|---|---|---|---|
2018_Rico-Juan_etal_CompEdu_final.pdf | Versión final (acceso restringido) | 2,76 MB | Adobe PDF | Obrir Sol·licitar una còpia |
2018_Rico-Juan_etal_CompEdu_accepted.pdf | Accepted Manuscript (acceso abierto) | 1,32 MB | Adobe PDF | Obrir Vista prèvia |
Tots els documents dipositats a RUA estan protegits per drets d'autors. Alguns drets reservats.