Year: 2016
Type: article
Abstract: Peer grading is widely used in MOOCs and in standard university settings.\nThe quality of grades obtained via peer grading is essential for the educational process. In this work, we study the factors that influence errors in\npeer grading. We analyze 288 assignments with 25,633 submissions and 113,169 reviews conducted with CrowdGrader, a web based peer grading tool. First, we found that large grading errors are generally more closely correlated with hard-to-grade submission, rather than with imprecise students. Second, we detected a weak correlation between review accuracy and student proficiency, as measured by the quality of the student's own work. Third, we found little correlation between review accuracy and the time it took to perform the review, or how late in the review period the review was performed. Finally, we found a clear evidence of tit-for-tat behavior when students give feedback on the reviews they received. We conclude with remarks on how these data can lead to improvements in peer-grading tools.
Authors: Luca de Alfaro, Michael Shavlovsky
Institution: University of California, Santa Cruz
Language: English
Subfield: Computer Science Applications
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: green
Funder: National Science Foundation
OpenAlex ID: W2494317914