Assessing the Reliability of Peer Evaluation of Undergraduate Research Papers Through the Use of Generalizability Theory
Year: 2012
Type: preprint
Abstract: Educational researchers have long espoused the virtues of writing with regard to student cognitive skills. However, unlike objective tests, the grading of essays is time consuming. Therefore, peer evaluations have become an increasingly common method by which faculty can integrate written assignments without substantially increasing their workload. Although research into the reliability and validity of peer evaluations has found mixed results, most evidence supports the use of peer evaluations. Unfortunately, these studies frequently committed one or more analytical flaws. The present study employed Generalizability Theory to estimate reliability and a paired t-test to assess validity. The results showed peer evaluation was reliable but its validity was questionable. A new method for computing the minimum acceptable reliability was also introduced.
Source: SSRN Electronic Journal
Authors: Mihaiela Ristei Gugiu, P. Cristian Gugiu
Institution: The Ohio State University
Language: English
Subfield: Education
Field: Social Sciences
Domain: Social Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W95021943