Is three better than one? simulating the effect of reviewer selection and behavior on the quality and efficiency of peer review
Year: 2015
Type: conference-paper
Abstract: This paper looks at the effect of multiple reviewers and their behavior on the quality and efficiency of peer review. By extending a previous model, we tested various reviewer behavior, fair, random and strategic, and examined the impact of selecting multiple reviewers for the same author submission. We found that, when reviewer reliability is random or reviewers behave strategically, involving more than one reviewer per submission reduces evaluation bias. However, if scientists review scrupulously, multiple reviewers require an abnormal resource drain at the system level from research activities towards reviewing. This implies that reviewer selection mechanisms that protect the quality of the process against reviewer misbehavior might be economically unsustainable.
Source: Winter Simulation Conference
Authors: Federico Bianchi, Flaminio Squazzoni
Institution: University of Brescia
Language: English
Subfield: History and Philosophy of Science
Field: Arts and Humanities
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W4247089812