Work

Measurement issues in determining interrater agreement.

Year: 2002
Type: dissertation
Abstract: Multiple indices have been proposed claiming to measure the amount of agreement between ratings of two or more judges on a multi-item measure. Unfortunately, simulation work based on these indices is lacking; thus we are left with very little understanding of exactly what should be expected of these indices and when they should work. The present investigation seeks to bridge this gap in the literature by comparing several of the more commonly used measures of interrater agreement via an Item Response Theory (IRT) model. The goal is to identify which agreement indices best recover true agreement.
Author: Vincent, Andrea Harrell.
Language: English
Open Access status: green
OpenAlex ID: W7048891458
Cites: 38
Cited by:
Related to: 9