A Comparison of Cohen's Kappa and Agreement Coefficients by Corrado Gini
Year: 2013
Type: article
Abstract: The paper compares four coefficients that can be used to summarize inter-rater agreement on a nominal scale.The coefficients are Cohen's kappa and three coefficients that were originally proposed by the Italian statistician Corrado Gini.All four coefficients have zero value if the two nominal variables are statistically independent, and value unity if there is perfect agreement.The coefficients are compared both analytically and empirically.An ordering between the four coefficients is formally proved.It turns out that Cohen's kappa is a lower bound of the other coefficients.Moreover, it is shown that the point estimates of Cohen's kappa and the two smallest of Gini's coefficients are very similar for real data.We conclude that these three coefficients lead to the same conclusions about the degree of inter-rater agreement in practice.
Author: Matthijs J. Warrens
Institution: Leiden University
Language: English
Subfield: Statistics, Probability and Uncertainty
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
Award: Properties of weighted kappa
OpenAlex ID: W2184066413
