Work

A Comparison of Cohen's Kappa and Agreement Coefficients by Corrado Gini

Year: 2013
Type: article
Abstract: The paper compares four coefficients that can be used to summarize inter-rater agreement on a nominal scale.The coefficients are Cohen's kappa and three coefficients that were originally proposed by the Italian statistician Corrado Gini.All four coefficients have zero value if the two nominal variables are statistically independent, and value unity if there is perfect agreement.The coefficients are compared both analytically and empirically.An ordering between the four coefficients is formally proved.It turns out that Cohen's kappa is a lower bound of the other coefficients.Moreover, it is shown that the point estimates of Cohen's kappa and the two smallest of Gini's coefficients are very similar for real data.We conclude that these three coefficients lead to the same conclusions about the degree of inter-rater agreement in practice.
Institution: Leiden University
Language: English
Open Access status: green
OpenAlex ID: W2184066413
FWCI: 0.999
Cites: 58
Cited by: 17
Related to: 9