A Comment on ‘‘The J Index as a Measure of Nominal Scale Response Agreement’’
Year: 2009
Type: article
Abstract: V arious authors have proposed agreement indices for measuring nominal scale response agreement between two judges. Two situations may occur. Either the categories of the nominal scale are defined in advance and both raters use the same categories, or the categories are not defined in advance and the number of categories used by each rater is different. For the former case, the kappa statistic by Cohen (1960) is a popular measure. For the latter case, agreement measures have been proposed by Brennan and Light (1974), Hubert (1977), and Janson and Vegelius (1978, 1982). Hubert’s (1977) G is a monotonic function of the index by Brennan and Light (1974) and may be derived directly as a correlational index of agreement. Janson and Vegelius (1982) discussed some appealing properties of Hubert’s G: It is a special case of DanielKendall’s generalized correlation coefficient, and it satisfies the requirement of a scalar product between normalized vectors in a Euclidean space. Janson and Vegelius (1982) also noted several less desirable characteristics of Hubert’s G:
Author: Matthijs J. Warrens
Institution: Leiden University
Language: English
Subfield: Statistics, Probability and Uncertainty
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W2115816322
