Year: 2025
Type: article
Abstract: This study investigates the estimation of classification consistency and accuracy indices for composite summed and theta scores within the SS‐MIRT framework, using five popular approaches, including the Lee, Rudner, Guo, Bayesian EAP, and Bayesian MCMC approaches. The procedures are illustrated through analysis of two real datasets and further evaluated via a simulation study under various conditions. Overall, results indicated that all five approaches performed well, producing classification indices estimates that were highly consistent in both magnitude and pattern. However, the results also indicated that factors such as the ability estimator, score metric, and cut score location can significantly influence estimation outcomes. Consequently, these considerations should guide practitioners in selecting the most appropriate estimation approach for their specific assessment context.
DOI: 10.1111/jedm.70006
Authors: Huan Liu, Won‐Chan Lee
Institution: University of Iowa
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: hybrid
Estimated APC paid: $3,040
OpenAlex ID: W4414028947