An intraclass correlation coefficient is a correlation: A tutorial
Year: 2026
Type: preprint
Abstract: The intraclass correlation coefficient (ICC) is widely used to assess reliability, agreement, and consistency for quantitative measurements. Despite being termed a ``correlation'', its definition and interpretation can be ambiguous because the ICC is commonly computed using variance components, a procedure that may obscure its conceptual foundations as a measure of correlation. In this tutorial paper, we aim to clarify the conceptual foundations of the ICC and its relationship to correlation by establishing a consistent way of conceptualizing ICCs through simulations. We illustrate various forms of ICCs under the one-way nested, two-way crossed, and three-level fully nested random-effects models, and show how they can be interpreted as correlations between two hypothetical replicates of the measurement process. To make this concept intuitive, we introduce a visual grammar that maps out the data-generating mechanisms. We then use Monte Carlo simulations to empirically verify that this correlation approach perfectly converges with variance-based ICC formulas. Ultimately, this tutorial provides researchers with an intuitive conceptual compass to seamlessly understand, select, and interpret appropriate ICCs across diverse experimental designs.
Source: PsyArXiv (OSF Preprints)
Language: English
Subfield: Statistics, Probability and Uncertainty
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7167372988
