Comparing Irt Properties of Different Likert Scale Lengths: a Case From Attitudinal Measurement on Physics Education Research
Year: 2023
Type: preprint
Abstract: Collapsing Likert scale length on attitudinal measurement toward learning and instruction can be an option by physics education researchers (PER) while interpreting categorical responses from participants. Psychometric evaluation of the different scale length, however, has inconclusive results to date. Item response theory (IRT) offers advanced information at the item level that has been approached in this simulation study to explore psychometric properties of five different Likert scale lengths. The total of 1000 artificial data were generated within five scale variations based on the underlying marginal distribution and inter item correlation matrix. Three parameters (item parameters, global fit indices, and test information functions (TIFs)) from Graded Response Model (GRM) were calculated to compare psychometric behaviors of the observed Likert scale length. Our findings demonstrated the discrimination indices among the five scale lengths remain constant. Global fit indices have no distinguishable information to differentiate the varying points. Based on item endorsement and TIFs, our simulation results confirmed previous works that more information will be raised by the greater number of Likert scale points. The implication intended by this study should provide a key recommendation for a case from attitudinal measurement on the PER community or even beyond the psychometric field.
Source: Research Square
Institution: Yogyakarta State University
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W4328107229