Beyond classical test theory-assessing function using item response theory/computer adaptive testing
Year: 2016
Type: article
Abstract: Issue/problem The U.S. Social Security Administration (SSA) disability programs receive nearly 3 million new applications per year and must conduct periodic reviews of existing beneficiaries. Resource constraint coupled with the sheer size of the SSA disability programs demands innovative approaches to more fully inform decisions about work disability. Description of the problem Functional assessment surveys consistent with classical test theory require administration of a fixed set of questions to produce a total score, regardless of question relevancy to the respondent. Comprehensive assessment of whole person functioning across relevant activity domains would require a lengthy question set, potentially burdensome to respondents. To enhance instrument precision, classically-based assessments must narrowly define target populations, reducing generalizability and utility among populations possessing a range of health conditions and functional levels. We wanted to know if it would be feasible to develop a self-report instrument that systematically, comprehensively, and efficiently assessed functional activity. Over the course of 7 years, the National Institutes of Health and Boston University developed a 313-item instrument using item response theory (IRT) and computer adaptive testing technology (CAT). Results The Work Disability Functional Assessment Batter (WD-FAB) covers 4 mental domains (mood and emotions; resilience/sociability; self-regulation; and, cognition/communication) and 4 physical health domains (basic mobility; upper body function; fine motor function; and, community mobility). Lessons The WD-FAB uses IRT/CAT methods to increase instrument precision and efficiency and produce 8 sub-domain scores in approximately 15 minutes. These scores may be tracked over time and used to detect aberrant response patterns. Key messages: IRT/CAT is a promising approach to quickly and comprehensively collect self-reported function IRT/CAT scores may be examined over time to identify changes in function and aberrant responses
Authors: C McDonough, D Brandt, L Chan
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: bronze
OpenAlex ID: W2588678083