A Comparison of Pragmatic and Scalable Strategies to Assess Fidelity to Cognitive Processing Therapy in Routine Care Settings
Year: 2024
Type: article
Study design: Observational Study
Abstract: Fidelity monitoring is crucial for successful implementation of evidence-based practices, buttraditional methods such as observation and video recording are impractical for routine mentalhealth care due to their high resource demands. A reliable, low-burden fidelity (adherence andcompetence) assessment can be helpful in improving the sustained implementation of cognitivebehavioral therapies (CBTs). This study evaluated two pragmatic alternatives to the time andcost-intensive “gold standard” observer ratings based on session recordings to assess fidelity inCognitive Processing Therapy (CPT). We assessed the feasibility of clinician-completedadherence checklists and ratings of clinical worksheets that were completed during sessions inpublic and private mental healthcare settings by a diverse sample of patients with significanttrauma histories and their therapists. We also examined whether fidelity ratings using theseapproaches were associated with observer ratings of fidelity and with subsequent PTSDsymptom change. Results indicated high overall rater agreement for adherence and competenceon CPT worksheets and session recordings. We found significant associations among traditionalobserver ratings of adherence and our two low-burden alternatives for assessing adherence.Clinician-completed adherence checklists were also associated with subsequent symptomchange. Checklists and worksheets required substantially less time to rate than sessionrecordings. Overall, checklists and worksheets emerged as reliable and feasible methods forfidelity assessment, potentially diminishing the necessity for time- and labor-intensive fidelityratings based on session recordings. Our findings suggest a scalable approach for integratingfidelity monitoring and support into policies aimed at enhancing the accessibility andeffectiveness of evidence-based care.
Source: Behavior Therapy
Authors: Shannon Wiltsey Stirman, Nicole B. Gumport, Amber Calloway, Cassidy Gunter, Luana Marques, Samantha Hernandez, Jiyoung Song, Clara Johnson, Soo Jeong Youn, Sohayla Elhusseini, Regine M. Deguzman-Lucero, Taylor Loskot, Heidi La Bash, Yesenia Aguilar Silvan, Caroline Canale, Alayna L. Park, Jansey Lagdamen, Anna D. Bartuska, Booil Jo, Paul Barnett, Eric Kuhn, Robert DeRubeis, Dawne Vogt, Torrey A. Creed
Institutions: VA Palo Alto Health Care System, National Center for Post Traumatic Stress Disorder, Stanford University, University of Pennsylvania, Boston University, Massachusetts General Hospital, Reliant Medical Group, University of California, Los Angeles, VA Boston Healthcare System, University of Oregon, Palo Alto Veterans Institute for Research
Language: English
Subfield: Clinical Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $3,200
Award: G5056611198
OpenAlex ID: W4405311189