Developing an Assessment Framework for Essential Internal Medicine Subspecialty Topics
Year: 2018
Type: article
Abstract: BACKGROUND: Assessing residents by direct observation is the preferred assessment method for infrequently encountered subspecialty topics, but this is logistically challenging. OBJECTIVE: We developed an assessment framework for internal medicine (IM) residents in subspecialty topics, using tuberculosis diagnosis for proof of concept. METHODS: We used a 4-step process at 8 academic medical centers that entailed (1) creating a 10-item knowledge assessment tool; (2) pilot testing on a sample of 129 IM residents and infectious disease fellow volunteers to evaluate validity evidence; (3) implementing the final tool among 886 resident volunteers; and (4) assessing outcomes via retrospective chart review. Outcomes included tool score, item performance, and rates of obtaining recommended diagnostics. RESULTS: < .001) and a satisfactory Kuder-Richardson Formula 20 (0.72). Implementation of the tool revealed a 14-minute (SD = 2.0) mean completion time, 61% (541 of 886) response rate, 4.4 (SD = 1.6) mean score, and ≤ 57% correct response rate for 9 of 10 items. On chart review (n = 343), the rate of obtaining each recommended test was ≤ 43% (113 of 261), except for chest x-rays (96%, 328 of 343). CONCLUSIONS: Our assessment framework revealed knowledge and practice gaps in tuberculosis diagnosis in IM residents. Adopting this approach may help ensure assessment is not limited to frequently encountered topics.
Authors: Natasha Chida, Christopher Brown, Jyoti Mathad, Kelly Carpenter, George Nelson, Marcos C. Schechter, Paulina A. Rebolledo, Valeria Fabre, Diana Silva Cantillo, Sarah Longworth, Valerianna Amorosa, Christian Petrauskis, Catherine Boulanger, Natalie Cain, Amita Gupta, Jane McKenzie-White, Robert Bollinger, Michael Melia
Language: English
Field: Medicine
Domain: Health Sciences
Open Access status: green
OpenAlex ID: W2803464856