Assessment of the Interrater Reliability of the Congress of Neurological Surgeons Microanastomosis Assessment Scale
Year: 2016
Type: article
Abstract: BACKGROUND: The potential for simulation-based learning in neurosurgical training has led the Congress of Neurosurgical Surgeons to develop a series of simulation modules. The Northwestern Objective Microanastomosis Assessment Tool (NOMAT) was created as the corresponding assessment tool for the Congress of Neurosurgical Surgeons Microanastomosis Module. The face and construct validity of the NOMAT have been previously established. OBJECTIVE: To further validate the NOMAT by determining its interrater reliability (IRR) between raters of varying levels of microsurgical expertise. METHODS: The NOMAT was used to assess residents' performance in a microanastomosis simulation module in 2 settings: Northwestern University and the Society of Neurological Surgeons 2014 Boot Camp at the University of Indiana. At Northwestern University, participants were scored by 2 experienced microsurgeons. At the University of Indiana, participants were scored by 2 postdoctoral fellows and an experienced microsurgeon. The IRR of NOMAT was estimated by computing the intraclass correlation coefficient using SPSS v22.0 (IBM, Armonk, New York). RESULTS: A total of 75 residents were assessed. At Northwestern University, 21 residents each performed microanastomosis on 2 model vessels of different sizes, one 3 mm and one 1 mm. At the University of Indiana, 54 residents performed a single microanastomosis procedure on 3-mm vessels. The intraclass correlation coefficient of the total NOMAT scores was 0.88 at Northwestern University and 0.78 at the University of Indiana. CONCLUSION: This study indicates high IRR for the NOMAT. These results suggest that the use of raters with varying levels of expertise does not compromise the precision or validity of the scale. This allows for a wider adoption of the scale and, hence, a greater potential educational impact.
Source: Operative Neurosurgery
Authors: Andrew R. Pines, Mohammed S. Alghoul, Youssef J. Hamade, Mithun G. Sattur, Rami James N. Aoun, Tariq K. Halasa, Chandan Krishna, Samer G. Zammar, Najib E. El Tecle, Tarek Y. El Ahmadieh, Salah G. Aoun, Richard W. Byrne, James S. Harrop, Brian T. Ragel, Daniel K. Resnick, Russell R. Lonser, Nathan R. Selden, Bernard R. Bendok
Institutions: Mayo Clinic, Mayo Clinic Hospital, Northwestern University, Saint Louis University Hospital, The University of Texas Southwestern Medical Center, Rush University Medical Center, Rush University, Thomas Jefferson University Hospital, Oregon Health & Science University, University of Wisconsin–Madison, The Ohio State University
Language: English
Subfield: Surgery
Field: Medicine
Domain: Health Sciences
Open Access status: green
Funder: National Institutes of Health
OpenAlex ID: W2516250672