Real-time instance segmentation of spine endoscopy images using a YOLO-V11 deep convolutional neural network
Year: 2026
Type: article
Abstract: BACKGROUND AND OBJECTIVES: Spine endoscopic surgery requires precise anatomical recognition and real-time bleeding detection to enhance surgical safety and efficiency. However, most existing computer vision studies do not offer real-time multi-class segmentation of the entire scene. This study aims to develop a real-time instance segmentation model based on YOLO-V11, capable of automatically identifying surgical instruments, critical anatomical structures, and bleeding sites in spine endoscopy. METHODS: The model was trained and evaluated using 2,181 annotated frames (training 1,741 / validation 216 / held-out test 224) from spine endoscopy images, covering nine key categories: instruments, bone, ligamentum flavum, dura, soft tissue, vessels, fat, the radiofrequency ablation wand, and bleeding focus. The segmentation model's performance was evaluated across various YOLO-V11 variants. RESULTS: Across five random seeds per variant on the same NVIDIA A100 GPU, YOLO-V11 l achieved the highest mask mAP50, defined as mean average precision at an intersection-over-union threshold of 0.50, with a value of 0.7735 ± 0.0030 (mean ± SD, n = 5). It also maintained real-time inference, reaching 270 ± 35 frames per second (FPS) with a per-frame latency of 3.75 ± 0.51 ms. All five variants exceeded 30 FPS, the widely accepted real-time threshold for surgical imaging. The model demonstrated high precision in segmenting vital structures such as the dura and ligamentum flavum and accurately identified bleeding regions. CONCLUSION: This research contributes to AI-driven surgical guidance systems, with potential applications in robotic-assisted spine surgery. The developed model enables real-time navigation, improving intraoperative decision-making and enhancing surgical outcomes. In particular, our YOLO-V11-based framework extends prior single-structure or lower-frame-rate multi-element approaches by delivering real-time multi-class instance segmentation of instruments, anatomical structures, and bleeding sites in spine endoscopy, with explicitly quantified inference latency.
Source: PLoS ONE
Authors: Hyun Ji Jung(Writing – original draft), Noah Euyhyun Nam(Supervision), Chulmin Lee(Conceptualization), Yeje Lim(Data curation), Won Chang Choi(Formal analysis), Junsu Lee(Investigation), Gunyul Kim(Methodology), Hyunjae Kim(Project administration), Sang Kyeong Lee(Project administration), Jiho Kang(Writing – review & editing), Tae-Shin Kim(Resources)
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,382
OpenAlex ID: W7235897871
