Work

Diagnostic precision of a deep learning algorithm for the classification of non-contrast brain CT reports

Year: 2025

Type: article

Abstract: Objective: This study aimed to determine the diagnostic precision of a deep learning algorithm for the classificaiton of non-contrast brain CT reports. Methods: A total of 1,861 non-contrast brain CT reports were randomly selected, anonymized, and annotated for urgency level by two radiologists, with review by a senior radiologist. The data, encrypted and stored in Excel format, were securely maintained on a university cloud system. Using Python 3.8.16, the reports were classified into four urgency categories: emergency, not emergency but needs timely attention, clinically non-significant and normal. The dataset was split, with 800 reports used for training and 200 for validation. The DistilBERT model, featuring six transformer layers and 66 million trainable parameters, was employed for text classification. Training utilized the Adam optimizer with a learning rate of 2e-5, a batch size of 32, and a dropout rate of 0.1 to prevent overfitting. The model achieved a mean F1 score of 0.85 through 5-fold cross-validation, demonstrating strong performance in categorizing radiology reports. Results: Of the 1,861 scans, 861 cases were identified as fit for study through the senior radiologist and self-hosted Label Studio interpretations. It was observed that the algorithm achieved a sensitivity of 91% and a specificity of 90% in the measurements made on the test data. The F1 score was measured as 0.89 for the best fold. The algorithm most successfully distinguished emergency results with positive predictive values that were unexpectedly lower than in previously reported studies. Beam hardening artifacts and excessive noise, compromising the quality of CT scan images, were significantly associated with decreased model performance. Conclusion: The proposed deep learning algorithm demonstrated high diagnostic accuracy, sensitivity, and specificity in classifying non-contrast brain CT reports. These results indicate the feasibility of automated identification of critical cases, which may support workflow efficiency and timely patient management in radiology practice.

Source: Frontiers in Radiology

DOI: 10.3389/fradi.2025.1509377

Authors: Hamza Eren Güzel, Göktuğ Aşcı, Oytun Demirbilek, Tuğçe Doğa Özdemir, Pelin Berfin Erekli

Institutions: İzmir Şehir Hastanesi, IE University, Technical University of Munich

Language: English

Topic: Machine Learning in Healthcare

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

SDG: Good health and well-being

Open Access status: gold

Estimated APC paid: $2,353