Breast Ultrasound Classification Under Cross-Dataset Shift: A Multi-Seed Benchmark of Convolutional Networks, a Vision Transformer, and a Self-Supervised Foundation Model
Year: 2026
Type: article
Abstract: Deep-learning classifiers for breast ultrasound are usually evaluated on images from their training institution, and self-supervised foundation models are increasingly proposed as more transferable than supervised networks; whether ranking ability, decision thresholds, and probability calibration survive a change in institution has rarely been tested under leakage-controlled conditions. We fine-tuned ResNet-50, EfficientNet-B0, a supervised Vision Transformer (ViT-B/16), and self-supervised DINOv2 under one shared protocol on the official BUS-BRA five-fold partitions, each fold with three seeds, and on three case-grouped hold-out splits, and evaluated every trained model unchanged on the Breast Ultrasound Images (BUSI) dataset. The supervised models largely retained their discrimination externally. ResNet-50 had the highest mean area under the receiver operating characteristic curve under the official folds, but no criterion separated it from ViT-B/16, whose small hold-out advantage at the decision threshold did not recur. In every official-fold run, both models labeled a larger share of BUSI than of BUS-BRA images malignant, although prevalence was the same—a shift that temperature scaling cannot correct. Top-label calibration error also understated malignant-class miscalibration. Full-frame DINOv2 did not fit its training data in any run, although exploratory lesion cropping produced good discrimination. External evaluations should report operating-point transport and class-wise calibration alongside discrimination.
Source: Algorithms
DOI: 10.3390/a19111011
Authors: Ervin Ramollari(Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – original draft), Narasimha Rao Vajjhala(Conceptualization, Methodology, Resources, Validation, Visualization, Writing – review & editing), Rajesh Kumar(Conceptualization, Data curation, Methodology, Project administration, Supervision, Writing – original draft), Komal Ramchandani(Data curation, Investigation, Validation, Visualization), Ranjeeta Mahraj(Data curation, Formal analysis, Validation), Khalid Hussain(Data curation, Resources, Visualization)
Language: English
Topic: AI in cancer detection
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $1,930
OpenAlex ID: W7236332253
