Work

Breast Ultrasound Classification Under Cross-Dataset Shift: A Multi-Seed Benchmark of Convolutional Networks, a Vision Transformer, and a Self-Supervised Foundation Model

Year: 2026
Type: article
Abstract: Deep-learning classifiers for breast ultrasound are usually evaluated on images from their training institution, and self-supervised foundation models are increasingly proposed as more transferable than supervised networks; whether ranking ability, decision thresholds, and probability calibration survive a change in institution has rarely been tested under leakage-controlled conditions. We fine-tuned ResNet-50, EfficientNet-B0, a supervised Vision Transformer (ViT-B/16), and self-supervised DINOv2 under one shared protocol on the official BUS-BRA five-fold partitions, each fold with three seeds, and on three case-grouped hold-out splits, and evaluated every trained model unchanged on the Breast Ultrasound Images (BUSI) dataset. The supervised models largely retained their discrimination externally. ResNet-50 had the highest mean area under the receiver operating characteristic curve under the official folds, but no criterion separated it from ViT-B/16, whose small hold-out advantage at the decision threshold did not recur. In every official-fold run, both models labeled a larger share of BUSI than of BUS-BRA images malignant, although prevalence was the same—a shift that temperature scaling cannot correct. Top-label calibration error also understated malignant-class miscalibration. Full-frame DINOv2 did not fit its training data in any run, although exploratory lesion cropping produced good discrimination. External evaluations should report operating-point transport and class-wise calibration alongside discrimination.
Source: Algorithms
Language: English
Open Access status: gold
Estimated APC paid: $1,930
OpenAlex ID: W7236332253
FWCI:
Cites: 83
Cited by:
Related to: 10