Year: 2026
Type: article
Abstract: Biomedical Foundation Models (FMs) are transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological features — including variations in laboratory procedures and scanner hardware — poses risks for clinical deployment. We introduce PathoROB, a public benchmark quantifying FM robustness to non-biological features. Representation-level robustness is assessed using the robustness index, while output-level robustness is evaluated across clinically relevant settings, including patch- and slide-level prediction, case retrieval, and clustering tasks. Our experiments reveal robustness deficits across all 20 evaluated FMs, with substantial differences between them. We find that non-robust FM representations can cause major diagnostic downstream errors preventing safe clinical adoption. Using more robust FMs, vision-language alignment, and post-hoc robustification reduces (but does not yet eliminate) the risk of such errors. This work establishes that robustness evaluation is essential for validating pathology FMs before clinical adoption and provides a blueprint for assessing and improving robustness across biomedical domains. Biomedical Foundation Models (FMs) can be susceptible to learning non-biological features that pose risk for clinical deployment. Here, the authors introduce PathoROB, a public benchmark framework to quantify robustness to non-biological features across 20 FMs and the corresponding impact on downstream clinical errors.
Source: Nature Communications
Institutions: Berlin Institute for the Foundations of Learning and Data, Technische Universität Berlin, The Netherlands Cancer Institute, Charité – Universitätsmedizin Berlin, German Cancer Research Center, Deutsches Konsortium für Translationale Krebsforschung, Pathologisches Institut, Ludwig-Maximilians-Universität München, Korea University, Max Planck Institute for Informatics
Language: English
Topic: AI in cancer detection
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $6,990
OpenAlex ID: W4415231643
