Deep learning‐based H&E‐derived risk scores in colorectal cancer: associations with tumour morphology, biology, and predicted drug response
Year: 2026
Type: article
Abstract: Over recent years, several deep learning (DL) models have been presented to predict colorectal cancer (CRC) patient survival directly from haematoxylin and eosin (H&E)-stained routine whole-slide images (WSIs). Unlike traditional studies that rely on manually defined histopathological features, weakly supervised DL allows training directly on clinical endpoints without prior specification of the model's focus. This offers a unique opportunity to study the tissue morphology underlying these predictions, improving our understanding of disease biology. Here, we present a comprehensive analysis of the clinicopathological features, tumour morphology and biology, as well as gene expression-based predicted drug response of over 4,000 CRC patients derived from four different international cohorts with available H&E-inferred DL-based risk scores (low- versus high-risk as well as absolute risk scores). The results from our study suggest that conventional clinicopathological risk factors, such as grade of differentiation, presence of lymph node metastasis, tumour budding, and percentage of tumour necrosis, are positively associated with DL-based risk scores. Moreover, CRCs with direct tumour-adipocyte interactions are enriched in the DL-based high-risk group. Through detailed morphologic review, we provide comprehensive evidence that direct tumour-adipocyte interaction, a high degree of tumour budding, and poorly differentiated morphology are linked to high DL-based risk scores. Transcriptomic and genetic subgroups show only limited association with H&E-derived DL-based risk scores. Moreover, we present data suggesting that DL-based low- versus high-risk CRCs may be characterised by differential drug sensitivity. Our study highlights that DL-based risk scores derived from H&E WSIs not only align with established clinicopathological features but also highlight morphological features, such as tumour-adipocyte interaction, that are not routinely captured by established clinicopathological scoring systems. Moreover, DL-based risk groups may be associated with a differential treatment response, underlining their potential to guide patient stratification in routine clinical practice. © 2026 The Author(s). The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.
Source: The Journal of Pathology
DOI: 10.1002/path.70039
Authors: Nic G Reitsam, Xiaofeng Jiang, Junhao Liang, Bianca Grosser, Veselin Grozdanov, Chiara ML Loeffler, Marco Gustav, Tim Lenz, Hannah S Muti, Zunamys I Carrero, Nicholas P West, Philip Quirke, Sebastian Foersch, Moritz Jesinghaus, Wolfram Müller, Tanwei Yuan, Michael Hoffmeister, Hermann Brenner, Jitendra Jonnagaddala, Nicholas J Hawkins, Robyn L Ward, Heike I Grabsch, Bruno Märkl, Jakob N Kather
Institutions: University of Augsburg, Else Kröner Fresenius Center for Digital Health, Technische Universität Dresden, University of Electronic Science and Technology of China, Sichuan Cancer Hospital, Tsinghua University, Technical University of Munich, Universität Ulm, Helmholtz-Zentrum Dresden-Rossendorf, University Hospital Carl Gustav Carus, Nationales Centrum für Tumorerkrankungen Dresden, University of Leeds, University Medical Center of the Johannes Gutenberg University Mainz, Philipps University of Marburg, Starnberg Hospital, German Cancer Research Center, Deutsches Konsortium für Translationale Krebsforschung, UNSW Sydney, Monash University, Maastricht University Medical Centre, Maastricht University, University Hospital Heidelberg, National Center for Tumor Diseases
Language: English
Topic: AI in cancer detection
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $5,450
Awards: G133025269, G1461154980, G2027283056, G2200907562, G2237712113, G23125886, G2757930255, G3397978760, G3528256138, G3614050419, G3848825097, G407863352, G4082129129, G4382627319, G4407328535, G4487933309, G689520650, Entitätsübergreifende, morphologiebasierte Vorhersage des Therapieansprechens auf Immuncheckpoint Inhibitoren mittels Deep Learning
OpenAlex ID: W7130648463
