Cell type prediction with neighborhood-enhanced cellular embedding using deep learning on hematoxylin and eosin-stained images
Year: 2025
Type: article
Abstract: Purpose: This study aimed to predict the cell types that infiltrate the tumor microenvironment using hematoxylin and eosin-stained images from colon cancer and breast cancer samples. Methods: Two datasets, one focused on colon cancer and the other on breast cancer, were used to develop deep learning models. Cell segmentation was performed using Stardist, followed by the K-Nearest Neighbor method to construct a neighborhood-enhanced cellular extraction matrix for model training. Transductive semi-supervised learning was applied to the breast cancer dataset, where the Base-4 model was trained on S1 and S2 samples and subsequently used to generate assigned labels for the S3, S4, and S5 sets, on which the Base-4+ model was trained. Results: The Base-7 model trained on colon cancer cell images achieved accuracy of 0.85 on the hold-out test set and 0.74- on the independent test set, with six neighboring cells identified as the optimal condition for prediction. In addition, the Base-4 model achieved a prediction accuracy of 0.69 with four neighboring cells as the optimal condition in the breast cancer dataset, while the Base-4+ model reached an accuracy of up to 0.93 on the validation set. The model also captured invasive and ductal carcinoma cells with overall agreement relative to spot-based cell types (0.63). Conclusions: Deep learning models accurately predicted cell types in breast and colon cancer datasets using only cell morphology and neighborhood embedding.
Language: English
Subfield: Biophysics
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $3,230
Awards: G1143455775, G1190587642, Mays Cancer Center at UT Health SA, G1334422627, G2126012127, G2370644355, In silico screening for immune surveillance adaptation in cancer using Common Fund data resources, Enhancing AI-readiness of multi-omics data for cancer pharmacogenomics, G2789960460, G4535493433, Predicting Drug Response from Genomic Data Using Deep Learning Methods, UTHSCSA Cancer Genome Sequencing and Computation Core, G9000217503, G9000324485
OpenAlex ID: W4412459748
