Work

Lesion-Grounded Content-Based Retrieval of CT Findings Using Foundation Model Patch Embeddings for Case Review

Year: 2026
Type: preprint
Abstract: Background Computed tomography (CT) education benefits from prior examinations containing related localized findings. Whole-volume retrieval can be driven by global anatomy or unrelated findings, while database-specific retrieval models limit reuse. This study evaluates whether patch tokens from a frozen volumetric CT foundation encoder can support a reusable lesion-grounded retrieval framework without task-specific retrieval fine-tuning. Methods Spatial patch tokens were pooled into lesion representations linked to their parent examination, annotation, and source finding text. ReXGroundingCT served as the demonstration benchmark. The primary evaluation used FlexiCT-3D to search 14,359 reference lesions with 407 public-validation queries from 50 CT examinations. Exact masks, bounding boxes, and loose boxes tested sensitivity to query-region precision. Retrieval was evaluated against ontology-based relevance, analytic chance expectations, and annotation-informed descriptor controls. Results For exact-mask queries, exact-subcategory Recall@1 was 0.484, more than three times the analytic chance expectation of 0.154, while Recall@10 was 0.848 versus 0.729. Bounding-box and loose-box queries gave Recall@10 of 0.840 and 0.821, respectively, but less precise query regions lowered early-rank performance. Under both box policies, embedding retrieval outperformed the descriptor-only control. Conclusions A reusable lesion-retrieval layer can be built from frozen volumetric foundation features without task-specific retrieval training. The layer retains links to source finding text without using text for ranking and can organize compatible medical-image databases into lesion-centered ranked lists and localized review panels for educational case comparison.
Language: English
Open Access status: green
OpenAlex ID: W7225915644
Cites: 22
Cited by:
Related to: 10