Work

ATDFusion: Adapter-Tuned Dual-Branch Network for multimodal medical image fusion

Year: 2026

Type: article

Abstract: Multimodal medical image fusion aims to combine complementary visual information from different imaging modalities to assist diagnosis and clinical decision-making. Existing methods often struggle to balance global semantic representation and local detail preservation, leading to blurred or incomplete features in salient regions. This work proposes ATDFusion (Adapter-Tuned Dual-Branch Network), featuring a global semantic branch and an auxiliary detail branch to jointly capture high-level context and fine-grained details. A Low-Rank Dynamic Token Adapter (LR-DTA) adaptively fine-tunes intermediate layers of pretrained models based on token number and rank. Additionally, a Fusion Enhancement Guidance (FEG) module imposes explicit spatial supervision via a saliency-aware loss to strictly preserve diagnostically critical regions. On three typical tasks (MRI-CT, MRI-PET, MRI-SPECT), ATDFusion surpasses state-of-the-art methods, improving SSIM and CC by 11.93% and 5.07%, respectively. Other metrics (e.g., EN, PSNR) also achieve leading results, validating its effectiveness. Furthermore, the model demonstrates strong zero-shot generalization on the unseen HECKTOR 2025 dataset. Code is available at https://github.com/pluto628/ATDFusion .

Source: Pattern Recognition

DOI: 10.1016/j.patcog.2026.113848

Authors: Chenyang Li, Rui Zhu, Hang Zhao, Xiongfei Li, Xiaoli Zhang

Institutions: Jilin University, Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University

Language: English

Topic: Advanced Image Fusion Techniques

Subfield: Media Technology

Field: Engineering

Domain: Physical Sciences

SDG: Good health and well-being

Open Access status: hybrid

Estimated APC paid: $2,590