CM-S6: Cross-Modal Selective Scan via Parameter-Level Modulation for Multisource Remote Sensing
Year: 2026
Type: article
Abstract: Multimodal remote sensing classification benefits from complementary spectral, structural, and elevation information. Convolutional neural networks (CNNs) have limited long-range modeling, whereas Transformers incur quadratic computational and memory costs. Although Mamba enables linear-complexity sequence modeling, multimodal Mamba methods usually fuse modalities before selective scanning, limiting the direct use of auxiliary information in parameter generation. We propose Cross-Modal Selective Scan (CM-S6), which uses lightweight projections to condition selective state-space parameters Δ, B, and C on auxiliary information. These parameters regulate state retention, information writing, and state readout, respectively. With input injection, output calibration, and five tanh-bounded learnable coefficients, CM-S6 forms an input-parameter-output fusion mechanism without increasing backbone width or depth. Across ten independent runs, CM-S6 achieves OA values of 92.11 ± 0.91%, 81.04 ± 1.94%, and 92.77 ± 0.94% on Houston 2013, Augsburg, and MUUFL Gulfport, respectively, using fewer than 1 M parameters, corresponding to 1.9–2.9% of the high-capacity compared baselines. Paired tests detected no significant OA difference from MCAMamba on Houston 2013 or from HLMamba and PICNet on Augsburg, while CM-S6 shows significant OA gains over MSFMamba on Augsburg and MUUFL Gulfport and over DSFormer on MUUFL Gulfport. CM-S6(L) retains parameter-level modulation, reduces model size to approximately 0.19 M parameters, and increases throughput by 3.64–3.94×, with a dataset-dependent accuracy trade-off. CM-S6 offers an alternative for multimodal fusion under resource-constrained conditions.
Source: Remote Sensing
DOI: 10.3390/rs18193393
Authors: Jingbo Zhou(Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Software, Validation, Visualization, Writing – original draft, Writing – review & editing), Shaoqun Qi(Funding acquisition, Project administration, Supervision, Writing – review & editing), Dousheng Zhang(Data curation, Project administration), Zhenping Jiang(Data curation, Project administration)
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,258
OpenAlex ID: W7204779532
