Work

CTCNet: A CNN-Transformer Dual Branch Network for Sand Dune Image Segmentation

Year: 2025

Type: article

Abstract: Dune images typically display intricate details and relatively uniform spectral characteristics, making them a unique challenge for image segmentation tasks. Due to the limitations of traditional convolution operations, the CNN-based methods struggle to capture long-range dependencies. The Transformer-based methods have good performance in long-term dependency relationships, but it lacks modeling of local context. Based on the strengths of both approaches and the concept of a dual-branch architecture, in order to better achieve segmentation of sand dune images in desert areas, a dual-branch network combining Convolutional Neural Network(CNN) and Transformer (CTCNet) is proposed, and comparative experiments are conducted on a self-made Chinese desert sand dune morphology dataset and the Registan-Kharan desert sand dune morphology dataset. The CNN branch aims to capture local information and enhance feature extraction capabilities using Convolutional Attention Block. The Transformer branch captures global information and employs an enhanced transformer block to improve the capture of remote dependencies and create more discriminative features. Afterwards, the dual branch features are merged through a Feature Fusion Module to enhance the capture of finer details. Driven by its dual-branch structure and other design features, CTCNet has demonstrated exceptional capability in capturing dependencies and contextual information for sand dune image segmentation tasks. The experimental results demonstrate that CTCNet achieves an accuracy of 89.66% and a mean Intersection over Union(MIoU) of 82.29% on the Chinese desert sand dune morphology dataset. On the Registan-Kharan desert dune morphology dataset, it achieves an accuracy of 91.24% and a MIoU of 81.21%. Outperforming other models of similar complexity and size, achieving state-of-the-art results, and demonstrating the effectiveness and robustness of CTCNet.

Source: IEEE Transactions on Geoscience and Remote Sensing

DOI: 10.1109/tgrs.2025.3562909

Authors: Tianrui Zhang, Zhaobin Wang, Yaonan Zhang, Xuejun Guo

Institutions: Lanzhou University, Chinese Academy of Sciences, Northwest Institute of Eco-Environment and Resources, Institute of Tibetan Plateau Research

Language: English

Topic: Advanced Neural Network Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Estimated APC paid: $2,645

Funders: Yunnan Key Research and Development Program, National Key Research and Development Program of China