Work

SGCM: Semantic and Geometric Consistency for Robust Aerial Image Matching

Year: 2025

Type: article

Abstract: Aerial image matching remains an ongoing challenge due to the significant geometric distortions and nonlinear radiation distortion. Most current approaches primarily focus on low-level image features, while overlooking the potential of high-level semantic information to guide the matching process, limiting the robustness and accuracy of these methods in complex scenarios. In this article, we propose a novel coarse-to-fine aerial image matching framework called SGCM, which considers both semantic and geometric consistency in feature representation. Concretely, in the coarse matching stage, the SAM foundation model is leveraged to efficiently extract salient structural regions, providing valuable semantic guidance for subsequently matching procedure. To achieve accurate region matching, we construct the region description graphs that incorporate both semantic categories and geometric attributes information. A graph neural network (GNN) is then employed for feature aggregation and node descriptor updates, leading to more robust region representations. Coarse matching is performed by computing a similarity matrix between node descriptors, which helps effectively mitigate rotational and scaling differences between input images. Consequently, a fine matching strategy combining intraregion point matching and global matching is developed, which significantly improves the robustness of image matching under geometric variations. The performance of our method has been thoroughly evaluated on three challenging aerial image datasets and compared with five state-of-the-art matching methods. Extensive experimental results demonstrate the substantial advantages of SGCM in terms of matching accuracy and efficiency.

Source: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

DOI: 10.1109/jstars.2025.3594127

Authors: Xiangzeng Liu, Guanglu Shi, Chi Wang, Xiaodong Zhang, Qiguang Miao

Institution: Xidian University

Language: English

Topic: Advanced Image and Video Retrieval Techniques

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $1,800

Funder: Natural Science Basic Research Program of Shaanxi Province