M 3 E: An observation-support-aware enhancement for BEV matching in fine-grained cross-view localization
Year: 2026
Type: article
Abstract: Cross-view localization estimates the Three Degrees of Freedom (3-DoF) pose of a ground-view image with respect to a satellite image and is relevant when GNSS signals may be limited or unavailable. Recent Bird’s-Eye-View (BEV) matching-based methods have improved localization accuracy by transforming cross-view images into a shared top-down representation and estimating pose through feature matching. However, ground-view BEV features are constructed through view transformation and spatial aggregation rather than directly from observations, which introduces non-uniform observation support and may produce unreliable correspondences in weakly supported regions. We propose M 3E, an observation-support-aware enhancement for BEV matching in cross-view localization. M 3E improves the matching process from both global and local perspectives. The Geometry Consistency-Guided Optimization (GCO) scheme adaptively regulates feature-level supervision using Virtual Correspondence Error (VCE) as a geometry-consistency proxy for the current cross-view pose-estimation state. The Visibility-Aware Correspondence Selection (VCS) strategy uses a camera-distance observation-support prior to reweight matching candidates, encouraging pose estimation to rely more on regions better supported by ground-view observations. Rather than replacing existing pipelines, M 3E complements BEV matching-based methods and can be integrated into the evaluated learnable-BEV matching pipelines to improve correspondence reliability and pose estimation. Experiments on VIGOR, DReSS-D, and KITTI-CVL show that the most consistent benefit of M 3E lies in translation accuracy and robustness across the evaluated FG 2 and ViewBridge pipelines, while orientation gains are setting-dependent and less uniform, particularly in limited-FoV settings. The translation gains are especially evident in challenging unknown-orientation scenarios. The experimental results support the importance of spatially non-uniform observation reliability in BEV matching-based cross-view localization. M 3E introduces no additional learnable parameters and incurs negligible measured inference-time latency overhead under the tested settings, providing a practical enhancement for the evaluated learnable-BEV matching pipelines and offering a useful direction for more reliable correspondence reasoning.
Source: Geo-spatial Information Science
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $1,993
OpenAlex ID: W7235282890
