Year: 2025
Type: article
Abstract: Remote sensing image captioning is a rapidly growing application with significant roles in environmental monitoring, disaster response, and military intelligence. Despite advancements in handling scene diversity, object scale variability, and improving caption quality, existing models usually rely on large labeled datasets and computationally expensive methods, which limits their effectiveness in scenarios with scarce annotations. To overcome these challenges, this paper introduces semi-supervised training strategies that reduce the dependence on labeled data while enhancing both the quality and diversity of captions. Specifically, we propose a Weakly Supervised Enhanced Noisy Teacher-Student Network (WENTS) to prevent over-reliance on specific features and improve generalization. Additionally, we develop a Two-Stage Training Network (TSTN) designed to stabilize learning, reduce gradient variance, and promote the generation of diverse captions. Our methods demonstrate exceptional performance even with low sampling rates and simple network architectures, highlighting their high scalability. Experimental evaluations on benchmark datasets demonstrate the promising results achieved by our strategies, particularly the state-of-the-art performance attained on the challenging NWPU-Captions dataset, with a 17.71% in CIDEr and 11.23% in Sm improvement over previous state-of-the-art methods.
Source: Scientific Reports
Authors: Qimin Cheng, Haojun Cheng, Linfeng Yuan, Yingjie Du, Saifei Tu, Yuqi Xu
Institution: Huazhong University of Science and Technology
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,690
Award: G1895805351
OpenAlex ID: W4412365379