Parameter-Efficient Multilingual Vision–Language Adaptation for Spatio-Temporal Climate-Risk Interpretation from Satellite Imagery
Year: 2026
Type: article
Abstract: Climate-risk monitoring requires models that connect satellite observations with natural-language questions while supporting users working in different languages. We present ClimateRS-VL, a parameter-efficient adaptation of Qwen2.5-VL-3B-Instruct for English, Gujarati, and Hindi climate-risk interpretation. The benchmark combines 7182 regional optical–mask pairs from six districts of Gujarat, 1026 nominal regional temporal pairs, 740 reservoir-year metadata records, 409 reservoir-year image samples, and 178,503 programmatically generated multilingual references. A prompt audit confirms that explicit answer-bearing numerical and categorical variables were absent from all 126,810 training, 25,854 validation, and 25,839 test prompts. On the full 25,839-response test evaluation, English, Gujarati, and Hindi VQA obtain BLEU scores of 83.9230, 80.9125, and 83.2524, with BERTScore-F1 values of 0.9891, 0.9961, and 0.9953. A same-backbone study on a common 3000-response subset yields an average VQA BLEU of 0.5625 for zero-shot Qwen2.5-VL, 1.1138 with contextual prompting but no adaptation, and 85.5191 with contextual prompting and LoRA. Question-aligned cross-lingual consistency is 0.9673, although this metric measures agreement rather than correctness. Class-balanced analysis further shows that raw accuracies above 0.98 on four regional risk questions arise from severe low-risk class prevalence: the model predicts the low-risk class for every sample, yielding a balanced accuracy of 0.5000. The protocol is a temporal holdout over recurring monitoring locations rather than an evaluation of unseen-location generalization. The results support parameter-efficient multilingual adaptation for structured in-domain generation while identifying limitations in numerical visual reasoning, minority-risk discrimination, reference diversity, and spatial generalization.
Source: Remote Sensing
DOI: 10.3390/rs18223945
Authors: Parita Shah(Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing), Santosh Satapathy(Data curation, Investigation, Methodology, Visualization, Writing – original draft), Akash Kumar Bhoi(Resources, Validation, Writing – review & editing), Paolo Barsocchi(Formal analysis, Investigation, Writing – review & editing), Ritesh Vyas(Conceptualization, Formal analysis, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing)
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
SDG: Climate action
Open Access status: gold
Estimated APC paid: $3,258
OpenAlex ID: W7235328958
