Uncertainty-Aware Constrained Q-Learning for Online UAV-Based ILS Localizer Flight Inspection
Year: 2026
Type: article
Abstract: Unmanned aerial vehicle (UAV) flight inspection requires online decisions that respond to changing measurement evidence while sustaining task progress. An uncertainty-aware framework maps heterogeneous observations to normalized quality indicators and uses temporal intuitionistic fuzzy sets to represent reliability support, unreliability support, and hesitation. Aggregated evidence enters the decision state, while post-action uncertainty defines a cost under an expected discounted cumulative-cost constraint. The resulting constrained Markov decision process is addressed using primal–dual constrained Q-learning (CMDP-Q). Measured Instrument Landing System (ILS) localizer profiles motivate retaining local variation, and controlled simulations examine its influence on learned decisions. Compared with unconstrained Q-learning, CMDP-Q selects Retest and Reposition more often and lowers mean step uncertainty, with longer episodes. Under the main evaluation setting, its mean discounted cumulative cost exceeds the budget and is slightly higher than that of GreedyProgress, without a statistically supported reduction relative to unconstrained Q-learning. A tested fixed-Lagrangian variant achieves higher reward and lower discounted cumulative cost than CMDP-Q, but higher mean step uncertainty. The state derived from temporal intuitionistic fuzzy evidence shows no statistically supported advantage over direct aggregation in reward, discounted cost, or step uncertainty. These findings characterize trade-offs between uncertainty exposure and execution burden under explicit cost regulation.
Source: Drones
Authors: Yuan Jiang, Yu Zhang, Yihao Shu, Honghao Li, Haoxiang Xu
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W7235734817
