From Passive Metric to Active Signal: The Evolving Role of Uncertainty Quantification in Large Language Models
Year: 2026
Type: conference-paper
Abstract: While Large Language Models (LLMs) show remarkable capabilities, their unreliability remains a critical barrier to deployment in highstakes domains.This survey charts a functional evolution in addressing this challenge: the evolution of uncertainty from a passive diagnostic metric to an active control signal guiding real-time model behavior.We demonstrate how uncertainty is leveraged as an active control signal across three frontiers: in advanced reasoning to optimize computation and trigger self-correction; in autonomous agents to govern metacognitive decisions about tool use and information seeking; and in reinforcement learning to mitigate reward hacking and enable self-improvement via intrinsic rewards.By grounding these advancements in emerging theoretical frameworks like Bayesian methods and Conformal Prediction, we provide a unified perspective on this transformative trend.This survey provides a comprehensive overview, critical analysis, and practical design patterns, arguing that mastering the new trend of uncertainty is essential for building the next generation of scalable, reliable, and trustworthy AI. Method / Framework Key Advantage(s) Key Disadvantage(s) / Failure Mode(s) Cost ComplexityBetween Reasoning Paths CISC -More efficient than standard self-consistency.-A single bad step can sink a good path score.-Relies on well-calibrated confidence.High Low CER -Robust for long-chain reasoning.-Focuses on the most important steps.-Must correctly identify "critical" steps.-Can amplify errors from miscalibrated confidence. Very High MediumInside a Reasoning Path UAG / SPOC-Enables real-time error correction.-No retraining required.-LLMs often fail at true self-correction.-Can get stuck in correction loops. Medium HighUncertainty-Aware FT -Fundamentally improves model calibration.-Benefits all downstream tasks.-Data-intensive training process.-Risk of harming in-distribution performance.Low High Optimizing Cognitive Effort UnCert-CoT-Excellent efficiency-performance balance.-Simple and intuitive concept.-Performance is highly sensitive to the threshold value.Low Low MUR-More stable control via momentum.-Finer-grained resource allocation.-More complex than simple triggers.-Adds more hyperparameters to tune.
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7166880671