Year: 2026
Type: conference-paper
Abstract: Large Language Models (LLMs) face a fundamental challenge with delayed disambiguation: How is the meaning of an ambiguous word updated when clarifying context arrives only after it has been processed?While LLMs possess the latent capacity to resolve such ambiguities-as revealed when a full, non-causal context is provided-their unidirectional architecture prevents immediate updates.We investigate the underlying computational mechanism and show this semantic re-evaluation is deferred to subsequent tokens in a process we term "Deferred Semantic Drift (DSD)".Through targeted analysis of attentional pathways, we find that later tokens actively retrieve context-dependent "informational packets" from the ambiguous word's value vector to steer the final interpretation.We demonstrate this mechanism in metaphor comprehension and provide causal validation by steering model outputs towards literal or metaphorical meanings via targeted activation interventions.This research uncovers a key computational strategy for meaning construction, offering crucial insights for understanding and guiding the behavior of LLMs 1 .
Institution: Dalian University of Technology
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Awards: G3819115411, G8812420149
OpenAlex ID: W7166835797