A cue-locality audit framework for attributing spurious temporal shortcuts in deep sequence models
Year: 2026
Type: article
Abstract: High accuracy on independent and identically distributed (IID) test data does not reveal which temporal cue a sequence model uses. A directional process can leave a cue in individual frames, so out-of-distribution (OOD) failure alone does not establish temporal-order use. We propose a six-gate audit that attributes failure to a nuisance and distinguishes frame-local, order-invariant multi-frame, and order-encoded cues. A companion controlled benchmark provides the factor-level probes and interventions the audit requires. Applied to this benchmark, the audit revealed that a variant designed to encode temporal order was instead solvable from individual frames. In the strict order-encoded variant (OE-Strict), direction is readable only from interior frame order. With nuisance direction aligned with the label with probability 0.97 during training, a gated recurrent unit (GRU) trained by empirical risk minimization (ERM) selects the shortcut in thirty of thirty seeds (0.970 IID and 0.030 OOD accuracy). Channel-selective interventions attribute the collapse to nuisance frame ordering. The audit distinguishes which process supports a prediction and whether using that process requires temporal order.
Source: Scientific Reports
Institutions: University of Ulsan, Changwon National University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,690
OpenAlex ID: W7233608201
FWCI:
Cites:
Cited by:
Related to:
