When Blocks Outlive Tasks: Three Safeguards for Task-ID-Free Routing in Growing Continual Learners
Year: 2026
Type: preprint
Abstract: Growing continual learners add blocks for new data and freeze old ones. Without task labels, task-identity predictors pick the answering block but assume one block per task. Learners that grow when a block saturates break that assumption: a block learns several data periods and keeps changing while the router relies on it. For task-identity-free routing over such blocks' complete predictions we state three safeguards for replay-based growers, each tested by removal: the active block replays its earlier periods until it freezes; the router's records are written at freeze from final weights; and later training never overwrites the router's state for a frozen block, kept per block or as exact running statistics. In a pre-declared, Holm-corrected confirmation on ten independent seeds, 19 of 20 tests (four hypotheses on five benchmarks) held, except safeguard~2 on Permuted-MNIST. On CLEAR-10's natural drift one block covers nearly every year, so block choice matters little. A freeze-time competence record, compared among blocks claiming the same data, picks a revised block's competent version, but its centring lets version pairs capture other blocks' inputs, so banks keeping old versions route better without it. A bank/router loss split finds selection loss large but router- and stream-dependent: on Split CIFAR-100 the blocks hold 0.80; a per-block router reaches 0.51, and an analytic shared router using every training row 0.62, above a nearest-class-mean baseline (0.58) but not RanPAC (0.75), both non-growing, on the same features. Under per-period testing, RanPAC beats every routed bank on every frozen-feature stream.
Source: Research Square
Authors: Nishant Kumar, Saurabh Srivastava
Institution: Indian Institute of Technology Dhanbad
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Keywords: data drift, Holm correction
Open Access status: green
OpenAlex ID: W7225867714
