Work

Geometric Realizations of Capability Spaces of Large Models and Zigzag Persistent Homology

Year: 2026
Type: preprint
Abstract: We propose a topological model for capability changes during large-model training. The model represents knowledge states and preregistered capability probes as subcomplexes of a finite regular CW complex. We prove that attaching a single $n$-cell can only create a class in $\mathrm H_n$ or kill a class in $\mathrm H_{n-1}$. With the reliability threshold and the training checkpoint as two parameter axes, capability gains and losses make the spaces along the training axis nonnested. Union or intersection bridges produce zigzag persistence modules, and we distinguish checkpoint, transition, and bridge-sensitive classes. A finite four-stage example is computed by boundary matrices. The framework records algebraic changes under a chosen encoding, and a homological change is called a candidate capability emergence only after robustness tests, null-model comparisons, and independent behavioral validation.
Language: English
Open Access status: green
OpenAlex ID: W7220668193
Cites: 18
Cited by:
Related to: 10