Work

Contact-SSM: Geometric Contact State-Space Models for Long-Horizon Dynamical Sequence Modeling

Year: 2026
Type: preprint
Abstract: $\mathbf{Contact-SSM}$ introduces a geometric continuous-time state-space architecture for long-horizon dynamical sequence forecasting. While standard SSMs (e.g., S4, Mamba) enforce strictly dissipative contractive transitions ($\mathrm{Re}(\lambda) < 0$) that rapidly damp oscillatory modes, Contact-SSM formulates latent dynamics on odd-dimensional Contact Hamiltonian manifolds $\mathbf{z} = (\mathbf{q}, \mathbf{p}, s) \in \mathbb{R}^{2d+1}$. Parameterized on the Lie algebra direct sum $\mathfrak{sp}(2d, \mathbb{R}) \oplus \mathbb{R}$ and discretized via the Generalized Symplectic Cayley Transform, it guarantees spectral stability on the complex unit disk ($|\lambda| \le 1$) with exact symplectic invariance ($|\det(\mathbf{\Phi}) - 1.0| \le 4.44 \times 10^{-16}$) while supporting $\mathcal{O}(\log L)$ parallel associative GPU prefix scans. Contact-SSM achieves a $30.6\%$ error reduction on 14-day rollouts ($H=336$) and preserves strange attractor measures under chaotic Lorenz-96 turbulence.
Institution: University of Delhi
Language: English
Open Access status: green
OpenAlex ID: W7236561544
Cites:
Cited by:
Related to: 10