Work

Fibration Attention Dynamics

Year: 2025

Type: preprint

Abstract: We characterize the dynamics of query updating coming from fibration abductive attention mechanisms, using perturbed Koopman operators that are invertible. Importantly, we identify conditions for Lyapunov stability of solutions near equilibrium points. Depending on the Koopman resolvent, some key-value pairings can have query update trajectories that are Lyapunov stable.

Source: HAL (Le Centre pour la Communication Scientifique Directe)

DOI: 10.13140/rg.2.2.36796.09600

Author: Tie, Gary Nan

Language: English

Topic: Model Reduction and Neural Networks

Subfield: Statistical and Nonlinear Physics

Field: Physics and Astronomy

Domain: Physical Sciences

Open Access status: gold

OpenAlex ID: W4414686749

Cites:

Cited by:

Related to: