Deep Fibration Attention
Year: 2025
Type: preprint
Abstract: In fibration attention, a lifting simultaneously updates a query and abductively finds a key to explain a value. This all depends on the key-value pairing (k,v). By determining other keys that are highly similar to k, to also explain v, we can enhance key-value semantics to achieve more meaningful attention. Moreover, we can recursively layer keys upon keys in a tree, to deepen the set of value explanations.
Author: Tie, Gary Nan
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
OpenAlex ID: W4414560177
Cites:
Cited by:
Related to: