Contextual Fibration Attention
Year: 2025
Type: preprint
Abstract: In a query-key-value attention model, the key-value pairing conveys language semantics. Query context also carries meaning. We introduce an abductive fibration attention model that holistically captures both. A fibration lifting, jointly learns from query context and language semantics (that abductively finds a key to best explain the returned value).
Author: Tie, Gary Nan
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
OpenAlex ID: W4414560658
Cites:
Cited by:
Related to: