Work

Semantic Transfer Learning

Year: 2026
Type: preprint
Abstract: For the purposes of zero-shot next-token and sequence-to-sequence learning, Noken implicit deep learning models, can be composed and connected into feedback loops, enabling a myriad of network configurations to be explored, and so find ways to lower average entropy. Beyond statistical correlations, this novel attention mechanism is based on semantic architecture. Suppose we have learned the semantics of two different subject domains and want to explore interdisciplinary inquiries. Without starting over from scratch and training on the all combined data (which may in fact muddle matters) we introduce an algorithm to leverage and transfer the individual semantics to make sense of the interdisciplinary corpus.
Language: English
Open Access status: gold
OpenAlex ID: W7119617540
Cites:
Cited by:
Related to: