induction heads
Description: Attention heads in transformer language models that implement a copying-like pattern mechanism supporting sequence continuation and in-context learning.
Primary topic: Topic Modeling (44%)
Related topics: Topic Modeling (44%), Explainable Artificial Intelligence (XAI) (25%)
OpenAlex ID: keywords/induction-heads
