attention head pruning
Description: A model-compression technique that removes selected attention heads from transformer networks to reduce computational cost or model size.
Primary topic: Advanced Neural Network Applications (43%)
Related topics: Advanced Neural Network Applications (43%), Topic Modeling (16%)
OpenAlex ID: keywords/attention-head-pruning
