activation sparsity
Description: A property of neural networks in which only a small fraction of units produce nonzero activations, reducing computation in inference hardware.
Primary topic: Advanced Neural Network Applications (49%)
OpenAlex ID: keywords/activation-sparsity
