Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
layer normalization
Description:
A neural network normalization method that scales and shifts features within each layer to stabilize model training and inference.
Related topics:
Advanced Neural Network Applications (14%),
Topic Modeling (12%),
Neural Networks and Applications (8%)
Wikidata ID:
wiki/Q121322460
OpenAlex ID:
keywords/layer-normalization
Layer Normalization
2016
·
Ba, Jimmy Lei
, Kiros, Jamie Ryan
, et al.
·
arXiv (Cornell University)
·
14,738
PDF
Root Mean Square Layer Normalization
2019
·
Zhang, Biao
, Sennrich, Rico
·
arXiv (Cornell University)
·
1,855
PDF
ParseNet: Looking Wider to See Better
2015
·
Liu, Wei
, Rabinovich, Andrew
, et al.
·
arXiv (Cornell University)
·
1,315
PDF
On Layer Normalization in the Transformer Architecture
2020
·
Xiong, Ruibin
, Yang, Yunchang
, et al.
·
arXiv (Cornell University)
·
1,111
PDF
Learning Deep Transformer Models for Machine Translation
2019
·
Qiang Wang
, Bei Li
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
1,004
Towards Stable Test-Time Adaptation in Dynamic Wild World
2023
·
Niu, Shuaicheng
, Wu, Jiaxiang
, et al.
·
arXiv (Cornell University)
·
682
PDF
Understanding and Improving Layer Normalization
2019
·
Xu, Jingjing
, Sun, Xu
, et al.
·
arXiv (Cornell University)
·
410
PDF
DeepNet: Scaling Transformers to 1,000 Layers
2024
·
Hongyu Wang
, Shuming Ma
, et al.
·
IEEE Transactions on Pattern Analysis and Machine Intelligence
·
328
PDF
Transformers without Normalization
2025
·
Jiachen Zhu
, Xinlei Chen
, et al.
·
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
·
327
PDF
Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks
2018
·
Chunjie Luo
, Jianfeng Zhan
, et al.
·
Lecture notes in computer science
·
296
PDF
QUOTIENT: Two-Party Secure Neural Network Training and Prediction
2019
·
Nitin Agrawal
, Ali Shahin Shamsabadi
, et al.
·
ACM SIGSAC Conference on Computer and Communications Security (CCS)
·
276
PDF
An Exponential Learning Rate Schedule for Deep Learning
2019
·
Li, Zhiyuan
, Arora, Sanjeev
·
arXiv (Cornell University)
·
268
PDF
Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
2022
·
Sehoon Kim
, Amir Gholami
, et al.
·
neural information processing systems
·
240
PDF
Choose a Transformer: Fourier or Galerkin
2021
·
Cao, Shuhao
·
arXiv (Cornell University)
·
226
PDF
Full Stack Optimization of Transformer Inference: a Survey
2023
·
Kim, Sehoon
, Hooper, Coleman
, et al.
·
arXiv (Cornell University)
·
215
PDF
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
2022
·
Tianyu Chen
, Hangbo Bao
, et al.
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
203
PDF
Deep Recursive Network Embedding with Regular Equivalence
2018
·
Ke Tu
, Peng Cui
, et al.
·
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
·
203
GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training
2020
·
Cai, Tianle
, Luo, Shengjie
, et al.
·
arXiv (Cornell University)
·
167
PDF
Overcoming a Theoretical Limitation of Self-Attention
2022
·
David Chiang
, Peter Cholak
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
165
PDF
Dropout Q-Functions for Doubly Efficient Reinforcement Learning
2021
·
Hiraoka, Takuya
, Imagawa, Takahisa
, et al.
·
arXiv (Cornell University)
·
145
PDF
GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-To-Speech
2022
·
Rongjie Huang
, Yi Ren
, et al.
·
neural information processing systems
·
137
PDF
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction
2022
·
Kaifeng Lyu
, Zhiyuan Li
, et al.
·
neural information processing systems
·
131
PDF
PUMA: Secure inference of LLaMA-7B in five minutes
2025
·
Ye Dong
, Wen-Jie Lu
, et al.
·
Security and Safety
·
128
PDF
MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Mask
2021
·
Wang, Zhiqiang
, She, Qingyun
, et al.
·
arXiv (Cornell University)
·
126
PDF
NormFormer: Improved Transformer Pretraining with Extra Normalization
2021
·
Shleifer, Sam
, Weston, Jason
, et al.
·
arXiv (Cornell University)
·
125
PDF
Show more works
View as search
Works count:
786
Citation count:
32,740
Year
Topic
Type