Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
gradient normalization
Description:
A machine-learning technique that rescales gradients during training, often to influence optimization stability or the behavior of generative models.
Related topics:
Stochastic Gradient Optimization Techniques (17%),
Privacy-Preserving Technologies in Data (9%)
OpenAlex ID:
keywords/gradient-normalization
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
2018
·
Chen Zhao
, Vijay Badrinarayanan
, et al.
·
International Conference on Machine Learning
·
1,544
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
2017
·
Chen, Zhao
, Badrinarayanan, Vijay
, et al.
·
arXiv (Cornell University)
·
947
PDF
Gradient Centralization: A New Optimization Technique for Deep Neural Networks
2020
·
Hongwei Yong
, Jianqiang Huang
, et al.
·
Lecture notes in computer science
·
268
PDF
2. Gradient and Visual Speaker Normalization in the Perception of Fricatives
1996
·
Elizabeth A. Strand
, Keith Johnson
·
De Gruyter eBooks
·
205
The LFOPC leap-frog algorithm for constrained optimization
2000
·
J.A. Snyman
·
Computers & Mathematics with Applications
·
122
PDF
Finger vein extraction using gradient normalization and principal curvature
2009
·
Joon Hwan Choi
, Wonseok Song
, et al.
·
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
·
112
Full Attention Wasserstein GAN With Gradient Normalization for Fault Diagnosis Under Imbalanced Data
2022
·
Jigang Fan
, Xianfeng Yuan
, et al.
·
IEEE Transactions on Instrumentation and Measurement
·
111
Gradient Normalization for Generative Adversarial Networks
2021
·
Yi-Lun Wu
, Hong-Han Shuai
, et al.
·
IEEE/CVF International Conference on Computer Vision (ICCV)
·
110
PDF
An End-to-End Curriculum Learning Approach for Autonomous Driving Scenarios
2022
·
Luca Anzalone
, Paola Barra
, et al.
·
IEEE Transactions on Intelligent Transportation Systems
·
86
PDF
Real-Time Independent Vector Analysis for Convolutive Blind Source Separation
2010
·
Taesu Kim
·
IEEE Transactions on Circuits and Systems I Regular Papers
·
79
Normalized/Clipped SGD with Perturbation for Differentially Private Non-Convex Optimization
2022
·
Yang, Xiaodong
, Zhang, Huishuai
, et al.
·
arXiv (Cornell University)
·
61
PDF
Binary Coherent Edge Descriptors
2010
·
C. Lawrence Zitnick
·
Lecture notes in computer science
·
56
Unleashing the Power of Visual Prompting At the Pixel Level
2024
·
Wu, Junyang
, Li, Xianhang
, et al.
·
Transactions on machine learning research
·
55
PDF
Multi-Gradient Descent for Multi-Objective Recommender Systems
2020
·
Milojkovic, Nikola
, Antognini, Diego
, et al.
·
arXiv (Cornell University)
·
55
PDF
Accumulated Gradient Normalization
2017
·
Hermans, Joeri
, Spanakis, Gerasimos
, et al.
·
arXiv (Cornell University)
·
49
PDF
An Electrochemical Aging-Informed Data-Driven Approach for Health Estimation of Lithium-Ion Batteries With Parameter Inconsistency
2025
·
Shuxin Zhang
, Zhitao Liu
, et al.
·
IEEE Transactions on Power Electronics
·
48
Dual-Balancing for Multi-Task Learning
2023
·
Lin, Baijiong
, Jiang, Weisen
, et al.
·
arXiv (Cornell University)
·
43
PDF
Generating fuzzy edge images from gradient magnitudes
2011
·
C. Lopez-Molina
, B. De Baets
, et al.
·
Computer Vision and Image Understanding
·
40
Farmland Aerial Images Fast-Stitching Method and Application Based on Improved SIFT Algorithm
2022
·
Yuanyuan Liu
, Ming He
, et al.
·
IEEE Access
·
39
Practical Sharpness-Aware Minimization Cannot Converge All the Way to Optima
2023
·
Dongkuk Si
, Chulhee Yun
·
neural information processing systems
·
37
PDF
Spatial Sensitive GRAD-CAM: Visual Explanations for Object Detection by Incorporating Spatial Sensitivity
2022
·
Toshinori Yamauchi
, Masayoshi Ishikawa
·
Proceedings - International Conference on Image Processing
·
33
Intelligent Proximate Analysis of Coal Based on Near-Infrared Spectroscopy and Multioutput Deep Learning
2023
·
Liang Zou
, Jiahui Qiao
, et al.
·
IEEE Transactions on Artificial Intelligence
·
32
The Coverage Principle: How Pre-Training Enables Post-Training
2026
·
Chen, Fan
, Huang, Audrey
, et al.
·
International Conference on Learning Representations
·
31
PDF
SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training
2024
·
Ma, Chao
, Gong, Wenbo
, et al.
·
arXiv (Cornell University)
·
26
PDF
Automatic repetition instruction generation for air traffic control training using multi-task learning with an improved copy network
2022
·
Jianwei Zhang
, Pan Zhang
, et al.
·
Knowledge-Based Systems
·
26
Show more works
View as search
Works count:
216
Citation count:
5,092
Year
Topic
Type