Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
natural gradient
Description:
The natural gradient is an optimization method that adjusts parameter updates using the geometry of a statistical model’s parameter space.
Related topics:
Blind Source Separation Techniques (17%),
Stochastic Gradient Optimization Techniques (10%),
Neural Networks and Applications (8%),
Reinforcement Learning in Robotics (8%)
OpenAlex ID:
keywords/natural-gradient
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
2015
·
Clevert, Djork-Arné
, Unterthiner, Thomas
, et al.
·
arXiv (Cornell University)
·
7,090
PDF
Natural Gradient Works Efficiently in Learning
1998
·
Shun-ichi Amari
·
Neural Computation
·
3,895
Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources
1999
·
Te-Won Lee
, Mark Girolami
, et al.
·
Neural Computation
·
2,140
A New Learning Algorithm for Blind Signal Separation
1995
·
S. Amari
, A. Cichocki
, et al.
·
Institutional Repositories DataBase (IRDB)
·
2,052
Bayesian Learning via Stochastic Gradient Langevin Dynamics
·
Max Welling
, Yee Whye Teh
·
1,853
Online Learning for Latent Dirichlet Allocation
·
Matthew D. Hoffman
, David M. Blei
, et al.
·
1,470
A Natural Policy Gradient
2001
·
Sham M. Kakade
·
ScholarlyCommons (University of Pennsylvania)
·
1,461
PDF
A natural gradient experiment on solute transport in a sand aquifer: Spatial variability of hydraulic conductivity and its role in the dispersion process
1986
·
E. A. Sudicky
·
Water Resources Research
·
1,414
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
2012
·
Ivo Grondman
, Lucian Busoniu
, et al.
·
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)
·
1,287
Natural actor–critic algorithms
2009
·
Shalabh Bhatnagar
, Richard S. Sutton
, et al.
·
Automatica
·
743
A natural gradient experiment on solute transport in a sand aquifer: 1. Approach and overview of plume movement
1986
·
D. M. Mackay
, D. L. Freyberg
, et al.
·
Water Resources Research
·
686
A DIRT-T Approach to Unsupervised Domain Adaptation
2018
·
Shu, Rui
, Bui, Hung H.
, et al.
·
arXiv (Cornell University)
·
657
PDF
Natural evolution strategies
2014
·
WierstraDaan
, SchaulTom
, et al.
·
Journal of Machine Learning Research
·
584
NGBoost: Natural Gradient Boosting for Probabilistic Prediction
2020
·
Tony Duan
, Anand Avati
, et al.
·
International Conference on Machine Learning
·
538
Composing graphical models with neural networks for structured representations and fast inference
2016
·
Johnson, Matthew J.
, Duvenaud, David
, et al.
·
arXiv (Cornell University)
·
507
PDF
Natural Evolution Strategies
2008
·
Daan Wierstra
, Tom Schaul
, et al.
·
IEEE Congress on Evolutionary Computation (CEC)
·
477
PDF
Long-term ecological dynamics: reciprocal insights from natural and anthropogenic gradients
2005
·
Tadashi Fukami
, David A Wardle
·
Proceedings of the Royal Society B Biological Sciences
·
474
Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
2002
·
Nicol N. Schraudolph
·
Neural Computation
·
445
Revisiting Natural Gradient for Deep Networks
2013
·
Pascanu, Razvan
, Bengio, Yoshua
·
arXiv (Cornell University)
·
409
PDF
Stable and fast update rules for independent vector analysis based on auxiliary function technique
2011
·
Nobutaka Ono
·
IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
·
403
Natural Evolution Strategies
·
Tobias Glasmachers
, Daan Wierstra
, et al.
·
352
Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information
1997
·
Howard Hua Yang
, Shun-ichi Amari
·
Neural Computation
·
348
NGBoost: Natural Gradient Boosting for Probabilistic Prediction
2019
·
Duan, Tony
, Avati, Anand
, et al.
·
arXiv (Cornell University)
·
346
PDF
Integrating Experimental and Gradient Methods in Ecological Climate Change Research
2004
·
Jennifer A. Dunne
, Scott R. Saleska
, et al.
·
Ecology
·
328
A natural gradient experiment on solute transport in a sand aquifer: 3. Retardation estimates and mass balances for organic solutes
1986
·
Paul V. Roberts
, Mark N. Goltz
, et al.
·
Water Resources Research
·
323
Show more works
View as search
Works count:
934
Citation count:
43,640
Year
Topic
Type