Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
random initialization
Description:
A stochastic procedure for choosing initial values of model parameters or algorithmic states in machine learning, optimization, and numerical computation.
Related topics:
Stochastic Gradient Optimization Techniques (13%),
Neural Networks and Applications (13%)
OpenAlex ID:
keywords/random-initialization
Understanding the difficulty of training deep feedforward neural networks
2010
·
Xavier Glorot
, Yoshua Bengio
·
International Conference on Artificial Intelligence and Statistics
·
24,164
On the importance of initialization and momentum in deep learning
2013
·
Ilya Sutskever
, James Martens
, et al.
·
International Conference on Machine Learning
·
5,937
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
2018
·
Frankle, Jonathan
, Carbin, Michael
·
arXiv (Cornell University)
·
3,312
PDF
A Convergence Theory for Deep Learning via Over-Parameterization
2018
·
Allen-Zhu, Zeyuan
, Li, Yuanzhi
, et al.
·
arXiv (Cornell University)
·
1,641
PDF
Rethinking the Value of Network Pruning
2018
·
Liu, Zhuang
, Sun, Mingjie
, et al.
·
arXiv (Cornell University)
·
1,620
PDF
Rethinking ImageNet Pre-Training
2019
·
Kaiming He
, Ross Girshick
, et al.
·
IEEE/CVF International Conference on Computer Vision (ICCV)
·
1,455
PDF
Fast is better than free: Revisiting adversarial training
2020
·
Wong, Eric
, Rice, Leslie
, et al.
·
arXiv (Cornell University)
·
1,320
PDF
Gradient Descent Provably Optimizes Over-parameterized Neural Networks
2018
·
Du, Simon S.
, Zhai, Xiyu
, et al.
·
arXiv (Cornell University)
·
1,200
PDF
An empirical comparison of four initialization methods for the K-Means algorithm
1999
·
J.M Peña
, J.A Lozano
, et al.
·
Pattern Recognition Letters
·
991
Deep Ensembles: A Loss Landscape Perspective
2019
·
Fort, Stanislav
, Hu, Huiyi
, et al.
·
arXiv (Cornell University)
·
932
PDF
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks
2019
·
Arora, Sanjeev
, Du, Simon S.
, et al.
·
arXiv (Cornell University)
·
857
PDF
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.
2019
·
Jonathan Frankle
, Michael Carbin
·
DSpace@MIT (Massachusetts Institute of Technology)
·
834
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data
2018
·
Li, Yuanzhi
, Liang, Yingyu
·
arXiv (Cornell University)
·
571
PDF
The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training
2009
·
Dumitru Erhan
, Pierre-Antoine Manzagol
, et al.
·
International Conference on Artificial Intelligence and Statistics
·
525
Absence of Barren Plateaus in Quantum Convolutional Neural Networks
2021
·
Arthur Pesah
, M. Cerezo
, et al.
·
Physical Review X
·
524
PDF
Initialization is critical for preserving global data structure in both t-SNE and UMAP
2021
·
Dmitry Kobak
, George C. Linderman
·
Nature Biotechnology
·
475
PDF
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
2020
·
Allen-Zhu, Zeyuan
, Li, Yuanzhi
·
arXiv (Cornell University)
·
466
PDF
Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks
2019
·
Cao, Yuan
, Gu, Quanquan
·
arXiv (Cornell University)
·
419
PDF
A review on weight initialization strategies for neural networks
2021
·
Meenal V. Narkhede
, Prashant P. Bartakke
, et al.
·
Artificial Intelligence Review
·
412
Global Optimality of Local Search for Low Rank Matrix Recovery
2016
·
Bhojanapalli, Srinadh
, Neyshabur, Behnam
, et al.
·
arXiv (Cornell University)
·
409
PDF
Toward Moderate Overparameterization: Global Convergence Guarantees for Training Shallow Neural Networks
2020
·
Samet Oymak
, Mahdi Soltanolkotabi
·
IEEE Journal on Selected Areas in Information Theory
·
404
PDF
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask
2019
·
Zhou, Hattie
, Lan, Janice
, et al.
·
arXiv (Cornell University)
·
376
PDF
Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks
2015
·
Lee, Stefan
, Purushwalkam, Senthil
, et al.
·
arXiv (Cornell University)
·
371
PDF
Proving the Lottery Ticket Hypothesis: Pruning is All You Need
2020
·
Malach, Eran
, Yehudai, Gilad
, et al.
·
arXiv (Cornell University)
·
359
PDF
Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization
2006
·
L.I. Kuncheva
, D.P. Vetrov
·
IEEE Transactions on Pattern Analysis and Machine Intelligence
·
350
Show more works
View as search
Works count:
939
Citation count:
47,070
Year
Topic
Type