Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
singular learning theory
Description:
A framework in statistical learning theory for analyzing models with singular parameter spaces, including neural networks and mixture models.
Related topics:
Neural Networks and Applications (14%),
Stochastic Gradient Optimization Techniques (10%),
Statistical Methods and Inference (9%)
OpenAlex ID:
keywords/singular-learning-theory
Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory
2010
·
Watanabe, Sumio
·
arXiv (Cornell University)
·
2,311
PDF
Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory
2010
·
渡邊, 澄夫
·
Institutional Repositories DataBase (IRDB)
·
1,953
Deep Learning Is Singular, and That’s Good
2022
·
Susan Wei
, Daniel Murfet
, et al.
·
IEEE Transactions on Neural Networks and Learning Systems
·
68
PDF
Loss Landscape Degeneracy and Stagewise Development in Transformers
2024
·
Hoogland, Jesse
, Wang, George
, et al.
·
Transactions on machine learning research
·
64
The Local Learning Coefficient: A Singularity-Aware Complexity Measure
2023
·
Lau, Edmund
, Furman, Zach
, et al.
·
arXiv (Cornell University)
·
41
PDF
Algebraic methods for evaluating integrals In Bayesian statistics
2011
·
Shaowei Lin
·
eScholarship (California Digital Library)
·
41
Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient
2024
·
Wang, George
, Hoogland, Jesse
, et al.
·
International Conference on Learning Representations
·
37
Consideration on the learning efficiency of multiple-layered neural networks with linear units
2024
·
Miki Aoyagi
·
Neural Networks
·
30
Dynamical Versus Bayesian Phase Transitions in a Toy Model of Superposition
2026
·
Zhongtian Chen
, Edmund Lau
, et al.
·
IEEE Transactions on Neural Networks and Learning Systems
·
25
PDF
Using Degeneracy in the Loss Landscape for Mechanistic Interpretability
2024
·
Bushnaq, Lucius
, Mendel, Jake
, et al.
·
arXiv (Cornell University)
·
18
PDF
Numerical analysis near singularities in RBF networks
2018
·
Weili Guo
, Haikun Wei
, et al.
·
DR-NTU (Nanyang Technological University)
·
13
Compressibility Measures Complexity: Minimum Description Length Meets Singular Learning Theory
2025
·
Urdshals, Einar
, Lau, Edmund
, et al.
·
Transactions on machine learning research
·
9
PDF
A Basin-Selection Perspective on Grokking via Singular Learning Theory
2026
·
Cullen, Ben
, Estan-Ruiz, Sergio
, et al.
·
arXiv (Cornell University)
·
8
PDF
Bayesian Free Energy of Deep ReLU Neural Network in Overparametrized Cases
2023
·
Nagayasu, Shuya
, Watanabe, Sumio
·
arXiv (Cornell University)
·
8
PDF
Asymptotic Bayesian Generalization Error in Latent Dirichlet Allocation and Stochastic Matrix Factorization
2020
·
Naoki Hayashi
, Sumio Watanabe
·
SN Computer Science
·
8
PDF
Influence Dynamics and Stagewise Data Attribution
2025
·
Lee, Jin Hwa
, Smith, Matthew
, et al.
·
International Conference on Learning Representations
·
7
Dead Directions: Geometric Singular Learning
2026
·
Shirodkar, Tejas Pradeep
·
arXiv (Cornell University)
·
6
PDF
Singular Learning Theory for Factor Analysis
2025
·
Drton, Mathias
, Gross, Elizabeth
, et al.
·
arXiv (Cornell University)
·
6
PDF
Variational Bayesian Neural Networks via Resolution of Singularities
2024
·
Susan Wei
, Edmund Lau
·
Journal of Computational and Graphical Statistics
·
6
PDF
Stagewise Reinforcement Learning and the Geometry of the Regret Landscape
2026
·
Elliott, Chris
, Urdshals, Einar
, et al.
·
arXiv (Cornell University)
·
5
PDF
Singular leaning coefficients and efficiency in learning theory
2025
·
Aoyagi, Miki
·
arXiv (Cornell University)
·
5
PDF
Geometry of fibers of the multiplication map of deep linear neural networks
2024
·
Lehalleur, Simon Pepin
, Rimányi, Richárd
·
arXiv (Cornell University)
·
5
PDF
SLT-driven deep networks for robust and generalizable cyber threat detection
2026
·
Suneeta Satpathy
, Saswati Chatterjee
, et al.
·
Discover Computing
·
3
PDF
A singular learning theory for unified large language model pruning
2025
·
Xinyu Wang
, Zhaoxin Fan
, et al.
·
Neurocomputing
·
3
Programs as Singularities
2025
·
Murfet, Daniel
, Troiani, Will
·
arXiv (Cornell University)
·
3
PDF
Show more works
View as search
Works count:
102
Citation count:
5,088
Year
Topic
Type