Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
ReLU activation
Description:
An activation function in artificial neural networks that outputs zero for negative inputs and passes positive inputs through unchanged.
Related topics:
Neural Networks and Applications (18%),
Advanced Neural Network Applications (11%),
Stochastic Gradient Optimization Techniques (8%)
OpenAlex ID:
keywords/relu-activation-function
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks
2017
·
Guy Katz
, Clark Barrett
, et al.
·
Lecture notes in computer science
·
2,508
A Convergence Theory for Deep Learning via Over-Parameterization
2018
·
Allen-Zhu, Zeyuan
, Li, Yuanzhi
, et al.
·
arXiv (Cornell University)
·
1,642
PDF
Nonparametric regression using deep neural networks with ReLU activation function
2020
·
Johannes Schmidt-Hieber
·
The Annals of Statistics
·
1,374
PDF
Convergence Analysis of Two-layer Neural Networks with ReLU Activation
2017
·
Li, Yuanzhi
, Yuan, Yang
·
arXiv (Cornell University)
·
705
PDF
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks
2017
·
Bartlett, Peter L.
, Harvey, Nick
, et al.
·
arXiv (Cornell University)
·
689
PDF
Fast and Effective Robustness Certification
2018
·
Gagandeep Singh
, Timon Gehr
, et al.
·
neural information processing systems
·
584
A comparison of deep networks with ReLU activation function and linear spline-type methods
2018
·
Konstantin Eckle
, Johannes Schmidt-Hieber
·
Neural Networks
·
455
PDF
On the Computational Efficiency of Training Neural Networks
2014
·
Livni, Roi
, Shalev-Shwartz, Shai
, et al.
·
arXiv (Cornell University)
·
451
PDF
Deep vs. shallow networks: An approximation theory perspective
2016
·
H. N. Mhaskar
, T. Poggio
·
Analysis and Applications
·
427
PDF
An approach to reachability analysis for feed-forward ReLU neural networks
2017
·
Lomuscio, Alessio
, Maganti, Lalit
·
arXiv (Cornell University)
·
416
PDF
Improvement of learning for CNN with ReLU activation by sparse regularization
2017
·
Hidenori Ide
, Takio Kurita
·
International Joint Conference on Neural Networks (IJCNN)
·
408
Neural network approximation
2021
·
Ronald DeVore
, Boris Hanin
, et al.
·
Acta Numerica
·
406
PDF
On the Practical Computational Power of Finite Precision RNNs for Language Recognition
2018
·
Gail Weiss
, Yoav Goldberg
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
384
PDF
NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems
2020
·
Hoang-Dung Tran
, Xiaodong Yang
, et al.
·
Lecture notes in computer science
·
373
PDF
Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss
2020
·
Chizat, Lenaic
, Bach, Francis
·
arXiv (Cornell University)
·
363
PDF
Identity Matters in Deep Learning
2016
·
Hardt, Moritz
, Ma, Tengyu
·
arXiv (Cornell University)
·
335
PDF
On the rate of convergence of fully connected deep neural network regression estimates
2021
·
Michael Kohler
, Sophie Langer
·
The Annals of Statistics
·
331
PDF
Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputs
2017
·
Brutzkus, Alon
, Globerson, Amir
·
arXiv (Cornell University)
·
297
PDF
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks
2019
·
Lyu, Kaifeng
, Li, Jian
·
arXiv (Cornell University)
·
283
PDF
CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU
2021
·
Sijun Tan
, Brian Knott
, et al.
·
IEEE Symposium on Security and Privacy (S&P)
·
282
PDF
Topology of deep neural networks
2020
·
Naitzat, Gregory
, Zhitnikov, Andrey
, et al.
·
arXiv (Cornell University)
·
265
PDF
Deep learning convolutional neural network in rainfall–runoff modelling
2020
·
Song Pham Van
, Hoang Minh Le
, et al.
·
Journal of Hydroinformatics
·
263
A Universal Approximation Theorem of Deep Neural Networks for Expressing Probability Distributions
2020
·
Lu, Yulong
, Lu, Jianfeng
·
arXiv (Cornell University)
·
259
PDF
A Stacked Autoencoder-Based Deep Neural Network for Achieving Gearbox Fault Diagnosis
2018
·
Guifang Liu
, Huaiqian Bao
, et al.
·
Mathematical Problems in Engineering
·
259
PDF
Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced
2018
·
Du, Simon S.
, Hu, Wei
, et al.
·
arXiv (Cornell University)
·
259
PDF
Show more works
View as search
Works count:
1,504
Citation count:
31,270
Year
Topic
Type