Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
ELU
Description:
An activation function used in neural networks, short for Exponential Linear Unit, which applies an exponential curve to negative inputs.
Primary topic:
Neural Networks and Applications (25%)
Related topics:
Neural Networks and Applications (25%),
Advanced Neural Network Applications (11%)
OpenAlex ID:
keywords/elu
Gaussian Error Linear Units (GELUs)
2016
·
Hendrycks, Dan
, Gimpel, Kevin
·
arXiv (Cornell University)
·
10,964
PDF
Activation functions in deep learning: A comprehensive survey and benchmark
2022
·
Shiv Ram Dubey
, Satish Kumar Singh
, et al.
·
Neurocomputing
·
1,824
PDF
Systematic evaluation of convolution neural network advances on the Imagenet
2017
·
Dmytro Mishkin
, Nikolay Sergievskiy
, et al.
·
Computer Vision and Image Understanding
·
385
PDF
RELU-Function and Derived Function Review
2022
·
Yuhan Bai
·
SHS Web of Conferences
·
231
PDF
Batch Normalization in Convolutional Neural Networks — A comparative study with CIFAR-10 data
2018
·
Vignesh Thakkar
, Suman Tewary
, et al.
·
International Conference on Emerging Applications of Information Technology
·
182
Inheritance, Defaults and the Lexicon
1994
·
Ted Briscoe Valeria
, Valeria De Paiva
, et al.
·
Cambridge University Press eBooks
·
144
RSigELU: A nonlinear activation function for deep neural networks
2021
·
Serhat Kiliçarslan
, Mete Celik
·
Expert Systems with Applications
·
135
The Role of Activation Function in CNN
2020
·
Wang Hao
, Wang Yizhou
, et al.
·
International Conference on Information Technology and Computer Application (ITCA)
·
108
Low-threshold all-optical nonlinear activation function based on a Ge/Si hybrid structure in a microring resonator
2022
·
Bo Wu
, Hengkang Li
, et al.
·
Optical Materials Express
·
103
An overview of the activation functions used in deep learning algorithms
2021
·
Serhat Kılıçarslan
, Kemal Adem
, et al.
·
journal of new results in science
·
90
PDF
Improving Deep Learning by Inverse Square Root Linear Units (ISRLUs)
2017
·
Carlile, Brad
, Delamarter, Guy
, et al.
·
arXiv (Cornell University)
·
64
PDF
Deep Learning Activation Functions: Fixed-Shape, Parametric, Adaptive, Stochastic, Miscellaneous, Non-Standard, Ensemble
2024
·
Hammad, M. M.
·
arXiv (Cornell University)
·
55
PDF
Learning with Type-2 Fuzzy activation functions to improve the performance of Deep Neural Networks
2019
·
Aykut Beke
, Tufan Kumbasar
·
Engineering Applications of Artificial Intelligence
·
51
Enhancing batch normalized convolutional networks using displaced rectifier linear units: A systematic comparative study
2019
·
David Macêdo
, Cleber Zanchettin
, et al.
·
Expert Systems with Applications
·
49
AFibri-Net: A Lightweight Convolution Neural Network Based Atrial Fibrillation Detector
2023
·
Nabasmita Phukan
, M. Sabarimalai Manikandan
, et al.
·
IEEE Transactions on Circuits and Systems I Regular Papers
·
46
Deep Network Approximation: Beyond ReLU to Diverse Activation Functions
2023
·
Zhang, Shijun
, Lu, Jianfeng
, et al.
·
arXiv (Cornell University)
·
45
PDF
Analysis of Non-Linear Activation Functions for Classification Tasks Using Convolutional Neural Networks
2018
·
Aman Dureja
, Payal Pahwa
·
Recent Advances in Computer Science and Communications
·
43
Programmable low-power consumption all-optical nonlinear activation functions using a micro-ring resonator with phase-change materials
2022
·
Ziling Fu
, Zhi Wang
, et al.
·
Optics Express
·
42
Soft++, a multi-parametric non-saturating non-linearity that improves convergence in deep neural architectures
2019
·
Andrei Ciuparu
, Adriana Nagy-Dăbâcan
, et al.
·
Neurocomputing
·
39
PDF
An Evaluation of Parametric Activation Functions for Deep Learning
2019
·
Luke B. Godfrey
·
Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
·
38
Transfer Learning for Leaf Small Dataset Using Improved ResNet50 Network with Mixed Activation Functions
2022
·
Ruolei Zhang
, Yijun Zhu
, et al.
·
Forests
·
36
PDF
Impact of activation functions and number of layers on detection of exudates using circular Hough transform and convolutional neural networks
2022
·
Kemal Adem
·
Expert Systems with Applications
·
35
Belief revision, minimal change and relaxation: A general framework based on satisfaction systems, and applications to description logics
2017
·
Marc Aiguier
, Jamal Atif
, et al.
·
Artificial Intelligence
·
33
PDF
Effect of Activation Functions on the Training of Overparametrized Neural Nets
2019
·
Panigrahi, Abhishek
, Shetty, Abhishek
, et al.
·
arXiv (Cornell University)
·
30
PDF
The influence of the activation function in a capsule network for brain tumor type classification
2021
·
Kwabena Adu
, Yongbin Yu
, et al.
·
International Journal of Imaging Systems and Technology
·
28
Show more works
View as search
Works count:
215
Citation count:
15,400
Year
Topic
Type