Multilayer Feedforward Networks With Non-polynomial Activation Functions Can Approximate Any Function
Year: 1991
Type: preprint
Abstract: Several researchers characterized the activation functions under which multilayer feedforward networks can act as universal approximators. We show that all the characterizations that were reported thus far in the literature ark special cases of the following general result: a standard multilayer feedforward network can approximate any continuous function to any degree of accuracy if and only if the network's activation functions are not polynomial. We also emphasize the important role of the threshold, asserting that without it the last theorem doesn't hold.
Source: SSRN Electronic Journal
Authors: Moshe Leshno, Shimon Schocken
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W1694116470
