Year: 2025
Type: article
Abstract: We prove deep neural network (DNN for short) expressivity rate bounds for solution sets of a model class of singularly perturbed, elliptic two-point boundary value problems, in Sobolev norms, on the bounded interval $$(-1,1)$$ ( - 1 , 1 ) . We assume that the given source term and reaction coefficient are analytic in $$[-1,1]$$ [ - 1 , 1 ] . The expression rate bounds in Sobolev norms in terms of the NN size are robust, i.e. uniform with respect to the singular perturbation parameter $$\varepsilon \in (0,1]$$ ε ∈ ( 0 , 1 ] for several classes of DNN architectures. In particular, ReLU NNs, spiking NNs, and $$\tanh $$ tanh - and sigmoid-activated NNs. The latter activations can represent “exponential boundary layer solution features” explicitly, in the last hidden layer of the DNN, i.e. in a shallow subnetwork, and afford improved robust expression rate bounds in terms of the NN size. All DNN architectures allow robust exponential solution expression in so-called ‘energy’ as well as in ‘balanced’ Sobolev norms, for analytic input data.
Source: Numerische Mathematik
Authors: J. A. A. Opschoor, Ch. Schwab, C. Xenophontos
Institutions: ETH Zurich, Seminar for Applied Mathematics, University of Cyprus
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,190
OpenAlex ID: W4414530370