Challenges in Automatic Differentiation and Numerical Integration in Physics‐Informed Neural Networks Modelling
Year: 2025
Type: article
Abstract: ABSTRACT In this paper, we numerically examine the precision challenges that emerge in automatic differentiation and numerical integration in various tasks now tackled by physics‐informed neural networks (PINNs). Specifically, we illustrate how ill‐posed problems or inaccurately computed functions can cause serious precision issues in differentiation and integration. A major difficulty lies in detecting these problems. A simple, large‐scale view of the function, or good‐looking loss functions or convergence results, may not reveal any potential errors, and the resulting outcomes are often mistakenly considered correct. To address this, it is often critical to determine whether standard double‐precision arithmetic suffices or if higher precision is necessary, but using higher precision arithmetic with neural networks does not have to bring an improvement at all. Three problematic use cases for solving differential equations using PINNs are analyzed in detail. For the case requiring numerical integration, we also evaluate several numerical quadrature methods and suggest particular numerical analysis steps to choose the most suitable method.
DOI: 10.1002/nme.70148
Authors: Josef Daněk, Jan Pospíšil
Institution: University of West Bohemia in Pilsen
Language: English
Subfield: Statistical and Nonlinear Physics
Field: Physics and Astronomy
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $4,250
OpenAlex ID: W7091640445