Neural ODEs - Theory and Application: From Residual Networks to Continuous-Depth Dynamics
Year: 2026
Type: preprint
Abstract: A Neural Ordinary Differential Equation (Neural ODE) uses a neural network to represent a system’s rate of change. This project investigates how well such a model can learn logistic growth from samples of a single solution. We first derive the exact solution using the Bernoulli substitution, then use it to generate 100 noise-free training points. A small neural network represents the growth rate, and a fourth-order Runge–Kutta solver produces the predicted population. In the reference run, the learned trajectory has a root-mean-square error of approximately 0.20 population units over the training points, but eventually exceeds the true carrying capacity. The same overshoot occurs in ten runs with different random initializations. Examining the learned growth rate shows that the models do not recover the equilibrium at the carrying capacity. For this experiment, agreement with the observed growth curve does not guarantee agreement with the system’s long-term behavior.
Source: Valency Hub
DOI: 10.83295/8pvm-8ux2
Author: Sebastian Chegini
Institution: Foothill College
Language: English
Subfield: Statistical and Nonlinear Physics
Field: Physics and Astronomy
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7233176234
