Work

Trusting Machine Learning With Physics: A Fidelity Verification Framework for Complex Systems

Year: 2026

Type: article

Abstract: Neural networks (NN) are embraced to model complex systems based only on data, but their opacity remains a concern. It is unclear whether skill comes from learning physical dependencies or data memorization, which could lead to catastrophic errors. We present a fidelity verification framework, generalizable across disciplines, revealing NN prediction strategies using dynamical regimes and mechanistic indicators. Using an idealized model of Atlantic Meridional Overturning Circulation with hysteresis behavior and scarcely represented tipping points, we target regime prediction in present day and climate change induced unseen scenarios. We use a hierarchy of architectures, including individual and ensemble multilayer perceptrons, long short‐term memory networks, and transformers, and assess aleatoric and epistemic uncertainty with Shapley Additive Explanations and Layer‐wise Relevance Propagation. We verify that many NNs did learn underlying dependencies for skillful prediction, but also reveal a richness in learning strategy across architectures. Our framework offers a mechanistic pathway to demonstrate fidelity, supporting optimism while stressing the need for verification.

Source: Journal of Geophysical Research Machine Learning and Computation

DOI: 10.1029/2025jh001211

Authors: Sanah Suri, Maike Sonnewald

Institutions: University of California, Davis, NOAA Geophysical Fluid Dynamics Laboratory, University of Washington

Language: English

Topic: Model Reduction and Neural Networks

Subfield: Statistical and Nonlinear Physics

Field: Physics and Astronomy

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,500

Funder: National Science Foundation