Work

A conceptual framework for evaluating neural networks as instruments of scientific discovery

Year: 2026
Type: article
Abstract: Neural networks are increasingly used not only for prediction, but also as instruments for simulation, inverse modeling, operator learning, representation learning, and hypothesis generation. This perspective argues that their scientific value cannot be assessed by predictive accuracy alone. Architectures such as physics-informed neural networks, neural operators, graph and equivariant models, Kolmogorov-Arnold Networks, long-sequence models, and foundation models for science illustrate a broader transition from data-driven fitting toward computational systems that interact with theory, experiment, and domain constraints. However, this transition also exposes methodological risks: data leakage, weak external validation, poor uncertainty quantification, limited interpretability, reproducibility gaps, and overconfidence under distribution shift. To address these issues, this article proposes the Scientific Consistency and Interpretability Framework for Neural Networks (SCI-NN), a conceptual appraisal framework for scientific neural networks based on eight dimensions: accuracy, scientific consistency, generalization, interpretability, uncertainty, computational efficiency, reproducibility, and scientific utility. Its primary use is qualitative, claim-centered appraisal; optional ordinal descriptors summarize the reported evidence without producing an overall ranking. The literature and worked examples are illustrative rather than systematic or validating. SCI-NN does not certify model validity, and its reliability and added value require empirical evaluation.
Language: English
Open Access status: hybrid
OpenAlex ID: W7235006692
FWCI:
Cites: 67
Cited by:
Related to: 10