When Symmetry Breaks: A Monte Carlo and Longitudinal Study of Predictive Invariance, Dataset Shift, and Asymmetric Decision Costs in Respiratory Mortality Risk Models
Year: 2026
Type: article
Abstract: Predictive reliability of artificial intelligence in healthcare extends beyond discrimination, particularly when models are deployed in populations whose epidemiology changes over time. We study how predictive invariance, distributional shift, and asymmetric decision costs jointly shape the robustness of respiratory mortality risk models. A Monte Carlo experiment with known data-generating mechanisms separates prior-probability shift, covariate shift, concept drift, and joint shift, evaluating discrimination, calibration, and decision regret against a Bayes oracle. A longitudinal retrospective analysis of Brazilian SIVEP-Gripe surveillance data (2019–2025) examines temporal and geographic transportability, out-of-time recalibration, and sensitivity to case mix, outcome ascertainment, and predictor timing. In both settings, discrimination remained stable or recovered, while probability accuracy and decision utility deteriorated; covariate shift and concept drift acted differently; and simple recalibration helped in some but not all settings. Invariance, discrimination, calibration, and decision utility are distinct dimensions of robustness that reliable evaluation of clinical artificial intelligence must examine separately under explicit assumptions about distributional change and asymmetric decision consequences.
Source: Symmetry
DOI: 10.3390/sym18111936
Authors: Pietro Hiram Guzzi(Investigation, Supervision, Visualization, Writing – original draft, Writing – review & editing), Annamaria Defilippo(Investigation, Writing – original draft, Writing – review & editing), Pierangelo Veltri(Supervision, Writing – original draft, Writing – review & editing), Giancarlo Ceccarelli(Investigation, Writing – original draft, Writing – review & editing), Fabio Scarpa(Investigation, Writing – original draft, Writing – review & editing), Massimo Ciccozzi(Supervision, Validation, Writing – original draft, Writing – review & editing), Francesco Branda(Conceptualization, Methodology, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,896
OpenAlex ID: W7236796568
