Work

When Symmetry Breaks: A Monte Carlo and Longitudinal Study of Predictive Invariance, Dataset Shift, and Asymmetric Decision Costs in Respiratory Mortality Risk Models

Year: 2026
Type: article
Abstract: Predictive reliability of artificial intelligence in healthcare extends beyond discrimination, particularly when models are deployed in populations whose epidemiology changes over time. We study how predictive invariance, distributional shift, and asymmetric decision costs jointly shape the robustness of respiratory mortality risk models. A Monte Carlo experiment with known data-generating mechanisms separates prior-probability shift, covariate shift, concept drift, and joint shift, evaluating discrimination, calibration, and decision regret against a Bayes oracle. A longitudinal retrospective analysis of Brazilian SIVEP-Gripe surveillance data (2019–2025) examines temporal and geographic transportability, out-of-time recalibration, and sensitivity to case mix, outcome ascertainment, and predictor timing. In both settings, discrimination remained stable or recovered, while probability accuracy and decision utility deteriorated; covariate shift and concept drift acted differently; and simple recalibration helped in some but not all settings. Invariance, discrimination, calibration, and decision utility are distinct dimensions of robustness that reliable evaluation of clinical artificial intelligence must examine separately under explicit assumptions about distributional change and asymmetric decision consequences.
Source: Symmetry
Language: English
Open Access status: gold
Estimated APC paid: $2,896
OpenAlex ID: W7236796568
FWCI:
Cites: 40
Cited by:
Related to: 10