Teaching an ECG model where to look does not make it more robust to missing leads: a pre-registered comparison of guideline-based attention guidance with random lead masking
Year: 2026
Type: preprint
Abstract: Background Real-world 12-lead electrocardiograms (ECGs) often have missing or corrupted leads. A deep-learning classifier can be prepared for this by random lead masking during training, or by injecting clinical knowledge, for example by pulling its attention towards the leads that guidelines use for each diagnosis. Whether this knowledge adds robustness beyond masking is unknown. Methods Pre-registered comparison of three arms sharing one network (per-lead 1D-ResNet encoder and per-diagnosis attention over the 12 leads): standard training (M0); random whole-lead masking (M1); masking plus a Kullback-Leibler penalty pulling attention towards a fixed guideline-derived key-lead map (M2, guideline-based attention guidance). Six diagnoses; five seeds per arm. Development on PTB-XL (21,799 ECGs); single sealed evaluation on PTB-XL fold 10 (2,198 ECGs) and on CODE-15% (233,204 exams, external validation). Primary endpoint: AUROC difference M2 − M1, averaged over first-degree AV block, right and left bundle branch block and atrial fibrillation and over 1 to 6 lost (zeroed) leads, with a patient-level paired BCa bootstrap 95% confidence interval. Results The guidance did not change robustness: ΔAUROC −0.0010 (95% CI −0.0033 to +0.0006), an interval entirely within the pre-specified ±0.02 margin; the result was unchanged with another bootstrap seed, other interval methods and leave-one-diagnosis-out analyses. Masking improved AUROC: M1 − M0 = +0.0134 (95% CI +0.0102 to +0.0172) when one key lead was lost, and the number of lost leads tolerated before AUROC fell by more than 0.02 rose from 7 (M0) to 10 (M1). M2 attention matched the map and M2 was non-inferior on intact ECGs, but its calibration slope was lower for all six diagnoses in both datasets. M2 lost slightly more when all key leads were lost together (−0.0067) and gained only when one to three leads remained (exploratory; AUROC 0.9408 vs 0.9210 with 11 leads lost). CODE-15% reproduced every pattern (primary −0.0007, 95% CI −0.0011 to −0.0003). Conclusions Random lead masking suffices to make an ECG classifier robust to missing leads; adding guideline knowledge aligns attention with clinical criteria but adds no robustness and worsens calibration. Guideline-aligned attention should not be taken as evidence of robustness.
Source: medRxiv
Authors: Mohamed Nour Bou Ali, Mohamed Mahmoud
Institution: University of Monastir
Language: English
Topic: ECG Monitoring and Analysis
Subfield: Cardiology and Cardiovascular Medicine
Field: Medicine
Domain: Health Sciences
Open Access status: green
OpenAlex ID: W7222955366