To assure aviation safety: the pilot fatigue detection based on short-term multimodal physiological signals
Year: 2026
Type: article
Abstract: Pilot fatigue detection based on physiological signals is practical for aviation safety. Current methods face challenges in balancing the high computational cost of deep learning models with robust accuracy, especially when integrating short-term multimodal physiological signals. To address these challenges, this paper proposes a framework for fast, accurate, and robust pilot fatigue detection by fusing features from electroencephalogram (EEG) and electrocardiogram (ECG) signals. The primary novelty of this work lies in a streamlined selection and classification strategy that overcomes the intrinsic limitations of Heart Rate Variability (HRV) analysis in short (2-s) segments while maintaining competitive accuracy at a drastically lower training cost. Specifically, by utilizing statistical ECG features, which are then integrated with EEG markers through a two-stage ANOVA-SVM feature selection process. The optimized, low-dimensional feature set is then classified using an XGBoost model. Evaluated on data from 32 pilots, the framework demonstrated robust generalization with an accuracy of 88.42% in rigorous cross-subject cross-validation, significantly outperforming our previous EEG-only ASFT-Transformer. While standard cross-clip validation yielded a higher accuracy of 98.36%, the cross-subject metric highlights the model's potential utility for unseen individuals. Crucially, the framework achieves this performance with an average training time of only 39.3 s, a drastic reduction compared to mainstream deep learning models. By striking a balance between accuracy, generalization, and efficiency, this study presents a promising and feasible approach for objective pilot fatigue management.
Source: Frontiers in Human Neuroscience
Institution: Nanjing University of Aeronautics and Astronautics
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $3,801
Awards: G2198545598, G3150447986, G7048486343
OpenAlex ID: W7127190644
