Year: 2026
Type: article
Abstract: Wearable sensor systems are being increasingly deployed in real-world environments to monitor human activities and cognitive states. However, such systems frequently suffer from degraded or missing sensor modalities due to occlusions, energy constraints, or hardware failures. In this work, we introduce CognifySSL v2.0, a self-supervised learning framework designed to detect and repair missing modalities in real time under simulated real-world missing-modality conditions. The model combines contrastive and masked modeling objectives across multiple physiological and motion signals (e.g., IMU, ECG, EDA) using a fusion architecture with dropout simulation. Evaluation on WESAD demonstrated effective multimodal detection and reconstruction under missing-modality conditions, while experiments on MobiAct validated unimodal robustness and representation learning under sensor dropout. We released our code and interactive visualization dashboard to support reproducibility and future research on robust multimodal fusion.
Source: Sensors
DOI: 10.3390/s26082419
Authors: Aboul Hassane Cisse, Shoya Ishimaru
Institution: Osaka Metropolitan University
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W7154500912
FWCI:
Cites:
Cited by:
Related to: