Work

Multimodal Eeg World Model: Self-supervised Latent Transition Learning for Wearable Eeg Seizure Detection

Year: 2026

Type: preprint

Abstract: ABSTRACT Existing supervised and self-supervised EEG models mainly learn within-segment discriminative or reconstructive representations, leaving transitions between adjacent EEG segments underexplored. We propose a self-supervised Multimodal EEG World Model for EEG seizure detection that predicts the latent representation of the next EEG segment from the current EEG state, conditioned on synchronized ECG, EMG, and movement signals. A learnable query-based fusion module aggregates the multimodal synchronized signals into a compact physiological condition. Pretraining uses no seizure labels; downstream detection retains only the frozen EEG encoder and a linear probe. On the SeizeIT2 dataset with a strict patient-wise split, the model achieved an AUPRC of 0.3748±0.0127, ROC-AUC of 0.8025±0.0071, and balanced accuracy of 0.7308±0.0075, outperforming official database baseline (SVM with hand-crafted features, ChronoNet), external baselines (DSAINet) and foundation models (NeuroLM). Ablations show a 14.4% relative AUPRC gain over a random-initialized encoder, supporting multimodal-conditioned latent transition learning for wearable EEG representation learning.

Source: medRxiv

DOI: 10.64898/2026.07.20.26358450