Multimodal contrastive learning on rs-fMRI to quantify whole-brain network recovery after hypothalamic hamartoma surgery
Year: 2025
Type: article
Study design: Observational Study
Abstract: INTRODUCTION: Epilepsy due to hypothalamic hamartoma (HH) is associated with epileptic encephalopathy and often requires surgical intervention, as medications are ineffective at reducing the seizures. However, the first step of disentangling the impact of the surgery on the broader whole-brain networks, a biomarker of encephalopathy compared to controls, is not quantified. Subtle pre- and post-operative networks can elude conventional rs-fMRI analysis. METHODS: We retrospectively analyzed rs-fMRI from 56 HH patients scanned before and 6 months after surgery. We developed a two-stage contrastive learning-based algorithm to classify the motor, vision, language, frontal, and temporal networks as pre- vs post-operative. In stage one, a multimodal contrastive encoder jointly ingests 3D spatial Independent Component Analysis (ICA) maps and their corresponding 1D temporal ICA time series to learn embeddings that distinguish pre-operative from post-operative states for each network while separating embeddings of different networks. In stage two, a lightweight classifier refines these embeddings, augmented by original ICA inputs, to classify each network as pre-operative or post-operative. RESULTS: Visualization of the learned feature space with t-SNE revealed clear separation by pre- vs post-surgical condition across all five networks. Across networks, mean accuracy ranged from 0.85 to 0.90, sensitivity from 0.79 to 0.90, specificity from 0.87 to 0.93, F1-score from 0.83 to 0.90 and AUC from 0.90 to 0.94 in stratified cross validation. CONCLUSIONS: Contrastive learning can sensitively detect functional shifts in critical cortical networks that previous traditional analyses may overlook. These findings inform broader shifts in whole-brain network functioning following effective HH surgery and establish a featurewise distinction between preoperative and postoperative states, motivating future studies that compare HH patients to healthy controls to quantify network recovery.
Source: BioMedical Engineering OnLine
Authors: Andrew Jeyabose, Belfin Robinson, Olivia Leggio, Meitra H. Kazemi, Varina L. Boerwinkle
Institution: University of North Carolina at Chapel Hill
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $2,690
Funders: China Medical Board, Cleveland Clinic, Wellcome Trust, Australian Government, National Institute for Health and Care Research, King's College London, Department of Biotechnology, Ministry of Science and Technology, India, National Natural Science Foundation of China, Ferdowsi University of Mashhad, Nederlandse Organisatie voor Wetenschappelijk Onderzoek, Natural Science Foundation of Guangdong Province, Rural Development Administration, University of Hong Kong, Natural Science Foundation of Hubei Province, Isfahan University of Medical Sciences, Ligue Contre le Cancer, Mazandaran University of Medical Sciences, Natural Science Foundation of Jiangxi Province, Hamadan University of Medical Sciences, Natural Science Foundation of Ningxia Province, Food and Health Bureau, Eva og Henry Frænkels Mindefond, Natural Science Foundation of Shandong Province, Department of Education of Guangdong Province, Science, Technology and Innovation Commission of Shenzhen Municipality, Kom op tegen Kanker, Zhejiang Provincial Ten Thousand Plan for Young Top Talents, Directorate for Biological Sciences, Wu Jieping Medical Foundation, National Outstanding Youth Science Fund Project of National Natural Science Foundation of China, National Health and Medical Research Council, Japan Society for the Promotion of Science, Fundação para a Ciência e a Tecnologia, Beijing Nova Program, European Regional Development Fund, National Key Research and Development Program of China, Bilimsel Araştırma Projeleri, Erciyes Üniversitesi, Basic and Applied Basic Research Foundation of Guangdong Province, National Heart, Lung, and Blood Institute, National Institute of General Medical Sciences, National Institute of Neurological Disorders and Stroke, National Institute on Minority Health and Health Disparities, Medical Science and Technology Project of Zhejiang Province, Natural Science Foundation of Zhejiang Province, Israeli Smart Transportation Research Center, Australian Centre of Research Excellence in Malaria Elimination
OpenAlex ID: W4415666168
