Privilege Is Not Enough: Evaluating Generalized Distillation for Normative Brain Age Modeling in Depression, Anxiety and Alcohol Use Disorder
Year: 2026
Type: preprint
Abstract: Models trained on rich multimodal data may depend on modalities unavailable at deployment. In generalized distillation, a teacher trained on such privileged data guides a student using only deployable features. We ask whether students inherit clinically meaningful properties beyond predictions in brain-age modeling, where brain-age gaps index deviations from normative aging and brain health. In simulations, distillation recovered a gap-severity association which an age-trained baseline missed. In UK Biobank analyses of depression, anxiety, and alcohol use disorder, students using structural MRI, functional MRI or biosocial data produced gaps closer to their teacher's than matched baselines in 10 of 12 comparisons. Where teachers most exceeded baselines (anxiety in biosocial, alcohol use in functional MRI students), gap-severity associations rose toward their teacher's. Our findings characterize conditions for successful distillation, i.e. clinical signal the teacher holds, the baseline misses and deployable features contain, and demonstrate their relevance in a real-life psychiatry application.
Source: medRxiv
Institution: Central Institute of Mental Health
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: green
OpenAlex ID: W7233616072
Cites:
Cited by:
Related to:
