SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
Year: 2021
Type: article
Abstract: We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at doic https://w3id.org/synthmorph.
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,045
Funders: Alzheimer’s Research UK, National Institutes of Health, European Research Council, National Institute on Aging, National Institute of Mental Health, National Institute of Neurological Disorders and Stroke, National Institute of Biomedical Imaging and Bioengineering, National Center for Research Resources, Eunice Kennedy Shriver National Institute of Child Health and Human Development
Awards: G1162822636, G1228769380, G1243485958, Diagnosing the undiagnosable: studies of Alzheimer disease mimics and confounders via "neuropathometry" of dissection photos with 3D scanning, G1427290713, G15294626, G1540917792, G1602390028, G1840865139, G1848923949, G187944815, Mapping Abnormal Neurodevelopment in Schizophrenia, G2058387751, G2058492296, G2100347653, G2227408383, G2648347921, G3009596013, G323562261, G3336587530, G3382955721, Segmenting Brain Structures for Neurological Disorders, G3507538372, G3720150018, G393103480, G40706755, G424209889, G4427631003, G462471744, G5421070557, G6062652376, G6073090889, Computeserver Structural &Functional Image Analysis, Neuropathology of CTE and Delayed Effects of TBI: Toward In-Vivo Diagnostics, MRI, Genetics & Cognitive Precursors of AD and Dementia, Open-source software for multi-scale mapping of the human brain, Alzheimer's Disease Research Center, Deep Learning Algorithms for FreeSurfer, G7788694070, Tools for Analyzing Cortical Structure and Connectivity, G8538380161, Mapping the Human Connectome During Typical Aging, A Storage Area Network for Structural and Functional Image Analysis, FreeSurfer Development, Maintenance, and Hardening, Alzheimer's Disease Research Center, Antecedent Biomarkers for Alzheimer Disease: The Adult Children Study, Silicon Graphics Prism Extreme 128P/1TB
OpenAlex ID: W3204867994
