SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth
Year: 2018
Type: article
Abstract: A key limitation of deep convolutional neural networks (DCNN) based image segmentation methods is the lack of generalizability. Manually traced training images are typically required when segmenting organs in a new imaging modality or from distinct disease cohort. The manual efforts can be alleviated if the manually traced images in one imaging modality (e.g., MRI) are able to train a segmentation network for another imaging modality (e.g., CT). In this paper, we propose an end-to-end synthetic segmentation network (SynSeg-Net) to train a segmentation network for a target imaging modality without having manual labels. SynSeg-Net is trained by using (1) unpaired intensity images from source and target modalities, and (2) manual labels only from source modality. SynSeg-Net is enabled by the recent advances of cycle generative adversarial networks (CycleGAN) and DCNN. We evaluate the performance of the SynSeg-Net on two experiments: (1) MRI to CT splenomegaly synthetic segmentation for abdominal images, and (2) CT to MRI total intracranial volume synthetic segmentation (TICV) for brain images. The proposed end-to-end approach achieved superior performance to two stage methods. Moreover, the SynSeg-Net achieved comparable performance to the traditional segmentation network using target modality labels in certain scenarios. The source code of SynSeg-Net is publicly available 2.
Authors: Yuankai Huo, Zhoubing Xu, Hyeonsoo Moon, Shunxing Bao, Albert Assad, Tamara K. Moyo, Michael R. Savona, Richard G. Abramson, Bennett A. Landman
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funders: National Science Foundation, Vanderbilt University, National Institutes of Health, National Institute on Aging, National Eye Institute, National Cancer Institute, National Institute of Neurological Disorders and Stroke, National Institute of Biomedical Imaging and Bioengineering, National Center for Research Resources, National Center for Advancing Translational Sciences
Awards: Resource Development for the Java Image Science Toolkit, CAREER: Modeling Personalized Brain Development with Big Data, GPU-Accelerated Parallel Computer for Drug Discovery Applications, Segmentation and volumetric quantification of thalamic nuclei for assessing MS, Computer-Assited Functional Neurosurgery, Automatic Cerebellar MRI Labeling In Health and Disease, An Interactive Web-Based Game for Collaborative Labeling of Medical Images, Computer-Assisted functional neurosurgery, Brain Image Analysis Tools for Quantitative Longitudinal Assessment of MS, The Vanderbilt Institute for Clinical and Translational Research (VICTR) UL1, Controlling Quality and Capturing Uncertainty in Advanced Diffusion Weighted MRI, The Vanderbilt Institute for Clinical and Translational Research (VICTR), Quantitative Image Analysis Techniques for Optic Nerve Disease, Cancer Center Support Grant
OpenAlex ID: W2896359486
