Reducing magnetic resonance image spacing by learning without ground-truth

PATTERN RECOGNITION

卷:120

Article

Xuan, Kai¹  Si, Liping³  Zhang, Lichi¹  Xue, Zhong⁵  Jiao, Yining¹  Yao, Weiwu³  Shen, Dinggang^4,5,6  Wu, Dijia⁵  Wang, Qian² 

[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200030, Peoples R China

[2] Shanghai Jiao Tong Univ, Sch Biomed Engn, Med Image Comp Lab, Shanghai 200030, Peoples R China

[3] Shanghai Jiao Tong Univ, Sch Med, Tongren Hosp, Dept Imaging, Shanghai 200050, Peoples R China

[4] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China

[5] Shanghai United Imaging Intelligence Co Ltd, Shanghai 200230, Peoples R China

[6] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea

关键词: Generative adversarial network;    Magnetic resonance imaging;    Super-resolution;    Super Variational auto-encoder;   

DOI  :  10.1016/j.patcog.2021.108103

来源: Elsevier

【 摘 要 】

High-quality magnetic resonance (MR) image, i.e., with near isotropic voxel spacing, is desirable in various scenarios of medical image analysis. However, many MR images are acquired using good in-plane resolution but large spacing between slices in clinical practice. In this work, we propose a novel deep-learning based super-resolution algorithm to generate high-resolution (HR) MR images of small slice spacing from low-resolution (LR) inputs of large slice spacing. Notice that real HR images are needed in most existing deep-learning-based methods to supervise the training, but in clinical scenarios, usually they will not be acquired. Therefore, our unique goal herein is to design and train the super-resolution network without real HR ground-truth. Specifically, two-staged training is used in our method. In the first stage, HR images of reduced slice spacing are synthesized from real LR images using variational auto-encoder (VAE). Although these synthesized HR images of reduced slice spacing are as realistic as possible, they may still suffer from unexpected morphing induced by VAE, implying that the synthesized HR images cannot be paired with the real LR images in terms of anatomical structure details. In the second stage, we degrade the synthesized HR images to generate corresponding LR-HR image pairs and train a super-resolution network based on these synthesized pairs. The underlying mechanism is that such a super-resolution network is less vulnerable to anatomical variability. Experiments on knee MR images successfully demonstrate the effectiveness of our proposed solution to reduce the slice spacing for better rendering. (c) 2021 Elsevier Ltd. All rights reserved.

【 授权许可】

Free