Paired Conditional Generative Adversarial Network for Highly Accelerated Liver 4D MRI
0
🌐
Sign in to get full access
Overview
- The researchers aimed to develop a fast and efficient method for reconstructing 4D (3D + time) liver MRI data, which is important for image-guided radiotherapy.
- Acquiring dense k-space data for 4D MRI is time-consuming, so they propose using an accelerated acquisition with sparse samples.
- However, this often leads to degraded image quality or long reconstruction times.
- The researchers introduce the Reconstruct Paired Conditional Generative Adversarial Network (Re-Con-GAN) to address these issues.
Plain English Explanation
The researchers were interested in improving 4D (three-dimensional plus time) MRI of the liver, which can be used to guide radiation therapy for liver cancer. Acquiring the necessary data for 4D MRI takes a long time. To speed up the process, the researchers tried using fewer data points, but this often resulted in lower quality images or slow reconstruction times.
To address this problem, the researchers developed a Re-Con-GAN, which is a type of machine learning model that can generate high-quality 4D MRI images from limited data. This allows for faster 4D MRI scans while maintaining good image quality.
The key idea is to train the Re-Con-GAN model on pairs of low-quality and high-quality 4D MRI data. Once trained, the model can take new low-quality 4D MRI scans and reconstruct them into high-quality versions very quickly. This has the potential to enable more effective and efficient radiation therapy for liver cancer patients.
Technical Explanation
The researchers used retrospectively under-sampled 4D MRI data from 48 patients to train and evaluate their Re-Con-GAN model. They explored three types of network architectures as the generator: ResNet9, UNet, and a reconstruction swin transformer. PatchGAN was used as the discriminator.
The Re-Con-GAN model was trained on pairs of low-quality (3x, 6x, and 10x under-sampled) and high-quality (fully-sampled) 4D MRI data. During inference, the trained model was able to rapidly reconstruct high-quality 4D MRI images from new low-quality inputs.
Compared to traditional compressed sensing (CS) and UNet-based approaches, the Re-Con-GAN model consistently achieved better performance in terms of PSNR, SSIM, and RMSE metrics. Importantly, the inference time of Re-Con-GAN was much faster than the CS method (0.15s vs 120s).
The researchers also showed that the 4D MRI images reconstructed by Re-Con-GAN led to better performance on a liver tumor (GTV) detection task compared to the under-sampled inputs and the UNet-based reconstruction.
Critical Analysis
The researchers have presented a promising approach for accelerating 4D MRI reconstruction while maintaining image quality. The use of a generative adversarial network (GAN) architecture, along with exploring different generator networks, is a reasonable strategy to tackle this challenge.
However, the paper does not provide much insight into the limitations or potential issues with the proposed method. For example, it is unclear how the Re-Con-GAN model would perform on more diverse 4D MRI datasets, or how robust it is to variations in acquisition parameters or patient anatomy.
[Additionally, the researchers could have compared their approach to other state-of-the-art methods for accelerated 4D MRI reconstruction, such as those based on deep learning or compressed sensing, to provide a more comprehensive evaluation.](https://aimodels.fyi/papers/arxiv/multi-view-x-ray-image-synthesis-multiple)
Overall, the results are promising, but further research is needed to fully assess the capabilities and limitations of the Re-Con-GAN approach for 4D MRI reconstruction.
Conclusion
The researchers have developed a generative adversarial network called Re-Con-GAN that can rapidly reconstruct high-quality 4D MRI images from under-sampled data. This has the potential to significantly speed up 4D MRI acquisition for applications like image-guided liver radiotherapy, without sacrificing image quality.
The efficient and accurate reconstruction demonstrated by Re-Con-GAN is an important step towards enabling more widespread use of 4D MRI in the clinic. Further research is needed to validate the approach on larger and more diverse datasets, as well as to compare it to other state-of-the-art methods for accelerated 4D MRI reconstruction.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🌐
0
Paired Conditional Generative Adversarial Network for Highly Accelerated Liver 4D MRI
Di Xu, Xin Miao, Hengjie Liu, Jessica E. Scholey, Wensha Yang, Mary Feng, Michael Ohliger, Hui Lin, Yi Lao, Yang Yang, Ke Sheng
Purpose: 4D MRI with high spatiotemporal resolution is desired for image-guided liver radiotherapy. Acquiring densely sampling k-space data is time-consuming. Accelerated acquisition with sparse samples is desirable but often causes degraded image quality or long reconstruction time. We propose the Reconstruct Paired Conditional Generative Adversarial Network (Re-Con-GAN) to shorten the 4D MRI reconstruction time while maintaining the reconstruction quality. Methods: Patients who underwent free-breathing liver 4D MRI were included in the study. Fully- and retrospectively under-sampled data at 3, 6 and 10 times (3x, 6x and 10x) were first reconstructed using the nuFFT algorithm. Re-Con-GAN then trained input and output in pairs. Three types of networks, ResNet9, UNet and reconstruction swin transformer, were explored as generators. PatchGAN was selected as the discriminator. Re-Con-GAN processed the data (3D+t) as temporal slices (2D+t). A total of 48 patients with 12332 temporal slices were split into training (37 patients with 10721 slices) and test (11 patients with 1611 slices). Results: Re-Con-GAN consistently achieved comparable/better PSNR, SSIM, and RMSE scores compared to CS/UNet models. The inference time of Re-Con-GAN, UNet and CS are 0.15s, 0.16s, and 120s. The GTV detection task showed that Re-Con-GAN and CS, compared to UNet, better improved the dice score (3x Re-Con-GAN 80.98%; 3x CS 80.74%; 3x UNet 79.88%) of unprocessed under-sampled images (3x 69.61%). Conclusion: A generative network with adversarial training is proposed with promising and efficient reconstruction results demonstrated on an in-house dataset. The rapid and qualitative reconstruction of 4D liver MR has the potential to facilitate online adaptive MR-guided radiotherapy for liver cancer.
Read more5/22/2024
🧠
0
Applying Conditional Generative Adversarial Networks for Imaging Diagnosis
Haowei Yang, Yuxiang Hu, Shuyao He, Ting Xu, Jiajie Yuan, Xingxin Gu
This study introduces an innovative application of Conditional Generative Adversarial Networks (C-GAN) integrated with Stacked Hourglass Networks (SHGN) aimed at enhancing image segmentation, particularly in the challenging environment of medical imaging. We address the problem of overfitting, common in deep learning models applied to complex imaging datasets, by augmenting data through rotation and scaling. A hybrid loss function combining L1 and L2 reconstruction losses, enriched with adversarial training, is introduced to refine segmentation processes in intravascular ultrasound (IVUS) imaging. Our approach is unique in its capacity to accurately delineate distinct regions within medical images, such as tissue boundaries and vascular structures, without extensive reliance on domain-specific knowledge. The algorithm was evaluated using a standard medical image library, showing superior performance metrics compared to existing methods, thereby demonstrating its potential in enhancing automated medical diagnostics through deep learning
Read more8/6/2024
🌐
0
DensePANet: An improved generative adversarial network for photoacoustic tomography image reconstruction from sparse data
Hesam Hakimnejad, Zohreh Azimifar, Narjes Goshtasbi
Image reconstruction is an essential step of every medical imaging method, including Photoacoustic Tomography (PAT), which is a promising modality of imaging, that unites the benefits of both ultrasound and optical imaging methods. Reconstruction of PAT images using conventional methods results in rough artifacts, especially when applied directly to sparse PAT data. In recent years, generative adversarial networks (GANs) have shown a powerful performance in image generation as well as translation, rendering them a smart choice to be applied to reconstruction tasks. In this study, we proposed an end-to-end method called DensePANet to solve the problem of PAT image reconstruction from sparse data. The proposed model employs a novel modification of UNet in its generator, called FD-UNet++, which considerably improves the reconstruction performance. We evaluated the method on various in-vivo and simulated datasets. Quantitative and qualitative results show the better performance of our model over other prevalent deep learning techniques.
Read more4/26/2024
🤿
0
Accelerated MR Cholangiopancreatography with Deep Learning-based Reconstruction
Jinho Kim, Marcel Dominik Nickel, Florian Knoll
This study accelerates MR cholangiopancreatography (MRCP) acquisitions using deep learning-based (DL) reconstruction at 3T and 0.55T. Thirty healthy volunteers underwent conventional two-fold MRCP scans at field strengths of 3T or 0.55T. We trained a variational network (VN) using retrospectively six-fold undersampled data obtained at 3T. We then evaluated our method against standard techniques such as parallel imaging (PI) and compressed sensing (CS), focusing on peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) as metrics. Furthermore, considering acquiring fully-sampled MRCP is impractical, we added a self-supervised DL reconstruction (SSDU) to the evaluating group. We also tested our method in a prospective accelerated scenario to reflect real-world clinical applications and evaluated its adaptability to MRCP at 0.55T. Our method demonstrated a remarkable reduction of average acquisition time from 599/542 to 255/180 seconds for MRCP at 3T/0.55T. In both retrospective and prospective undersampling scenarios, the PSNR and SSIM of VN were higher than those of PI, CS, and SSDU. At the same time, VN preserved the image quality of undersampled data, i.e., sharpness and the visibility of hepatobiliary ducts. In addition, VN also produced high quality reconstructions at 0.55T resulting in the highest PSNR and SSIM. In summary, VN trained for highly accelerated MRCP allows to reduce the acquisition time by a factor of 2.4/3.0 at 3T/0.55T while maintaining the image quality of the conventional acquisition.
Read more5/8/2024