Prior Frequency Guided Diffusion Model for Limited Angle (LA)-CBCT Reconstruction
2404.01448
0
0
📈
Abstract
Cone-beam computed tomography (CBCT) is widely used in image-guided radiotherapy. Reconstructing CBCTs from limited-angle acquisitions (LA-CBCT) is highly desired for improved imaging efficiency, dose reduction, and better mechanical clearance. LA-CBCT reconstruction, however, suffers from severe under-sampling artifacts, making it a highly ill-posed inverse problem. Diffusion models can generate data/images by reversing a data-noising process through learned data distributions; and can be incorporated as a denoiser/regularizer in LA-CBCT reconstruction. In this study, we developed a diffusion model-based framework, prior frequency-guided diffusion model (PFGDM), for robust and structure-preserving LA-CBCT reconstruction. PFGDM uses a conditioned diffusion model as a regularizer for LA-CBCT reconstruction, and the condition is based on high-frequency information extracted from patient-specific prior CT scans which provides a strong anatomical prior for LA-CBCT reconstruction. Specifically, we developed two variants of PFGDM (PFGDM-A and PFGDM-B) with different conditioning schemes. PFGDM-A applies the high-frequency CT information condition until a pre-optimized iteration step, and drops it afterwards to enable both similar and differing CT/CBCT anatomies to be reconstructed. PFGDM-B, on the other hand, continuously applies the prior CT information condition in every reconstruction step, while with a decaying mechanism, to gradually phase out the reconstruction guidance from the prior CT scans. The two variants of PFGDM were tested and compared with current available LA-CBCT reconstruction solutions, via metrics including PSNR and SSIM. PFGDM outperformed all traditional and diffusion model-based methods. PFGDM reconstructs high-quality LA-CBCTs under very-limited gantry angles, allowing faster and more flexible CBCT scans with dose reductions.
Create account to get full access
Overview
- Cone-beam computed tomography (CBCT) is widely used in image-guided radiotherapy.
- Reconstructing CBCT images from limited-angle acquisitions (LA-CBCT) is desirable for improved imaging efficiency, dose reduction, and better mechanical clearance.
- LA-CBCT reconstruction suffers from severe under-sampling artifacts, making it a challenging inverse problem.
- The researchers developed a diffusion model-based framework, prior frequency-guided diffusion model (PFGDM), for robust and structure-preserving LA-CBCT reconstruction.
Plain English Explanation
CBCT is a type of medical imaging that uses X-rays to create 3D images of the body. It is commonly used in cancer treatment to guide radiation therapy. Normally, CBCT scans involve capturing X-ray images from many different angles around the patient. However, in some situations, it may be desirable to capture images from only a limited number of angles. This is known as LA-CBCT.
The challenge with LA-CBCT is that the limited number of images can result in significant distortions and artifacts in the reconstructed 3D image, making it difficult to use for medical purposes. The researchers in this study developed a new approach to improve LA-CBCT reconstruction using a type of artificial intelligence called a diffusion model.
Diffusion models work by starting with random noise and gradually transforming it into a desired image by learning the patterns and structures in a dataset of example images. In this case, the researchers trained a diffusion model using prior CT scans of the patient, which provided strong information about the patient's underlying anatomy. This prior information helped the diffusion model generate high-quality LA-CBCT images, even with a limited number of input X-ray images.
The key advantage of this approach is that it allows faster and more flexible CBCT scans with lower radiation dose, while still producing high-quality 3D images that can be used to guide cancer treatment.
Technical Explanation
The researchers developed a diffusion model-based framework called Prior Frequency-Guided Diffusion Model (PFGDM) for LA-CBCT reconstruction. Diffusion models are a type of generative AI that can generate data/images by reversing a data-noising process through learned data distributions. The key innovation in PFGDM is the use of a conditioned diffusion model as a regularizer for LA-CBCT reconstruction, where the condition is based on high-frequency information extracted from patient-specific prior CT scans.
Specifically, PFGDM has two variants:
- PFGDM-A: Applies the high-frequency CT information condition until a pre-optimized iteration step, then drops it to enable reconstruction of anatomies that may differ between CT and CBCT.
- PFGDM-B: Continuously applies the prior CT information condition in every reconstruction step, but with a decaying mechanism to gradually phase out the reconstruction guidance from the prior CT scans.
The researchers evaluated the PFGDM approaches against current LA-CBCT reconstruction methods using metrics like PSNR and SSIM. PFGDM outperformed traditional and other diffusion model-based methods, demonstrating its ability to reconstruct high-quality LA-CBCTs from very limited gantry angles.
Critical Analysis
The paper provides a promising approach for improving LA-CBCT reconstruction, which is an important challenge in image-guided radiotherapy. The use of a diffusion model-based framework with patient-specific prior information is a clever and innovative solution.
One potential limitation is that the performance of PFGDM may depend on the availability and quality of the prior CT scans. In cases where the patient's anatomy has changed significantly between the CT and CBCT scans, the prior information may not be as useful. The authors acknowledge this and propose the PFGDM-A variant to address this issue.
Additionally, the paper does not provide much discussion on the computational complexity and runtime of the PFGDM approaches compared to other methods. This information would be helpful for evaluating the practical feasibility of deploying PFGDM in clinical settings.
Overall, the research presents a well-designed and promising solution for LA-CBCT reconstruction. Further studies investigating the robustness of PFGDM to variations in patient anatomy and its computational efficiency would be valuable next steps.
Conclusion
This study developed a novel diffusion model-based framework called PFGDM for robust and structure-preserving LA-CBCT reconstruction. By leveraging patient-specific prior information from CT scans, PFGDM was able to generate high-quality LA-CBCT images even with a limited number of input X-ray images. This breakthrough has the potential to enable faster and more flexible CBCT scans with reduced radiation dose, which could significantly improve the efficiency and safety of image-guided radiotherapy for cancer treatment.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Physics-informed Score-based Diffusion Model for Limited-angle Reconstruction of Cardiac Computed Tomography
Shuo Han, Yongshun Xu, Dayang Wang, Bahareh Morovati, Li Zhou, Jonathan S. Maltz, Ge Wang, Hengyong Yu
0
0
Cardiac computed tomography (CT) has emerged as a major imaging modality for the diagnosis and monitoring of cardiovascular diseases. High temporal resolution is essential to ensure diagnostic accuracy. Limited-angle data acquisition can reduce scan time and improve temporal resolution, but typically leads to severe image degradation and motivates for improved reconstruction techniques. In this paper, we propose a novel physics-informed score-based diffusion model (PSDM) for limited-angle reconstruction of cardiac CT. At the sampling time, we combine a data prior from a diffusion model and a model prior obtained via an iterative algorithm and Fourier fusion to further enhance the image quality. Specifically, our approach integrates the primal-dual hybrid gradient (PDHG) algorithm with score-based diffusion models, thereby enabling us to reconstruct high-quality cardiac CT images from limited-angle data. The numerical simulations and real data experiments confirm the effectiveness of our proposed approach.
5/24/2024
👀
Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction
Wenhao Zhang, Bin Huang, Shuyue Chen, Xiaoling Xu, Weiwen Wu, Qiegen Liu
0
0
Low-dose computed tomography (LDCT) plays a vital role in clinical applications by mitigating radiation risks. Nevertheless, reducing radiation doses significantly degrades image quality. Concurrently, common deep learning methods demand extensive data, posing concerns about privacy, cost, and time constraints. Consequently, we propose a few-shot low-dose CT reconstruction method using Partitioned Hankel-based Diffusion (PHD) models. During the prior learning stage, the projection data is first transformed into multiple partitioned Hankel matrices. Structured tensors are then extracted from these matrices to facilitate prior learning through multiple diffusion models. In the iterative reconstruction stage, an iterative stochastic differential equation solver is employed along with data consistency constraints to update the acquired projection data. Furthermore, penalized weighted least-squares and total variation techniques are introduced to enhance the resulting image quality. The results approximate those of normal-dose counterparts, validating PHD model as an effective and practical model for reducing artifacts and noise while preserving image quality.
5/28/2024
CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model
Shudong Li, Xiao Jiang, Matthew Tivnan, Grace J. Gang, Yuan Shen, J. Webster Stayman
0
0
Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood model, has been used to produce high quality CT images given low-quality measurements. This technique is attractive since it permits a one-time, unsupervised training of a CT prior; which can then be incorporated with an arbitrary data model. However, current methods rely on a linear model of x-ray CT physics to reconstruct or restore images. While it is common to linearize the transmission tomography reconstruction problem, this is an approximation to the true and inherently nonlinear forward model. We propose a new method that solves the inverse problem of nonlinear CT image reconstruction via diffusion posterior sampling. We implement a traditional unconditional diffusion model by training a prior score function estimator, and apply Bayes rule to combine this prior with a measurement likelihood score function derived from the nonlinear physical model to arrive at a posterior score function that can be used to sample the reverse-time diffusion process. This plug-and-play method allows incorporation of a diffusion-based prior with generalized nonlinear CT image reconstruction into multiple CT system designs with different forward models, without the need for any additional training. We develop the algorithm that performs this reconstruction, including an ordered-subsets variant for accelerated processing and demonstrate the technique in both fully sampled low dose data and sparse-view geometries using a single unsupervised training of the prior.
6/12/2024
Bi-level Guided Diffusion Models for Zero-Shot Medical Imaging Inverse Problems
Hossein Askari, Fred Roosta, Hongfu Sun
0
0
In the realm of medical imaging, inverse problems aim to infer high-quality images from incomplete, noisy measurements, with the objective of minimizing expenses and risks to patients in clinical settings. The Diffusion Models have recently emerged as a promising approach to such practical challenges, proving particularly useful for the zero-shot inference of images from partially acquired measurements in Magnetic Resonance Imaging (MRI) and Computed Tomography (CT). A central challenge in this approach, however, is how to guide an unconditional prediction to conform to the measurement information. Existing methods rely on deficient projection or inefficient posterior score approximation guidance, which often leads to suboptimal performance. In this paper, we propose underline{textbf{B}}i-level underline{G}uided underline{D}iffusion underline{M}odels ({BGDM}), a zero-shot imaging framework that efficiently steers the initial unconditional prediction through a emph{bi-level} guidance strategy. Specifically, BGDM first approximates an emph{inner-level} conditional posterior mean as an initial measurement-consistent reference point and then solves an emph{outer-level} proximal optimization objective to reinforce the measurement consistency. Our experimental findings, using publicly available MRI and CT medical datasets, reveal that BGDM is more effective and efficient compared to the baselines, faithfully generating high-fidelity medical images and substantially reducing hallucinatory artifacts in cases of severe degradation.
4/8/2024