Physics-informed Score-based Diffusion Model for Limited-angle Reconstruction of Cardiac Computed Tomography
2405.14770
0
0
Abstract
Cardiac computed tomography (CT) has emerged as a major imaging modality for the diagnosis and monitoring of cardiovascular diseases. High temporal resolution is essential to ensure diagnostic accuracy. Limited-angle data acquisition can reduce scan time and improve temporal resolution, but typically leads to severe image degradation and motivates for improved reconstruction techniques. In this paper, we propose a novel physics-informed score-based diffusion model (PSDM) for limited-angle reconstruction of cardiac CT. At the sampling time, we combine a data prior from a diffusion model and a model prior obtained via an iterative algorithm and Fourier fusion to further enhance the image quality. Specifically, our approach integrates the primal-dual hybrid gradient (PDHG) algorithm with score-based diffusion models, thereby enabling us to reconstruct high-quality cardiac CT images from limited-angle data. The numerical simulations and real data experiments confirm the effectiveness of our proposed approach.
Create account to get full access
Overview
- This paper presents a physics-informed score-based diffusion model for limited-angle reconstruction of cardiac computed tomography (CT) images.
- The proposed method leverages physical constraints and prior information to improve the quality of cardiac CT images obtained from limited-angle scanning.
- The model combines a score-based diffusion approach with physics-informed priors, aiming to generate high-quality reconstructions from incomplete data.
Plain English Explanation
Cardiac computed tomography (CT) is a widely used medical imaging technique that provides detailed information about the structure and function of the heart. However, in some cases, it may not be possible to capture a complete set of CT images from all angles around the patient's body. This is known as "limited-angle" scanning, and it can result in lower-quality reconstructed images.
The researchers in this paper have developed a new method to address this problem. They have created a machine learning model that incorporates physical knowledge and prior information about the heart and its motion. This allows the model to generate high-quality reconstructed images from the limited-angle CT data.
The key idea is to use a "score-based diffusion" approach, which is a type of machine learning technique that learns to gradually transform simple random noise into realistic-looking images. By incorporating physics-based constraints and prior information about cardiac anatomy and function, the model is able to generate more accurate and detailed reconstructions of the heart from the limited-angle CT data.
This is an important advance because it can help improve the quality of cardiac CT imaging, even in cases where complete data is not available. This could lead to better diagnosis and treatment of heart-related conditions, as well as reduce the need for more invasive or radiation-intensive imaging procedures.
Technical Explanation
The researchers propose a physics-informed score-based diffusion model for limited-angle reconstruction of cardiac CT images. The model combines a score-based diffusion approach with physics-informed priors to generate high-quality reconstructions from incomplete data.
The score-based diffusion model [1] is a generative machine learning technique that learns to gradually transform simple random noise into realistic-looking images. The model learns a "score function" that estimates the gradient of the log-likelihood of the data, which can then be used to iteratively refine the generated images.
To improve the reconstruction quality for limited-angle cardiac CT, the researchers incorporate several physics-informed priors into the model:
- Cardiac motion prior: The model learns a representation of the expected cardiac motion and deformation, based on previous studies of cardiac dynamics [2].
- Ray-tracing prior: The model incorporates a ray-tracing algorithm to enforce physical constraints on the CT image formation process [3].
- Sparsity prior: The model encourages sparsity in the reconstructed images, leveraging the fact that cardiac CT data is typically sparse [4].
By integrating these physics-informed priors, the score-based diffusion model is able to generate high-quality reconstructions of cardiac CT images from limited-angle data. The researchers demonstrate the effectiveness of their approach through experiments on both synthetic and real-world cardiac CT datasets.
Critical Analysis
The researchers have made a compelling case for the benefits of their physics-informed score-based diffusion model for limited-angle cardiac CT reconstruction. However, there are a few potential limitations and areas for further research:
-
Computational complexity: The score-based diffusion approach, while powerful, can be computationally intensive, especially when combined with the physics-informed priors. The researchers should explore ways to improve the efficiency of their model to make it more practical for real-world clinical applications.
-
Generalization to other modalities: The focus of this paper is on cardiac CT, but the principles of the physics-informed score-based diffusion model could potentially be extended to other medical imaging modalities, such as MRI or PET. The researchers could investigate the applicability of their approach to these other imaging techniques.
-
Validation on larger, more diverse datasets: The experiments in the paper were conducted on relatively small datasets. It would be important to further validate the performance of the model on larger, more diverse datasets to ensure its robustness and generalizability.
-
Comparison to other limited-angle reconstruction methods: While the researchers compare their approach to traditional limited-angle reconstruction methods, it would be valuable to also compare it to more recent deep learning-based techniques, such as prior-frequency guided diffusion models or differentiable score-based likelihoods.
Overall, the physics-informed score-based diffusion model presented in this paper is a promising approach for improving limited-angle cardiac CT reconstruction. The incorporation of physical constraints and prior information is a valuable contribution to the field, and the researchers have demonstrated the effectiveness of their method. With further refinement and validation, this work could have significant implications for improving the quality and accessibility of cardiac imaging.
Conclusion
This paper introduces a physics-informed score-based diffusion model for limited-angle reconstruction of cardiac computed tomography (CT) images. The proposed approach leverages physical constraints and prior information to generate high-quality reconstructions from incomplete data, addressing the challenges of limited-angle scanning.
By combining a score-based diffusion approach with physics-informed priors, such as cardiac motion, ray-tracing, and sparsity, the researchers have developed a powerful technique for improving the quality of cardiac CT imaging. This could lead to better diagnosis and treatment of heart-related conditions, as well as reduce the need for more invasive or radiation-intensive imaging procedures.
While the paper presents promising results, there are opportunities for further research and refinement, such as improving computational efficiency, exploring applicability to other imaging modalities, and conducting more extensive validation on larger, diverse datasets. Overall, this work represents an important step forward in the field of medical imaging and has the potential to significantly impact the way cardiac health is assessed and managed.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
👀
Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction
Wenhao Zhang, Bin Huang, Shuyue Chen, Xiaoling Xu, Weiwen Wu, Qiegen Liu
0
0
Low-dose computed tomography (LDCT) plays a vital role in clinical applications by mitigating radiation risks. Nevertheless, reducing radiation doses significantly degrades image quality. Concurrently, common deep learning methods demand extensive data, posing concerns about privacy, cost, and time constraints. Consequently, we propose a few-shot low-dose CT reconstruction method using Partitioned Hankel-based Diffusion (PHD) models. During the prior learning stage, the projection data is first transformed into multiple partitioned Hankel matrices. Structured tensors are then extracted from these matrices to facilitate prior learning through multiple diffusion models. In the iterative reconstruction stage, an iterative stochastic differential equation solver is employed along with data consistency constraints to update the acquired projection data. Furthermore, penalized weighted least-squares and total variation techniques are introduced to enhance the resulting image quality. The results approximate those of normal-dose counterparts, validating PHD model as an effective and practical model for reducing artifacts and noise while preserving image quality.
5/28/2024
📈
Prior Frequency Guided Diffusion Model for Limited Angle (LA)-CBCT Reconstruction
Jiacheng Xie, Hua-Chieh Shao, Yunxiang Li, You Zhang
0
0
Cone-beam computed tomography (CBCT) is widely used in image-guided radiotherapy. Reconstructing CBCTs from limited-angle acquisitions (LA-CBCT) is highly desired for improved imaging efficiency, dose reduction, and better mechanical clearance. LA-CBCT reconstruction, however, suffers from severe under-sampling artifacts, making it a highly ill-posed inverse problem. Diffusion models can generate data/images by reversing a data-noising process through learned data distributions; and can be incorporated as a denoiser/regularizer in LA-CBCT reconstruction. In this study, we developed a diffusion model-based framework, prior frequency-guided diffusion model (PFGDM), for robust and structure-preserving LA-CBCT reconstruction. PFGDM uses a conditioned diffusion model as a regularizer for LA-CBCT reconstruction, and the condition is based on high-frequency information extracted from patient-specific prior CT scans which provides a strong anatomical prior for LA-CBCT reconstruction. Specifically, we developed two variants of PFGDM (PFGDM-A and PFGDM-B) with different conditioning schemes. PFGDM-A applies the high-frequency CT information condition until a pre-optimized iteration step, and drops it afterwards to enable both similar and differing CT/CBCT anatomies to be reconstructed. PFGDM-B, on the other hand, continuously applies the prior CT information condition in every reconstruction step, while with a decaying mechanism, to gradually phase out the reconstruction guidance from the prior CT scans. The two variants of PFGDM were tested and compared with current available LA-CBCT reconstruction solutions, via metrics including PSNR and SSIM. PFGDM outperformed all traditional and diffusion model-based methods. PFGDM reconstructs high-quality LA-CBCTs under very-limited gantry angles, allowing faster and more flexible CBCT scans with dose reductions.
4/10/2024
CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model
Shudong Li, Xiao Jiang, Matthew Tivnan, Grace J. Gang, Yuan Shen, J. Webster Stayman
0
0
Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood model, has been used to produce high quality CT images given low-quality measurements. This technique is attractive since it permits a one-time, unsupervised training of a CT prior; which can then be incorporated with an arbitrary data model. However, current methods rely on a linear model of x-ray CT physics to reconstruct or restore images. While it is common to linearize the transmission tomography reconstruction problem, this is an approximation to the true and inherently nonlinear forward model. We propose a new method that solves the inverse problem of nonlinear CT image reconstruction via diffusion posterior sampling. We implement a traditional unconditional diffusion model by training a prior score function estimator, and apply Bayes rule to combine this prior with a measurement likelihood score function derived from the nonlinear physical model to arrive at a posterior score function that can be used to sample the reverse-time diffusion process. This plug-and-play method allows incorporation of a diffusion-based prior with generalized nonlinear CT image reconstruction into multiple CT system designs with different forward models, without the need for any additional training. We develop the algorithm that performs this reconstruction, including an ordered-subsets variant for accelerated processing and demonstrate the technique in both fully sampled low dose data and sparse-view geometries using a single unsupervised training of the prior.
6/12/2024
DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction
Bowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler, Liyue Shen
0
0
Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train a diffusion model directly on the entire volume of high-dimensional data to obtain an efficient 3D diffusion prior. Existing works utilizing diffusion priors on single 2D image slice with hand-crafted cross-slice regularization would sacrifice the z-axis consistency, which results in severe artifacts along the z-axis. In this work, we propose a novel framework that enables learning the 3D image prior through position-aware 3D-patch diffusion score blending for reconstructing large-scale 3D medical images. To the best of our knowledge, we are the first to utilize a 3D-patch diffusion prior for 3D medical image reconstruction. Extensive experiments on sparse view and limited angle CT reconstruction show that our DiffusionBlend method significantly outperforms previous methods and achieves state-of-the-art performance on real-world CT reconstruction problems with high-dimensional 3D image (i.e., $256 times 256 times 500$). Our algorithm also comes with better or comparable computational efficiency than previous state-of-the-art methods.
6/17/2024