CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model
2312.01464
0
0
Abstract
Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood model, has been used to produce high quality CT images given low-quality measurements. This technique is attractive since it permits a one-time, unsupervised training of a CT prior; which can then be incorporated with an arbitrary data model. However, current methods rely on a linear model of x-ray CT physics to reconstruct or restore images. While it is common to linearize the transmission tomography reconstruction problem, this is an approximation to the true and inherently nonlinear forward model. We propose a new method that solves the inverse problem of nonlinear CT image reconstruction via diffusion posterior sampling. We implement a traditional unconditional diffusion model by training a prior score function estimator, and apply Bayes rule to combine this prior with a measurement likelihood score function derived from the nonlinear physical model to arrive at a posterior score function that can be used to sample the reverse-time diffusion process. This plug-and-play method allows incorporation of a diffusion-based prior with generalized nonlinear CT image reconstruction into multiple CT system designs with different forward models, without the need for any additional training. We develop the algorithm that performs this reconstruction, including an ordered-subsets variant for accelerated processing and demonstrate the technique in both fully sampled low dose data and sparse-view geometries using a single unsupervised training of the prior.
Create account to get full access
Overview
- This paper introduces a novel approach for reconstructing images from noisy measurements, using a diffusion-based posterior sampling technique.
- The method leverages a nonlinear physical model to capture complex image formation processes, and can be applied to a variety of inverse problems, including computed tomography (CT) reconstruction.
- The proposed technique demonstrates improved reconstruction quality compared to traditional methods, while being computationally efficient.
Plain English Explanation
The researchers have developed a new way to create high-quality images from noisy data, which is a common problem in fields like medical imaging. Their method uses a special kind of machine learning model called a "diffusion model" to capture the complex physics of how the images are formed.
Typically, when you take an X-ray or other type of scan, the resulting image can be a bit blurry or noisy. The researchers' approach helps clean up these imperfections by learning the underlying patterns in the data. It does this in an efficient way, without requiring a lot of computational power.
The key idea is to use the diffusion model to "sample" from the probability distribution of possible images, and then select the one that best matches the noisy measurements. This allows the method to generate high-quality reconstructions, even for challenging inverse problems like computed tomography (CT) scans.
By incorporating the physical model of image formation, the researchers' technique is able to outperform traditional reconstruction methods, producing clearer and more accurate images. This could have important applications in medical imaging, as well as other areas where extracting useful information from noisy data is crucial.
Technical Explanation
The paper presents a novel diffusion-based posterior sampling approach for solving nonlinear inverse problems, such as computed tomography (CT) reconstruction. The key idea is to leverage a nonlinear physical model of the image formation process, which is used to guide the diffusion-based sampling of the posterior distribution.
Specifically, the method builds upon recent work on physics-informed score-based diffusion models and principled probabilistic imaging using diffusion models. The authors introduce a "partitioned Hankel-based diffusion model" that can efficiently capture the complex nonlinearities in the forward imaging operator.
During inference, the diffusion model is used to sample from the posterior distribution, guided by the nonlinear physical model. This allows the method to generate high-quality reconstructions, even for challenging inverse problems like CT reconstruction.
The paper demonstrates the effectiveness of the proposed approach through experiments on simulated CT data, showing improved reconstruction quality and computational efficiency compared to traditional methods.
Critical Analysis
The paper presents a promising approach for solving nonlinear inverse problems using diffusion-based posterior sampling. The key strength of the method is its ability to incorporate a nonlinear physical model of the image formation process, which helps capture the complex relationships in the data.
One potential limitation is the reliance on a partitioned Hankel-based diffusion model, which may not be suitable for all types of inverse problems. The authors acknowledge that the model design could be further improved to better match the specific characteristics of the problem at hand.
Additionally, the paper does not provide a detailed analysis of the computational complexity of the proposed method, which is an important factor for real-world applications. While the authors claim improved efficiency compared to traditional techniques, a more thorough evaluation of the runtime and memory requirements would be helpful.
Further research could also explore the robustness of the method to different types of noise and model misspecifications, as well as its applicability to a wider range of inverse problems beyond CT reconstruction.
Conclusion
The paper introduces a novel diffusion-based posterior sampling approach for solving nonlinear inverse problems, with a focus on computed tomography (CT) reconstruction. By incorporating a nonlinear physical model of the image formation process, the method is able to generate high-quality reconstructions that outperform traditional techniques.
The proposed approach has the potential to significantly impact fields like medical imaging, where extracting meaningful information from noisy data is crucial. The efficient and principled nature of the diffusion-based sampling process also suggests that the method could be extended to other types of inverse problems, opening up new avenues for research and real-world applications.
Overall, this work represents an important step forward in the use of diffusion models for solving complex inverse problems, and the authors' insights could inspire further advancements in this rapidly evolving field of study.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction
Xingyu Xu, Yuejie Chi
0
0
In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource constraints, this task is often extremely ill-posed, which necessitates the adoption of expressive prior information to regularize the solution space. Score-based diffusion models, due to its impressive empirical success, have emerged as an appealing candidate of an expressive prior in image reconstruction. In order to accommodate diverse tasks at once, it is of great interest to develop efficient, consistent and robust algorithms that incorporate unconditional score functions of an image prior distribution in conjunction with flexible choices of forward models. This work develops an algorithmic framework for employing score-based diffusion models as an expressive data prior in general nonlinear inverse problems. Motivated by the plug-and-play framework in the imaging community, we introduce a diffusion plug-and-play method (DPnP) that alternatively calls two samplers, a proximal consistency sampler based solely on the likelihood function of the forward model, and a denoising diffusion sampler based solely on the score functions of the image prior. The key insight is that denoising under white Gaussian noise can be solved rigorously via both stochastic (i.e., DDPM-type) and deterministic (i.e., DDIM-type) samplers using the unconditional score functions. We establish both asymptotic and non-asymptotic performance guarantees of DPnP, and provide numerical experiments to illustrate its promise in solving both linear and nonlinear image reconstruction tasks. To the best of our knowledge, DPnP is the first provably-robust posterior sampling method for nonlinear inverse problems using unconditional diffusion priors.
6/13/2024
👁️
Diffusion Posterior Sampling for General Noisy Inverse Problems
Hyungjin Chung, Jeongsol Kim, Michael T. Mccann, Marc L. Klasky, Jong Chul Ye
0
0
Diffusion models have been recently studied as powerful generative inverse problem solvers, owing to their high quality reconstructions and the ease of combining existing iterative solvers. However, most works focus on solving simple linear inverse problems in noiseless settings, which significantly under-represents the complexity of real-world problems. In this work, we extend diffusion solvers to efficiently handle general noisy (non)linear inverse problems via approximation of the posterior sampling. Interestingly, the resulting posterior sampling scheme is a blended version of diffusion sampling with the manifold constrained gradient without a strict measurement consistency projection step, yielding a more desirable generative path in noisy settings compared to the previous studies. Our method demonstrates that diffusion models can incorporate various measurement noise statistics such as Gaussian and Poisson, and also efficiently handle noisy nonlinear inverse problems such as Fourier phase retrieval and non-uniform deblurring. Code available at https://github.com/DPS2022/diffusion-posterior-sampling
5/21/2024
Physics-informed Score-based Diffusion Model for Limited-angle Reconstruction of Cardiac Computed Tomography
Shuo Han, Yongshun Xu, Dayang Wang, Bahareh Morovati, Li Zhou, Jonathan S. Maltz, Ge Wang, Hengyong Yu
0
0
Cardiac computed tomography (CT) has emerged as a major imaging modality for the diagnosis and monitoring of cardiovascular diseases. High temporal resolution is essential to ensure diagnostic accuracy. Limited-angle data acquisition can reduce scan time and improve temporal resolution, but typically leads to severe image degradation and motivates for improved reconstruction techniques. In this paper, we propose a novel physics-informed score-based diffusion model (PSDM) for limited-angle reconstruction of cardiac CT. At the sampling time, we combine a data prior from a diffusion model and a model prior obtained via an iterative algorithm and Fourier fusion to further enhance the image quality. Specifically, our approach integrates the primal-dual hybrid gradient (PDHG) algorithm with score-based diffusion models, thereby enabling us to reconstruct high-quality cardiac CT images from limited-angle data. The numerical simulations and real data experiments confirm the effectiveness of our proposed approach.
5/24/2024
DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography Reconstruction
Bowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler, Liyue Shen
0
0
Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train a diffusion model directly on the entire volume of high-dimensional data to obtain an efficient 3D diffusion prior. Existing works utilizing diffusion priors on single 2D image slice with hand-crafted cross-slice regularization would sacrifice the z-axis consistency, which results in severe artifacts along the z-axis. In this work, we propose a novel framework that enables learning the 3D image prior through position-aware 3D-patch diffusion score blending for reconstructing large-scale 3D medical images. To the best of our knowledge, we are the first to utilize a 3D-patch diffusion prior for 3D medical image reconstruction. Extensive experiments on sparse view and limited angle CT reconstruction show that our DiffusionBlend method significantly outperforms previous methods and achieves state-of-the-art performance on real-world CT reconstruction problems with high-dimensional 3D image (i.e., $256 times 256 times 500$). Our algorithm also comes with better or comparable computational efficiency than previous state-of-the-art methods.
6/17/2024