CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates

Read original: arXiv:2409.01571 - Published 9/4/2024 by Liutao Yang, Jiahao Huang, Guang Yang, Daoqiang Zhang
Total Score

0

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Presents a new deep learning model called CT-SDM for sparse-view CT reconstruction across different sampling rates
  • Uses a diffusion model approach to learn an adaptive sampling strategy for reconstructing CT images from sparse-view data
  • Demonstrates superior performance compared to existing methods, especially at very low sampling rates

Plain English Explanation

The paper introduces a new deep learning model called CT-SDM (CT Sampling Diffusion Model) that can reconstruct high-quality CT images from sparse-view data - that is, CT scans taken with fewer measurements than a full scan. This is an important problem because reducing the number of measurements can significantly lower the radiation dose for patients.

The key innovation of CT-SDM is that it uses a diffusion model approach to learn an adaptive sampling strategy. Diffusion models work by adding noise to an image and then learning how to reverse that process to recover the original image. In this case, the model learns to take sparse-view CT measurements, add noise, and then undo the noise and reconstruct the full CT image.

Importantly, the model is able to adapt its sampling strategy based on the specific sparsity level, performing better than existing methods especially at very low sampling rates. This makes it a promising approach for clinical applications where radiation dose is a key concern.

Technical Explanation

The CT-SDM model consists of two main components: a Sampling Diffusion Model (SDM) and a Reconstruction Network (RN). The SDM learns to add and remove noise from the CT scans in a way that preserves important structural information, while the RN takes the noisy, sparse-view measurements and reconstructs the final high-quality CT image.

The key innovation is that the SDM is trained to be

sampling rate adaptive
, meaning it can handle different levels of sparsity in the input data. This is achieved by conditioning the diffusion process on the specific sampling rate. At inference time, the model can then take sparse-view measurements at any desired rate and efficiently reconstruct the CT image.

The authors evaluate CT-SDM on a range of sparse-view CT reconstruction benchmarks, including both simulated and real-world data. They demonstrate significant performance improvements over existing state-of-the-art methods, especially at very low sampling rates (e.g. 10-20% of full measurements). This suggests the adaptive diffusion-based approach is well-suited for practical applications where radiation dose is a major concern.

Critical Analysis

The paper provides a thorough evaluation of CT-SDM, including comparisons to several leading sparse-view CT reconstruction techniques. The results are impressive, particularly the model's ability to handle extremely sparse input data. However, the authors do note some limitations:

  • The model was only evaluated on a single CT imaging dataset, so its generalization to other anatomies or imaging modalities is unclear.
  • The training and inference time of CT-SDM is relatively high compared to some competing methods, which could be a practical concern for clinical deployment.
  • The paper does not investigate the model's robustness to noise, artifacts, or other real-world factors that could impact performance in a clinical setting.

Additionally, while the adaptive sampling approach is a key strength, the authors do not provide much insight into how the model learns this capability. Understanding the internal workings and decision-making process of the SDM could lead to further improvements.

Overall, CT-SDM represents a promising advance in sparse-view CT reconstruction, but additional research is needed to fully understand its strengths, limitations, and potential for real-world clinical translation.

Conclusion

This paper presents a novel deep learning model called CT-SDM that can effectively reconstruct high-quality CT images from sparse-view measurements. The key innovation is the use of a diffusion-based approach that allows the model to adapt its sampling strategy based on the specific sparsity level of the input data.

The results demonstrate significant performance improvements over existing state-of-the-art sparse-view CT reconstruction methods, particularly at very low sampling rates. This makes CT-SDM a potentially valuable tool for clinical applications where reducing radiation dose is a critical concern.

While the paper highlights some limitations that warrant further investigation, the adaptive and data-efficient nature of the CT-SDM model suggests it is a promising direction for advancing the field of sparse-view CT reconstruction and enabling safer, more accessible medical imaging.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates
Total Score

0

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates

Liutao Yang, Jiahao Huang, Guang Yang, Daoqiang Zhang

Sparse views X-ray computed tomography has emerged as a contemporary technique to mitigate radiation dose. Because of the reduced number of projection views, traditional reconstruction methods can lead to severe artifacts. Recently, research studies utilizing deep learning methods has made promising progress in removing artifacts for Sparse-View Computed Tomography (SVCT). However, given the limitations on the generalization capability of deep learning models, current methods usually train models on fixed sampling rates, affecting the usability and flexibility of model deployment in real clinical settings. To address this issue, our study proposes a adaptive reconstruction method to achieve high-performance SVCT reconstruction at any sampling rate. Specifically, we design a novel imaging degradation operator in the proposed sampling diffusion model for SVCT (CT-SDM) to simulate the projection process in the sinogram domain. Thus, the CT-SDM can gradually add projection views to highly undersampled measurements to generalize the full-view sinograms. By choosing an appropriate starting point in diffusion inference, the proposed model can recover the full-view sinograms from any sampling rate with only one trained model. Experiments on several datasets have verified the effectiveness and robustness of our approach, demonstrating its superiority in reconstructing high-quality images from sparse-view CT scans across various sampling rates.

Read more

9/4/2024

📈

Total Score

0

MSDiff: Multi-Scale Diffusion Model for Ultra-Sparse View CT Reconstruction

Pinhuang Tan, Mengxiao Geng, Jingya Lu, Liu Shi, Bin Huang, Qiegen Liu

Computed Tomography (CT) technology reduces radiation haz-ards to the human body through sparse sampling, but fewer sampling angles pose challenges for image reconstruction. Score-based generative models are widely used in sparse-view CT re-construction, performance diminishes significantly with a sharp reduction in projection angles. Therefore, we propose an ultra-sparse view CT reconstruction method utilizing multi-scale dif-fusion models (MSDiff), designed to concentrate on the global distribution of information and facilitate the reconstruction of sparse views with local image characteristics. Specifically, the proposed model ingeniously integrates information from both comprehensive sampling and selectively sparse sampling tech-niques. Through precise adjustments in diffusion model, it is capable of extracting diverse noise distribution, furthering the understanding of the overall structure of images, and aiding the fully sampled model in recovering image information more effec-tively. By leveraging the inherent correlations within the projec-tion data, we have designed an equidistant mask, enabling the model to focus its attention more effectively. Experimental re-sults demonstrated that the multi-scale model approach signifi-cantly improved the quality of image reconstruction under ultra-sparse angles, with good generalization across various datasets.

Read more

5/10/2024

Learning Task-Specific Sampling Strategy for Sparse-View CT Reconstruction
Total Score

0

Learning Task-Specific Sampling Strategy for Sparse-View CT Reconstruction

Liutao Yang, Jiahao Huang, Yingying Fang, Angelica I Aviles-Rivero, Carola-Bibiane Schonlieb, Daoqiang Zhang, Guang Yang

Sparse-View Computed Tomography (SVCT) offers low-dose and fast imaging but suffers from severe artifacts. Optimizing the sampling strategy is an essential approach to improving the imaging quality of SVCT. However, current methods typically optimize a universal sampling strategy for all types of scans, overlooking the fact that the optimal strategy may vary depending on the specific scanning task, whether it involves particular body scans (e.g., chest CT scans) or downstream clinical applications (e.g., disease diagnosis). The optimal strategy for one scanning task may not perform as well when applied to other tasks. To address this problem, we propose a deep learning framework that learns task-specific sampling strategies with a multi-task approach to train a unified reconstruction network while tailoring optimal sampling strategies for each individual task. Thus, a task-specific sampling strategy can be applied for each type of scans to improve the quality of SVCT imaging and further assist in performance of downstream clinical usage. Extensive experiments across different scanning types provide validation for the effectiveness of task-specific sampling strategies in enhancing imaging quality. Experiments involving downstream tasks verify the clinical value of learned sampling strategies, as evidenced by notable improvements in downstream task performance. Furthermore, the utilization of a multi-task framework with a shared reconstruction network facilitates deployment on current imaging devices with switchable task-specific modules, and allows for easily integrate new tasks without retraining the entire model.

Read more

9/4/2024

Iterative CT Reconstruction via Latent Variable Optimization of Shallow Diffusion Models
Total Score

0

Iterative CT Reconstruction via Latent Variable Optimization of Shallow Diffusion Models

Sho Ozaki, Shizuo Kaji, Toshikazu Imae, Kanabu Nawa, Hideomi Yamashita, Keiichi Nakagawa

Image-generative artificial intelligence (AI) has garnered significant attention in recent years. In particular, the diffusion model, a core component of generative AI, produces high-quality images with rich diversity. In this study, we proposed a novel computed tomography (CT) reconstruction method by combining the denoising diffusion probabilistic model with iterative CT reconstruction. In sharp contrast to previous studies, we optimized the fidelity loss of CT reconstruction with respect to the latent variable of the diffusion model, instead of the image and model parameters. To suppress the changes in anatomical structures produced by the diffusion model, we shallowed the diffusion and reverse processes and fixed a set of added noises in the reverse process to make it deterministic during the inference. We demonstrated the effectiveness of the proposed method through the sparse-projection CT reconstruction of 1/10 projection data. Despite the simplicity of the implementation, the proposed method has the potential to reconstruct high-quality images while preserving the patient's anatomical structures and was found to outperform existing methods, including iterative reconstruction, iterative reconstruction with total variation, and the diffusion model alone in terms of quantitative indices such as the structural similarity index and peak signal-to-noise ratio. We also explored further sparse-projection CT reconstruction using 1/20 projection data with the same trained diffusion model. As the number of iterations increased, the image quality improved comparable to that of 1/10 sparse-projection CT reconstruction. In principle, this method can be widely applied not only to CT but also to other imaging modalities.

Read more

9/14/2024