Diffusion Transformer Model With Compact Prior for Low-dose PET Reconstruction

2407.00944

YC

0

Reddit

0

Published 7/2/2024 by Bin Huang, Xubiao Liu, Lei Fang, Qiegen Liu, Bingxuan Li

📈

Abstract

Positron emission tomography (PET) is an advanced medical imaging technique that plays a crucial role in non-invasive clinical diagnosis. However, while reducing radiation exposure through low-dose PET scans is beneficial for patient safety, it often results in insufficient statistical data. This scarcity of data poses significant challenges for accurately reconstructing high-quality images, which are essential for reliable diagnostic outcomes. In this research, we propose a diffusion transformer model (DTM) guided by joint compact prior (JCP) to enhance the reconstruction quality of low-dose PET imaging. In light of current research findings, we present a pioneering PET reconstruction model that integrates diffusion and transformer models for joint optimization. This model combines the powerful distribution mapping abilities of diffusion models with the capacity of transformers to capture long-range dependencies, offering significant advantages for low-dose PET reconstruction. Additionally, the incorporation of the lesion refining block and penalized weighted least squares (PWLS) enhance the recovery capability of lesion regions and preserves detail information, solving blurring problems in lesion areas and texture details of most deep learning frameworks. Experimental results demonstrate the effectiveness of DTM in enhancing image quality and preserving critical clinical information for low-dose PET scans. Our approach not only reduces radiation exposure risks but also provides a more reliable PET imaging tool for early disease detection and patient management.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • Positron Emission Tomography (PET) is a medical imaging technique used for clinical diagnosis.
  • Reducing radiation exposure through low-dose PET scans is beneficial for patient safety, but can result in insufficient statistical data.
  • This scarcity of data poses challenges for accurately reconstructing high-quality images, which are crucial for reliable diagnostic outcomes.
  • The researchers propose a Diffusion Transformer Model (DTM) guided by Joint Compact Prior (JCP) to enhance the reconstruction quality of low-dose PET imaging.

Plain English Explanation

PET scans are a type of medical imaging that can help doctors diagnose and monitor various health conditions. While lowering the radiation dose for these scans is good for patient safety, it can sometimes result in images that don't have enough detail or information for the doctors to make accurate diagnoses.

The researchers in this study developed a new computer model that aims to improve the quality of low-dose PET scan images. This model combines two powerful machine learning techniques - diffusion models and transformers - to create high-quality images from the limited data available in low-dose scans.

Diffusion models are good at mapping out the distribution of data, while transformers can capture long-range dependencies in the data. By combining these two approaches, the researchers' model is able to reconstruct PET images with more detail and accuracy, even when the original scan had less radiation exposure.

Additionally, the model includes features that help it better identify and preserve important details in the image, like lesions or textural information. This makes the reconstructed images more reliable for medical diagnosis and monitoring.

Overall, this research provides a promising new tool for reducing radiation exposure in PET scans while still maintaining the image quality needed for effective healthcare.

Technical Explanation

The researchers propose a Diffusion Transformer Model (DTM) guided by Joint Compact Prior (JCP) to enhance the reconstruction quality of low-dose PET imaging. This model integrates the powerful distribution mapping abilities of diffusion models with the capacity of transformers to capture long-range dependencies, offering significant advantages for low-dose PET reconstruction.

The DTM architecture consists of a diffusion module and a transformer module. The diffusion module uses a 25D multi-view averaging diffusion model to generate high-quality PET images from low-dimensional latent representations. The transformer module then refines these images by capturing long-range dependencies.

To further enhance the reconstruction quality, the researchers incorporate a lesion refining block and a penalized weighted least squares (PWLS) optimization step. The lesion refining block improves the recovery capability of lesion regions, while the PWLS step preserves detail information and solves blurring problems in lesion areas and texture details.

Experiments demonstrate the effectiveness of the DTM model in enhancing image quality and preserving critical clinical information for low-dose PET scans. The researchers also compare their approach to other PET reconstruction methods and physics-informed diffusion models, showing the advantages of their proposed technique.

Critical Analysis

The researchers have provided a compelling solution to the challenge of reconstructing high-quality PET images from low-dose scans. The integration of diffusion models and transformers is a novel and promising approach, leveraging the strengths of both techniques to address the limitations of low-dose PET imaging.

However, the paper does not extensively discuss potential limitations or caveats of the proposed DTM model. For example, the model's performance on different types of lesions or patient populations could be further explored. Additionally, the computational complexity and inference time of the DTM model compared to other PET reconstruction methods could be an important consideration for real-world clinical deployment.

It would also be valuable to see the model evaluated on a larger and more diverse dataset to assess its generalizability and robustness. The researchers mention the need for further research to optimize the model's hyperparameters and explore different architectural configurations.

Overall, this research represents an important step forward in enhancing low-dose PET imaging, but there is still room for further refinement and validation to ensure the model's practical utility and widespread adoption in clinical settings.

Conclusion

The proposed Diffusion Transformer Model (DTM) guided by Joint Compact Prior (JCP) offers a promising solution for improving the reconstruction quality of low-dose PET imaging. By integrating the strengths of diffusion models and transformers, the DTM model can generate high-quality PET images from limited data, while also preserving critical clinical information like lesion details and texture.

This research has the potential to significantly reduce radiation exposure for patients undergoing PET scans, without compromising the reliability of the diagnostic information. As the researchers continue to refine and validate the model, it could become a valuable tool for early disease detection, patient management, and overall healthcare delivery.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Dose-aware Diffusion Model for 3D Low-dose PET: Multi-institutional Validation with Reader Study and Real Low-dose Data

Dose-aware Diffusion Model for 3D Low-dose PET: Multi-institutional Validation with Reader Study and Real Low-dose Data

Huidong Xie, Weijie Gan, Bo Zhou, Ming-Kai Chen, Michal Kulon, Annemarie Boustani, Benjamin A. Spencer, Reimund Bayerlein, Xiongchao Chen, Qiong Liu, Xueqi Guo, Menghua Xia, Yinchi Zhou, Hui Liu, Liang Guo, Hongyu An, Ulugbek S. Kamilov, Hanzhong Wang, Biao Li, Axel Rominger, Kuangyu Shi, Ge Wang, Ramsey D. Badawi, Chi Liu

YC

0

Reddit

0

As PET imaging is accompanied by radiation exposure and potentially increased cancer risk, reducing radiation dose in PET scans without compromising the image quality is an important topic. Deep learning (DL) techniques have been investigated for low-dose PET imaging. However, existing models have often resulted in compromised image quality when achieving low-dose PET and have limited generalizability to different image noise-levels, acquisition protocols, patient populations, and hospitals. Recently, diffusion models have emerged as the new state-of-the-art generative model to generate high-quality samples and have demonstrated strong potential for medical imaging tasks. However, for low-dose PET imaging, existing diffusion models failed to generate consistent 3D reconstructions, unable to generalize across varying noise-levels, often produced visually-appealing but distorted image details, and produced images with biased tracer uptake. Here, we develop DDPET-3D, a dose-aware diffusion model for 3D low-dose PET imaging to address these challenges. Collected from 4 medical centers globally with different scanners and clinical protocols, we extensively evaluated the proposed model using a total of 9,783 18F-FDG studies (1,596 patients) with low-dose/low-count levels ranging from 1% to 50%. With a cross-center, cross-scanner validation, the proposed DDPET-3D demonstrated its potential to generalize to different low-dose levels, different scanners, and different clinical protocols. As confirmed with reader studies performed by nuclear medicine physicians, the proposed method produced superior denoised results that are comparable to or even better than the 100% full-count images as well as previous DL baselines. The presented results show the potential of achieving low-dose PET while maintaining image quality. Lastly, a group of real low-dose scans was also included for evaluation.

Read more

5/24/2024

2.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction

2.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction

Tianqi Chen, Jun Hou, Yinchi Zhou, Huidong Xie, Xiongchao Chen, Qiong Liu, Xueqi Guo, Menghua Xia, James S. Duncan, Chi Liu, Bo Zhou

YC

0

Reddit

0

Positron Emission Tomography (PET) is an important clinical imaging tool but inevitably introduces radiation hazards to patients and healthcare providers. Reducing the tracer injection dose and eliminating the CT acquisition for attenuation correction can reduce the overall radiation dose, but often results in PET with high noise and bias. Thus, it is desirable to develop 3D methods to translate the non-attenuation-corrected low-dose PET (NAC-LDPET) into attenuation-corrected standard-dose PET (AC-SDPET). Recently, diffusion models have emerged as a new state-of-the-art deep learning method for image-to-image translation, better than traditional CNN-based methods. However, due to the high computation cost and memory burden, it is largely limited to 2D applications. To address these challenges, we developed a novel 2.5D Multi-view Averaging Diffusion Model (MADM) for 3D image-to-image translation with application on NAC-LDPET to AC-SDPET translation. Specifically, MADM employs separate diffusion models for axial, coronal, and sagittal views, whose outputs are averaged in each sampling step to ensure the 3D generation quality from multiple views. To accelerate the 3D sampling process, we also proposed a strategy to use the CNN-based 3D generation as a prior for the diffusion model. Our experimental results on human patient studies suggested that MADM can generate high-quality 3D translation images, outperforming previous CNN-based and Diffusion-based baseline methods.

Read more

6/18/2024

👀

Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction

Wenhao Zhang, Bin Huang, Shuyue Chen, Xiaoling Xu, Weiwen Wu, Qiegen Liu

YC

0

Reddit

0

Low-dose computed tomography (LDCT) plays a vital role in clinical applications by mitigating radiation risks. Nevertheless, reducing radiation doses significantly degrades image quality. Concurrently, common deep learning methods demand extensive data, posing concerns about privacy, cost, and time constraints. Consequently, we propose a few-shot low-dose CT reconstruction method using Partitioned Hankel-based Diffusion (PHD) models. During the prior learning stage, the projection data is first transformed into multiple partitioned Hankel matrices. Structured tensors are then extracted from these matrices to facilitate prior learning through multiple diffusion models. In the iterative reconstruction stage, an iterative stochastic differential equation solver is employed along with data consistency constraints to update the acquired projection data. Furthermore, penalized weighted least-squares and total variation techniques are introduced to enhance the resulting image quality. The results approximate those of normal-dose counterparts, validating PHD model as an effective and practical model for reducing artifacts and noise while preserving image quality.

Read more

5/28/2024

📈

Full-dose Whole-body PET Synthesis from Low-dose PET Using High-efficiency Denoising Diffusion Probabilistic Model: PET Consistency Model

Shaoyan Pan, Elham Abouei, Junbo Peng, Joshua Qian, Jacob F Wynne, Tonghe Wang, Chih-Wei Chang, Justin Roper, Jonathon A Nye, Hui Mao, Xiaofeng Yang

YC

0

Reddit

0

Objective: Positron Emission Tomography (PET) has been a commonly used imaging modality in broad clinical applications. One of the most important tradeoffs in PET imaging is between image quality and radiation dose: high image quality comes with high radiation exposure. Improving image quality is desirable for all clinical applications while minimizing radiation exposure is needed to reduce risk to patients. Approach: We introduce PET Consistency Model (PET-CM), an efficient diffusion-based method for generating high-quality full-dose PET images from low-dose PET images. It employs a two-step process, adding Gaussian noise to full-dose PET images in the forward diffusion, and then denoising them using a PET Shifted-window Vision Transformer (PET-VIT) network in the reverse diffusion. The PET-VIT network learns a consistency function that enables direct denoising of Gaussian noise into clean full-dose PET images. PET-CM achieves state-of-the-art image quality while requiring significantly less computation time than other methods. Results: In experiments comparing eighth-dose to full-dose images, PET-CM demonstrated impressive performance with NMAE of 1.278+/-0.122%, PSNR of 33.783+/-0.824dB, SSIM of 0.964+/-0.009, NCC of 0.968+/-0.011, HRS of 4.543, and SUV Error of 0.255+/-0.318%, with an average generation time of 62 seconds per patient. This is a significant improvement compared to the state-of-the-art diffusion-based model with PET-CM reaching this result 12x faster. Similarly, in the quarter-dose to full-dose image experiments, PET-CM delivered competitive outcomes, achieving an NMAE of 0.973+/-0.066%, PSNR of 36.172+/-0.801dB, SSIM of 0.984+/-0.004, NCC of 0.990+/-0.005, HRS of 4.428, and SUV Error of 0.151+/-0.192% using the same generation process, which underlining its high quantitative and clinical precision in both denoising scenario.

Read more

4/10/2024