Implicit Neural Representations for Robust Joint Sparse-View CT Reconstruction
0
🧠
Sign in to get full access
Overview
- Computed Tomography (CT) is crucial for industrial quality control and medical diagnostics.
- Sparse-view CT, which reduces ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems.
- Recent advancements in Implicit Neural Representations (INRs) have shown promise in addressing sparse-view CT reconstruction.
- Recognizing that CT often involves scanning similar subjects, this paper proposes a novel approach to improve reconstruction quality through joint reconstruction of multiple objects using INRs.
Plain English Explanation
Computed Tomography (CT) scans are widely used in industries and healthcare to examine the internal structures of objects or the human body. Traditional CT scans require a large number of X-ray images to create a detailed 3D reconstruction. However, reducing the number of X-ray images, known as sparse-view CT, can lower the amount of radiation exposure. Unfortunately, this sparse-view approach makes it more difficult to accurately reconstruct the 3D image.
Recent advancements in Implicit Neural Representations (INRs) have shown promise in improving sparse-view CT reconstruction. INRs are a way of representing 3D objects using neural networks, which can be more efficient than traditional 3D modeling techniques.
This paper proposes a new approach that takes advantage of the fact that CT scans often involve scanning similar objects, such as different patients or products. By jointly reconstructing multiple objects using INRs, the researchers aim to leverage both the strengths of INRs and the statistical patterns across the scanned objects. This could lead to better quality 3D reconstructions from sparse-view CT data.
Technical Explanation
The researchers recognize that CT scans often involve scanning similar subjects, such as different patients or products. They propose a novel approach to improve reconstruction quality by jointly reconstructing multiple objects using Implicit Neural Representations (INRs).
Current INR joint reconstruction techniques primarily focus on accelerating convergence via meta-initialization, but they do not specifically target enhancing reconstruction quality. To address this, the researchers introduce a novel INR-based Bayesian framework that integrates latent variables to capture the inter-object relationships.
These latent variables serve as a dynamic reference throughout the optimization process, thereby enhancing the fidelity of individual reconstructions. The researchers conduct extensive experiments to assess various key factors, such as reconstruction quality, resistance to overfitting, and generalizability. Their results demonstrate significant improvements over baseline methods in common numerical metrics, showcasing a notable advancement in CT reconstruction techniques.
Critical Analysis
The paper presents a promising approach for improving sparse-view CT reconstruction by leveraging the strengths of INRs and the statistical regularities across multiple scanned objects. The proposed Bayesian framework with latent variables to capture inter-object relationships is an innovative solution to the challenge of enhancing reconstruction quality beyond just accelerating convergence.
However, the paper does not provide much detail on the specific architecture or implementation of the latent variable model. It would be beneficial to have a more in-depth technical explanation of how the latent variables are introduced and optimized within the INR-based reconstruction process.
Additionally, the paper could benefit from a more thorough discussion of the limitations and potential drawbacks of the proposed approach. For example, it is unclear how the method would scale to a large number of objects, or how sensitive the reconstruction quality is to the similarity of the scanned subjects.
Further research could explore the robustness of the method to various types of object variations, as well as investigate potential applications beyond medical imaging, such as in industrial quality control or other fields that involve scanning similar objects.
Conclusion
This paper presents a novel approach to improve sparse-view Computed Tomography (CT) reconstruction by leveraging Implicit Neural Representations (INRs) and the statistical regularities across multiple scanned objects. The proposed INR-based Bayesian framework with latent variables to capture inter-object relationships demonstrates significant improvements in reconstruction quality, resistance to overfitting, and generalizability compared to baseline methods.
This research represents a notable advancement in CT reconstruction techniques, with the potential to enhance industrial quality control and medical diagnostics by reducing ionizing radiation exposure while maintaining high-quality 3D reconstructions. Further exploration of the method's scalability and robustness, as well as its applicability to other domains involving the scanning of similar objects, could lead to even broader impacts.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🧠
0
Implicit Neural Representations for Robust Joint Sparse-View CT Reconstruction
Jiayang Shi, Junyi Zhu, Daniel M. Pelt, K. Joost Batenburg, Matthew B. Blaschko
Computed Tomography (CT) is pivotal in industrial quality control and medical diagnostics. Sparse-view CT, offering reduced ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems. Recent advancements in Implicit Neural Representations (INRs) have shown promise in addressing sparse-view CT reconstruction. Recognizing that CT often involves scanning similar subjects, we propose a novel approach to improve reconstruction quality through joint reconstruction of multiple objects using INRs. This approach can potentially leverage both the strengths of INRs and the statistical regularities across multiple objects. While current INR joint reconstruction techniques primarily focus on accelerating convergence via meta-initialization, they are not specifically tailored to enhance reconstruction quality. To address this gap, we introduce a novel INR-based Bayesian framework integrating latent variables to capture the inter-object relationships. These variables serve as a dynamic reference throughout the optimization, thereby enhancing individual reconstruction fidelity. Our extensive experiments, which assess various key factors such as reconstruction quality, resistance to overfitting, and generalizability, demonstrate significant improvements over baselines in common numerical metrics. This underscores a notable advancement in CT reconstruction methods.
Read more5/7/2024
0
AC-IND: Sparse CT reconstruction based on attenuation coefficient estimation and implicit neural distribution
Wangduo Xie, Richard Schoonhoven, Tristan van Leeuwen, Matthew B. Blaschko
Computed tomography (CT) reconstruction plays a crucial role in industrial nondestructive testing and medical diagnosis. Sparse view CT reconstruction aims to reconstruct high-quality CT images while only using a small number of projections, which helps to improve the detection speed of industrial assembly lines and is also meaningful for reducing radiation in medical scenarios. Sparse CT reconstruction methods based on implicit neural representations (INRs) have recently shown promising performance, but still produce artifacts because of the difficulty of obtaining useful prior information. In this work, we incorporate a powerful prior: the total number of material categories of objects. To utilize the prior, we design AC-IND, a self-supervised method based on Attenuation Coefficient Estimation and Implicit Neural Distribution. Specifically, our method first transforms the traditional INR from scalar mapping to probability distribution mapping. Then we design a compact attenuation coefficient estimator initialized with values from a rough reconstruction and fast segmentation. Finally, our algorithm finishes the CT reconstruction by jointly optimizing the estimator and the generated distribution. Through experiments, we find that our method not only outperforms the comparative methods in sparse CT reconstruction but also can automatically generate semantic segmentation maps.
Read more9/12/2024
0
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction
Chenhe Du, Xiyue Lin, Qing Wu, Xuanyu Tian, Ying Su, Zhe Luo, Rui Zheng, Yang Chen, Hongjiang Wei, S. Kevin Zhou, Jingyi Yu, Yuyao Zhang
Limited-angle and sparse-view computed tomography (LACT and SVCT) are crucial for expanding the scope of X-ray CT applications. However, they face challenges due to incomplete data acquisition, resulting in diverse artifacts in the reconstructed CT images. Emerging implicit neural representation (INR) techniques, such as NeRF, NeAT, and NeRP, have shown promise in under-determined CT imaging reconstruction tasks. However, the unsupervised nature of INR architecture imposes limited constraints on the solution space, particularly for the highly ill-posed reconstruction task posed by LACT and ultra-SVCT. In this study, we introduce the Diffusion Prior Driven Neural Representation (DPER), an advanced unsupervised framework designed to address the exceptionally ill-posed CT reconstruction inverse problems. DPER adopts the Half Quadratic Splitting (HQS) algorithm to decompose the inverse problem into data fidelity and distribution prior sub-problems. The two sub-problems are respectively addressed by INR reconstruction scheme and pre-trained score-based diffusion model. This combination first injects the implicit image local consistency prior from INR. Additionally, it effectively augments the feasibility of the solution space for the inverse problem through the generative diffusion model, resulting in increased stability and precision in the solutions. We conduct comprehensive experiments to evaluate the performance of DPER on LACT and ultra-SVCT reconstruction with two public datasets (AAPM and LIDC), an in-house clinical COVID-19 dataset and a public raw projection dataset created by Mayo Clinic. The results show that our method outperforms the state-of-the-art reconstruction methods on in-domain datasets, while achieving significant performance improvements on out-of-domain (OOD) datasets.
Read more7/22/2024
0
INFusion: Diffusion Regularized Implicit Neural Representations for 2D and 3D accelerated MRI reconstruction
Yamin Arefeen, Brett Levac, Zach Stoebner, Jonathan Tamir
Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available. Previous work demonstrates that INRs improve rapid MRI through inherent regularization imposed by neural network architectures. Typically parameterized by fully-connected neural networks, INRs support continuous image representations by taking a physical coordinate location as input and outputting the intensity at that coordinate. Previous work has applied unlearned regularization priors during INR training and have been limited to 2D or low-resolution 3D acquisitions. Meanwhile, diffusion based generative models have received recent attention as they learn powerful image priors decoupled from the measurement model. This work proposes INFusion, a technique that regularizes the optimization of INRs from under-sampled MR measurements with pre-trained diffusion models for improved image reconstruction. In addition, we propose a hybrid 3D approach with our diffusion regularization that enables INR application on large-scale 3D MR datasets. 2D experiments demonstrate improved INR training with our proposed diffusion regularization, and 3D experiments demonstrate feasibility of INR training with diffusion regularization on 3D matrix sizes of 256 by 256 by 80.
Read more6/21/2024