3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning
0
Sign in to get full access
Overview
- This paper presents a method for reconstructing 3D vessel structures from sparse-view dynamic digital subtraction angiography (DSA) images.
- The approach uses a vessel probability field and an attenuation field to guide the 3D reconstruction process, leveraging deep learning techniques.
- The proposed method aims to enable high-quality 3D vessel reconstruction from limited DSA image data, which is important for clinical applications like cerebrovascular disease diagnosis and treatment planning.
Plain English Explanation
Digital subtraction angiography (DSA) is a medical imaging technique that can visualize blood vessels in the body. It works by injecting a contrast agent into the bloodstream and then taking X-ray images. However, acquiring high-quality 3D reconstructions of vessels from DSA images can be challenging, especially when only a small number of views (sparse-view) are available.
The researchers in this paper developed a new method to address this problem. Their approach learns to estimate two key properties of the vessels - a "vessel probability field" that indicates the likelihood of a vessel being present, and an "attenuation field" that models how X-rays interact with the vessels. By incorporating these learned fields into the 3D reconstruction process, the method can produce high-quality 3D vessel models even from limited DSA image data.
This is important because it can enable better diagnosis and treatment planning for conditions like cerebrovascular disease, where accurate 3D visualization of the blood vessels is crucial. The technique could also be applied to other medical imaging modalities that suffer from sparse-view limitations, like optical Doppler tomography or dynamic 3D scene reconstruction.
Technical Explanation
The paper proposes a deep learning-based approach for 3D vessel reconstruction from sparse-view dynamic DSA images. The key elements of the method are:
-
Vessel Probability Field: The method first learns to estimate a 3D "vessel probability field" from the 2D DSA images. This field encodes the likelihood of a vessel being present at each location in the 3D space.
-
Attenuation Field: In parallel, the method also learns to estimate a 3D "attenuation field" that models how X-rays interact with the vessel structures. This provides additional information to guide the 3D reconstruction.
-
Reconstruction: The vessel probability field and attenuation field are then used as inputs to a 3D reconstruction module, which generates the final 3D vessel model. This allows the method to leverage the learned vessel and attenuation properties to produce high-quality reconstructions from limited DSA data.
The authors evaluate their approach on both simulated and real DSA datasets, demonstrating significant improvements in 3D reconstruction quality compared to baseline methods, especially in the sparse-view setting. This suggests the vessel probability and attenuation fields are effective at compensating for the limited input information.
Critical Analysis
The paper presents a novel and promising approach for 3D vessel reconstruction from sparse-view DSA images. However, there are a few aspects that could be further explored or improved:
-
Validation on more diverse datasets: The evaluation was primarily conducted on a single DSA dataset, so testing the method's generalization to a wider range of anatomies, imaging conditions, and patient populations would be valuable.
-
Comparison to alternative reconstruction techniques: While the paper compares to some baseline methods, exploring the performance relative to other 3D reconstruction approaches, such as those based on compressed sensing or structured abstraction, could provide additional insights.
-
Clinical feasibility and translation: To fully assess the practical impact of this work, further investigation is needed into the clinical applicability, such as the required image quality, acquisition protocols, and integration with existing clinical workflows.
Overall, this paper presents an interesting and well-executed approach that could significantly advance the state-of-the-art in 3D vessel reconstruction from sparse-view DSA data, with potential benefits for cerebrovascular disease diagnosis and treatment as well as other medical imaging applications.
Conclusion
This paper introduces a novel deep learning-based method for reconstructing 3D vessel structures from sparse-view dynamic DSA images. By learning to estimate vessel probability and attenuation fields, the approach can generate high-quality 3D reconstructions even when only limited 2D DSA data is available.
The proposed technique has the potential to improve clinical applications such as cerebrovascular disease diagnosis and treatment planning, where accurate 3D visualization of blood vessels is crucial. Additionally, the core ideas behind the method could be applicable to other medical imaging modalities that suffer from sparse-view limitations, opening up new possibilities for improved 3D reconstruction in a variety of healthcare scenarios.
While further validation and optimization are still needed, this work represents a significant step forward in addressing the challenge of 3D vessel reconstruction from limited DSA data, with promising implications for the field of medical imaging and clinical decision-making.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning
Zhentao Liu, Huangxuan Zhao, Wenhui Qin, Zhenghong Zhou, Xinggang Wang, Wenping Wang, Xiaochun Lai, Chuansheng Zheng, Dinggang Shen, Zhiming Cui
Digital Subtraction Angiography (DSA) is one of the gold standards in vascular disease diagnosing. With the help of contrast agent, time-resolved 2D DSA images deliver comprehensive insights into blood flow information and can be utilized to reconstruct 3D vessel structures. Current commercial DSA systems typically demand hundreds of scanning views to perform reconstruction, resulting in substantial radiation exposure. However, sparse-view DSA reconstruction, aimed at reducing radiation dosage, is still underexplored in the research community. The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task. In this study, we propose to use a time-agnostic vessel probability field to solve this problem effectively. Our approach, termed as vessel probability guided attenuation learning, represents the DSA imaging as a complementary weighted combination of static and dynamic attenuation fields, with the weights derived from the vessel probability field. Functioning as a dynamic mask, vessel probability provides proper gradients for both static and dynamic fields adaptive to different scene types. This mechanism facilitates a self-supervised decomposition between static backgrounds and dynamic contrast agent flow, and significantly improves the reconstruction quality. Our model is trained by minimizing the disparity between synthesized projections and real captured DSA images. We further employ two training strategies to improve our reconstruction quality: (1) coarse-to-fine progressive training to achieve better geometry and (2) temporal perturbed rendering loss to enforce temporal consistency. Experimental results have demonstrated superior quality on both 3D vessel reconstruction and 2D view synthesis.
Read more5/20/2024
0
DSCA: A Digital Subtraction Angiography Sequence Dataset and Spatio-Temporal Model for Cerebral Artery Segmentation
Qihang Xie, Mengguo Guo, Lei Mou, Dan Zhang, Da Chen, Caifeng Shan, Yitian Zhao, Ruisheng Su, Jiong Zhang
Cerebrovascular diseases (CVDs) remain a leading cause of global disability and mortality. Digital Subtraction Angiography (DSA) sequences, recognized as the golden standard for diagnosing CVDs, can clearly visualize the dynamic flow and reveal pathological conditions within the cerebrovasculature. Therefore, precise segmentation of cerebral arteries (CAs) and classification between their main trunks and branches are crucial for physicians to accurately quantify diseases. However, achieving accurate CA segmentation in DSA sequences remains a challenging task due to small vessels with low contrast, and ambiguity between vessels and residual skull structures. Moreover, the lack of publicly available datasets limits exploration in the field. In this paper, we introduce a DSA Sequence-based Cerebral Artery segmentation dataset (DSCA), the first publicly accessible dataset designed specifically for pixel-level semantic segmentation of CAs. Additionally, we propose DSANet, a spatio-temporal network for CA segmentation in DSA sequences. Unlike existing DSA segmentation methods that focus only on a single frame, the proposed DSANet introduces a separate temporal encoding branch to capture dynamic vessel details across multiple frames. To enhance small vessel segmentation and improve vessel connectivity, we design a novel TemporalFormer module to capture global context and correlations among sequential frames. Furthermore, we develop a Spatio-Temporal Fusion (STF) module to effectively integrate spatial and temporal features from the encoder. Extensive experiments demonstrate that DSANet outperforms other state-of-the-art methods in CA segmentation, achieving a Dice of 0.9033.
Read more6/4/2024
🖼️
0
CAVE: Cerebral Artery-Vein Segmentation in Digital Subtraction Angiography
Ruisheng Su, P. Matthijs van der Sluijs, Yuan Chen, Sandra Cornelissen, Ruben van den Broek, Wim H. van Zwam, Aad van der Lugt, Wiro Niessen, Danny Ruijters, Theo van Walsum
Cerebral X-ray digital subtraction angiography (DSA) is a widely used imaging technique in patients with neurovascular disease, allowing for vessel and flow visualization with high spatio-temporal resolution. Automatic artery-vein segmentation in DSA plays a fundamental role in vascular analysis with quantitative biomarker extraction, facilitating a wide range of clinical applications. The widely adopted U-Net applied on static DSA frames often struggles with disentangling vessels from subtraction artifacts. Further, it falls short in effectively separating arteries and veins as it disregards the temporal perspectives inherent in DSA. To address these limitations, we propose to simultaneously leverage spatial vasculature and temporal cerebral flow characteristics to segment arteries and veins in DSA. The proposed network, coined CAVE, encodes a 2D+time DSA series using spatial modules, aggregates all the features using temporal modules, and decodes it into 2D segmentation maps. On a large multi-center clinical dataset, CAVE achieves a vessel segmentation Dice of 0.84 ($pm$0.04) and an artery-vein segmentation Dice of 0.79 ($pm$0.06). CAVE surpasses traditional Frangi-based K-means clustering (P<0.001) and U-Net (P<0.001) by a significant margin, demonstrating the advantages of harvesting spatio-temporal features. This study represents the first investigation into automatic artery-vein segmentation in DSA using deep learning. The code is publicly available at https://github.com/RuishengSu/CAVE_DSA.
Read more5/2/2024
0
NeRF-CA: Dynamic Reconstruction of X-ray Coronary Angiography with Extremely Sparse-views
Kirsten W. H. Maas, Danny Ruijters, Anna Vilanova, Nicola Pezzotti
Dynamic three-dimensional (4D) reconstruction from two-dimensional X-ray coronary angiography (CA) remains a significant clinical problem. Challenges include sparse-view settings, intra-scan motion, and complex vessel morphology such as structure sparsity and background occlusion. Existing CA reconstruction methods often require extensive user interaction or large training datasets. On the other hand, Neural Radiance Field (NeRF), a promising deep learning technique, has successfully reconstructed high-fidelity static scenes for natural and medical scenes. Recent work, however, identified that sparse-views, background occlusion, and dynamics still pose a challenge when applying NeRF in the X-ray angiography context. Meanwhile, many successful works for natural scenes propose regularization for sparse-view reconstruction or scene decomposition to handle dynamics. However, these techniques do not directly translate to the CA context, where both challenges and background occlusion are significant. This paper introduces NeRF-CA, the first step toward a 4D CA reconstruction method that achieves reconstructions from sparse coronary angiograms with cardiac motion. We leverage the motion of the coronary artery to decouple the scene into a dynamic coronary artery component and static background. We combine this scene decomposition with tailored regularization techniques. These techniques enforce the separation of the coronary artery from the background by enforcing dynamic structure sparsity and scene smoothness. By uniquely combining these approaches, we achieve 4D reconstructions from as few as four angiogram sequences. This setting aligns with clinical workflows while outperforming state-of-the-art X-ray sparse-view NeRF reconstruction techniques. We validate our approach quantitatively and qualitatively using 4D phantom datasets and ablation studies.
Read more8/30/2024