Anatomically aware dual-hop learning for pulmonary embolism detection in CT pulmonary angiograms

Read original: arXiv:2303.17593 - Published 5/20/2024 by Florin Condrea, Saikiran Rapaka, Lucian Itu, Puneet Sharma, Jonathan Sperl, A Mohamed Ali, Marius Leordeanu
Total Score

0

🔎

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Pulmonary embolisms (PEs) are a leading cause of cardiovascular death, and while medical imaging is the gold standard for diagnosis, it can still be prone to misdiagnosis or delays.
  • Deep learning has shown promise in boosting performance for a range of medical imaging tasks, but there is limited research on automatic pulmonary embolism detection.
  • This paper introduces a deep learning-based approach that combines computer vision and deep neural networks for efficient pulmonary embolism detection in computed tomographic pulmonary angiography (CTPA) scans.

Plain English Explanation

Pulmonary embolisms are blockages in the lungs that can be life-threatening if not detected and treated quickly. Doctors typically use a medical imaging technique called computed tomographic pulmonary angiography (CTPA) to diagnose these blockages. While CTPA is considered the gold standard, it can sometimes lead to misdiagnosis or significant delays, which can be critical for patients.

Recent advances in deep learning, a type of artificial intelligence, have shown great potential in improving the performance of medical imaging analysis. However, there hasn't been much research on using deep learning specifically for detecting pulmonary embolisms. This paper presents a new deep learning-based approach that combines computer vision techniques and deep neural networks to more efficiently detect pulmonary embolisms in CTPA scans.

The key innovations of this approach include:

  1. Automatically detecting the anatomical structures in the CTPA scans, which can help the deep learning model better understand the context.
  2. Using a specialized pre-training process that focuses on learning about the relevant anatomical structures, which can improve the model's performance.
  3. Employing a dual-hop deep neural network, which means the model processes the information in two stages to make a more accurate prediction of whether a pulmonary embolism is present.

The researchers tested this approach on a large, publicly available dataset of CTPA scans and achieved state-of-the-art results, meaning it outperformed previous methods. This suggests that this deep learning approach could be a valuable tool to help clinicians more accurately and quickly diagnose pulmonary embolisms, potentially saving lives.

Technical Explanation

The paper presents a deep learning-based approach for efficient pulmonary embolism (PE) detection in computed tomographic pulmonary angiography (CTPA) scans. The key innovations of this work include:

  1. Automatic detection of anatomical structures: The method first employs a deep learning model to automatically detect the relevant anatomical structures, such as the pulmonary arteries and veins, in the CTPA scans. This anatomical awareness can help the subsequent deep learning models better understand the context and make more informed predictions about the presence of PEs.

  2. Anatomical-aware pre-training: The researchers use a specialized pre-training process that focuses on learning the representations of the relevant anatomical structures. This "anatomical-aware" pre-training can improve the model's performance on the downstream PE detection task compared to standard pre-training approaches.

  3. Dual-hop deep neural network: The final PE detection model uses a dual-hop deep neural network architecture, which processes the input information in two stages. This allows the model to make more informed and accurate predictions about the presence of PEs.

The proposed approach was evaluated on the publicly available RSNA dataset, a large-scale, multicenter dataset of CTPA scans. The researchers report state-of-the-art results, outperforming previous methods for automatic PE detection.

Critical Analysis

The paper presents a compelling deep learning-based approach for efficient pulmonary embolism detection in CTPA scans. The key innovations, such as the automatic detection of anatomical structures, anatomical-aware pre-training, and the dual-hop deep neural network, demonstrate a thoughtful and systematic approach to addressing the challenges of this task.

However, the paper does not discuss the potential limitations or caveats of the proposed method. For example, it would be valuable to understand how the model's performance might be affected by variations in CTPA scan quality, patient demographics, or the prevalence of PEs in the dataset. Additionally, the paper does not explore the model's interpretability or provide insights into the specific features or patterns it uses to detect PEs, which could be an important consideration for clinical adoption.

Further research could also investigate the generalizability of the approach, such as its performance on data from different healthcare systems or its ability to detect other types of cardiovascular abnormalities beyond PEs. Lastly, the potential clinical impact and cost-effectiveness of deploying such a system in real-world settings could be an important area for future study.

Overall, the paper presents a promising deep learning-based solution for improving the efficiency and accuracy of pulmonary embolism detection, but additional research is needed to fully understand the approach's limitations, interpretability, and broader clinical implications.

Conclusion

This paper introduces a deep learning-based method for efficient pulmonary embolism detection in CTPA scans, which is a critical and often challenging task in clinical practice. The key innovations, including automatic anatomical structure detection, anatomical-aware pre-training, and a dual-hop deep neural network, demonstrate a thoughtful and systematic approach to addressing the complexities of this medical imaging problem.

The researchers report state-of-the-art results on a large, publicly available dataset, suggesting that this deep learning approach could be a valuable tool to help clinicians more accurately and quickly diagnose pulmonary embolisms, potentially saving lives. However, further research is needed to fully understand the method's limitations, interpretability, and broader clinical impact.

Overall, this work represents an important step forward in leveraging the power of deep learning to enhance medical imaging analysis and improve patient outcomes in the context of cardiovascular diseases.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Total Score

0

Anatomically aware dual-hop learning for pulmonary embolism detection in CT pulmonary angiograms

Florin Condrea, Saikiran Rapaka, Lucian Itu, Puneet Sharma, Jonathan Sperl, A Mohamed Ali, Marius Leordeanu

Pulmonary Embolisms (PE) represent a leading cause of cardiovascular death. While medical imaging, through computed tomographic pulmonary angiography (CTPA), represents the gold standard for PE diagnosis, it is still susceptible to misdiagnosis or significant diagnosis delays, which may be fatal for critical cases. Despite the recently demonstrated power of deep learning to bring a significant boost in performance in a wide range of medical imaging tasks, there are still very few published researches on automatic pulmonary embolism detection. Herein we introduce a deep learning based approach, which efficiently combines computer vision and deep neural networks for pulmonary embolism detection in CTPA. Our method features novel improvements along three orthogonal axes: 1) automatic detection of anatomical structures; 2) anatomical aware pretraining, and 3) a dual-hop deep neural net for PE detection. We obtain state-of-the-art results on the publicly available multicenter large-scale RSNA dataset.

Read more

5/20/2024

Cross-Phase Mutual Learning Framework for Pulmonary Embolism Identification on Non-Contrast CT Scans
Total Score

0

Cross-Phase Mutual Learning Framework for Pulmonary Embolism Identification on Non-Contrast CT Scans

Bizhe Bai, Yan-Jie Zhou, Yujian Hu, Tony C. W. Mok, Yilang Xiang, Le Lu, Hongkun Zhang, Minfeng Xu

Pulmonary embolism (PE) is a life-threatening condition where rapid and accurate diagnosis is imperative yet difficult due to predominantly atypical symptomatology. Computed tomography pulmonary angiography (CTPA) is acknowledged as the gold standard imaging tool in clinics, yet it can be contraindicated for emergency department (ED) patients and represents an onerous procedure, thus necessitating PE identification through non-contrast CT (NCT) scans. In this work, we explore the feasibility of applying a deep-learning approach to NCT scans for PE identification. We propose a novel Cross-Phase Mutual learNing framework (CPMN) that fosters knowledge transfer from CTPA to NCT, while concurrently conducting embolism segmentation and abnormality classification in a multi-task manner. The proposed CPMN leverages the Inter-Feature Alignment (IFA) strategy that enhances spatial contiguity and mutual learning between the dual-pathway network, while the Intra-Feature Discrepancy (IFD) strategy can facilitate precise segmentation of PE against complex backgrounds for single-pathway networks. For a comprehensive assessment of the proposed approach, a large-scale dual-phase dataset containing 334 PE patients and 1,105 normal subjects has been established. Experimental results demonstrate that CPMN achieves the leading identification performance, which is 95.4% and 99.6% in patient-level sensitivity and specificity on NCT scans, indicating the potential of our approach as an economical, accessible, and precise tool for PE identification in clinical practice.

Read more

7/17/2024

🔮

Total Score

0

Pulmonary Embolism Mortality Prediction Using Multimodal Learning Based on Computed Tomography Angiography and Clinical Data

Zhusi Zhong, Helen Zhang, Fayez H. Fayad, Andrew C. Lancaster, John Sollee, Shreyas Kulkarni, Cheng Ting Lin, Jie Li, Xinbo Gao, Scott Collins, Colin Greineder, Sun H. Ahn, Harrison X. Bai, Zhicheng Jiao, Michael K. Atalay

Purpose: Pulmonary embolism (PE) is a significant cause of mortality in the United States. The objective of this study is to implement deep learning (DL) models using Computed Tomography Pulmonary Angiography (CTPA), clinical data, and PE Severity Index (PESI) scores to predict PE mortality. Materials and Methods: 918 patients (median age 64 years, range 13-99 years, 52% female) with 3,978 CTPAs were identified via retrospective review across three institutions. To predict survival, an AI model was used to extract disease-related imaging features from CTPAs. Imaging features and/or clinical variables were then incorporated into DL models to predict survival outcomes. Four models were developed as follows: (1) using CTPA imaging features only; (2) using clinical variables only; (3) multimodal, integrating both CTPA and clinical variables; and (4) multimodal fused with calculated PESI score. Performance and contribution from each modality were evaluated using concordance index (c-index) and Net Reclassification Improvement, respectively. Performance was compared to PESI predictions using the Wilcoxon signed-rank test. Kaplan-Meier analysis was performed to stratify patients into high- and low-risk groups. Additional factor-risk analysis was conducted to account for right ventricular (RV) dysfunction. Results: For both data sets, the PESI-fused and multimodal models achieved higher c-indices than PESI alone. Following stratification of patients into high- and low-risk groups by multimodal and PESI-fused models, mortality outcomes differed significantly (both p<0.001). A strong correlation was found between high-risk grouping and RV dysfunction. Conclusions: Multiomic DL models incorporating CTPA features, clinical data, and PESI achieved higher c-indices than PESI alone for PE survival prediction.

Read more

6/6/2024

🤿

Total Score

0

Deep learning-driven pulmonary arteries and veins segmentation reveals demography-associated pulmonary vasculature anatomy

Yuetan Chu, Gongning Luo, Longxi Zhou, Shaodong Cao, Guolin Ma, Xianglin Meng, Juexiao Zhou, Changchun Yang, Dexuan Xie, Ricardo Henao, Xigang Xiao, Lianming Wu, Zhaowen Qiu, Xin Gao

Pulmonary artery-vein segmentation is crucial for diagnosing pulmonary diseases and surgical planning, and is traditionally achieved by Computed Tomography Pulmonary Angiography (CTPA). However, concerns regarding adverse health effects from contrast agents used in CTPA have constrained its clinical utility. In contrast, identifying arteries and veins using non-contrast CT, a conventional and low-cost clinical examination routine, has long been considered impossible. Here we propose a High-abundant Pulmonary Artery-vein Segmentation (HiPaS) framework achieving accurate artery-vein segmentation on both non-contrast CT and CTPA across various spatial resolutions. HiPaS first performs spatial normalization on raw CT scans via a super-resolution module, and then iteratively achieves segmentation results at different branch levels by utilizing the low-level vessel segmentation as a prior for high-level vessel segmentation. We trained and validated HiPaS on our established multi-centric dataset comprising 1,073 CT volumes with meticulous manual annotation. Both quantitative experiments and clinical evaluation demonstrated the superior performance of HiPaS, achieving a dice score of 91.8% and a sensitivity of 98.0%. Further experiments demonstrated the non-inferiority of HiPaS segmentation on non-contrast CT compared to segmentation on CTPA. Employing HiPaS, we have conducted an anatomical study of pulmonary vasculature on 10,613 participants in China (five sites), discovering a new association between pulmonary vessel abundance and sex and age: vessel abundance is significantly higher in females than in males, and slightly decreases with age, under the controlling of lung volumes (p < 0.0001). HiPaS realizing accurate artery-vein segmentation delineates a promising avenue for clinical diagnosis and understanding pulmonary physiology in a non-invasive manner.

Read more

4/12/2024