Tensor-based Multimodal Learning for Prediction of Pulmonary Arterial Wedge Pressure from Cardiac MRI

Read original: arXiv:2303.07540 - Published 4/9/2024 by Prasun C. Tripathi, Mohammod N. I. Suvon, Lawrence Schobs, Shuo Zhou, Samer Alabed, Andrew J. Swift, Haiping Lu
Total Score

0

🔮

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a tensor learning-based pipeline for identifying Pulmonary Arterial Wedge Pressure (PAWP) from multimodal cardiac Magnetic Resonance Imaging (MRI).
  • PAWP is an important marker for high pressure in the left ventricle, which is a serious condition in heart failure patients.
  • The proposed pipeline extracts spatial and temporal features from high-dimensional cardiac MRI scans and integrates them with Electronic Health Record data to improve performance.
  • The method achieves significant improvements over baselines in clinical practice, demonstrating its diagnostic value.

Plain English Explanation

Heart failure is a serious and life-threatening condition that can lead to high pressure in the left ventricle of the heart. Pulmonary Arterial Wedge Pressure (PAWP) is an important measurement that indicates this high pressure, but it requires an invasive procedure called Right Heart Catheterization (RHC) to obtain.

In this study, the researchers developed a new machine learning-based approach to estimate PAWP non-invasively from cardiac MRI scans and Electronic Health Records. Their tensor learning-based pipeline analyzes the spatial and temporal patterns in the MRI data to extract relevant features. It also incorporates an uncertainty-based strategy to ensure the training data is of high quality.

By combining the MRI features with data from Electronic Health Records, the researchers were able to achieve significant improvements in accurately predicting PAWP compared to previous methods. This means their approach could help quickly identify high-risk heart failure patients from a large population without the need for an invasive procedure.

Technical Explanation

The researchers developed a tensor learning-based pipeline to estimate Pulmonary Arterial Wedge Pressure (PAWP) from multimodal cardiac Magnetic Resonance Imaging (MRI) data. PAWP is an important marker of high pressure in the left ventricle, which is a serious condition in heart failure.

The pipeline extracts spatial and temporal features from high-dimensional cardiac MRI scans, including short-axis and four-chamber views. To ensure the quality of the training data, the researchers incorporated an epistemic uncertainty-based binning strategy to identify poor-quality samples.

To further improve performance, the researchers integrated features from Electronic Health Records with the MRI-based features. This allowed the model to learn complementary information from the multimodal data sources.

The experimental analysis on a large cohort of 1,346 subjects who underwent the RHC procedure for PAWP estimation showed that the proposed pipeline achieved significant improvements over baselines in clinical practice. The decision curve analysis further confirmed the clinical utility of the method.

Critical Analysis

The paper presents a promising approach for non-invasively estimating Pulmonary Arterial Wedge Pressure (PAWP), an important marker of heart failure. The use of multimodal data, including cardiac MRI and Electronic Health Records, is a particular strength of the research, as it allows the model to learn from complementary sources of information.

However, the paper does not discuss the potential limitations of the method, such as the availability and quality of the MRI and EHR data, or the generalizability of the approach to other populations or healthcare settings. It would be helpful to understand the specific challenges encountered in deploying such a system in a real-world clinical setting.

Additionally, the paper does not provide much insight into the interpretability of the tensor learning-based model. While the performance improvements are promising, it would be valuable to understand how the model arrives at its predictions and whether the features learned by the model align with clinical knowledge about the underlying physiology.

Overall, this is a well-designed study that demonstrates the potential of multimodal machine learning for non-invasive cardiac assessment. Further research is needed to address the limitations and ensure the clinical feasibility and interpretability of the approach.

Conclusion

This paper presents a tensor learning-based pipeline for non-invasively estimating Pulmonary Arterial Wedge Pressure (PAWP) from multimodal cardiac MRI and Electronic Health Record data. PAWP is an important marker of high pressure in the left ventricle, a serious condition in heart failure patients.

The proposed pipeline achieves significant improvements over baseline methods in clinical practice, demonstrating its diagnostic value. By providing a non-invasive way to quickly identify high-risk heart failure patients, this approach has the potential to improve patient care and outcomes. Further research is needed to address the limitations and ensure the clinical feasibility of the method.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔮

Total Score

0

Tensor-based Multimodal Learning for Prediction of Pulmonary Arterial Wedge Pressure from Cardiac MRI

Prasun C. Tripathi, Mohammod N. I. Suvon, Lawrence Schobs, Shuo Zhou, Samer Alabed, Andrew J. Swift, Haiping Lu

Heart failure is a serious and life-threatening condition that can lead to elevated pressure in the left ventricle. Pulmonary Arterial Wedge Pressure (PAWP) is an important surrogate marker indicating high pressure in the left ventricle. PAWP is determined by Right Heart Catheterization (RHC) but it is an invasive procedure. A non-invasive method is useful in quickly identifying high-risk patients from a large population. In this work, we develop a tensor learning-based pipeline for identifying PAWP from multimodal cardiac Magnetic Resonance Imaging (MRI). This pipeline extracts spatial and temporal features from high-dimensional scans. For quality control, we incorporate an epistemic uncertainty-based binning strategy to identify poor-quality training samples. To improve the performance, we learn complementary information by integrating features from multimodal data: cardiac MRI with short-axis and four-chamber views, and Electronic Health Records. The experimental analysis on a large cohort of $1346$ subjects who underwent the RHC procedure for PAWP estimation indicates that the proposed pipeline has a diagnostic value and can produce promising performance with significant improvement over the baseline in clinical practice (i.e., $Delta$AUC $=0.10$, $Delta$Accuracy $=0.06$, and $Delta$MCC $=0.39$). The decision curve analysis further confirms the clinical utility of our method.

Read more

4/9/2024

Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessment
Total Score

0

Interpretable Multimodal Learning for Cardiovascular Hemodynamics Assessment

Prasun C Tripathi, Sina Tabakhi, Mohammod N I Suvon, Lawrence Schob, Samer Alabed, Andrew J Swift, Shuo Zhou, Haiping Lu

Pulmonary Arterial Wedge Pressure (PAWP) is an essential cardiovascular hemodynamics marker to detect heart failure. In clinical practice, Right Heart Catheterization is considered a gold standard for assessing cardiac hemodynamics while non-invasive methods are often needed to screen high-risk patients from a large population. In this paper, we propose a multimodal learning pipeline to predict PAWP marker. We utilize complementary information from Cardiac Magnetic Resonance Imaging (CMR) scans (short-axis and four-chamber) and Electronic Health Records (EHRs). We extract spatio-temporal features from CMR scans using tensor-based learning. We propose a graph attention network to select important EHR features for prediction, where we model subjects as graph nodes and feature relationships as graph edges using the attention mechanism. We design four feature fusion strategies: early, intermediate, late, and hybrid fusion. With a linear classifier and linear fusion strategies, our pipeline is interpretable. We validate our pipeline on a large dataset of $2,641$ subjects from our ASPIRE registry. The comparative study against state-of-the-art methods confirms the superiority of our pipeline. The decision curve analysis further validates that our pipeline can be applied to screen a large population. The code is available at https://github.com/prasunc/hemodynamics.

Read more

4/9/2024

TabMixer: Noninvasive Estimation of the Mean Pulmonary Artery Pressure via Imaging and Tabular Data Mixing
Total Score

0

TabMixer: Noninvasive Estimation of the Mean Pulmonary Artery Pressure via Imaging and Tabular Data Mixing

Michal K. Grzeszczyk, Przemys{l}aw Korzeniowski, Samer Alabed, Andrew J. Swift, Tomasz Trzci'nski, Arkadiusz Sitek

Right Heart Catheterization is a gold standard procedure for diagnosing Pulmonary Hypertension by measuring mean Pulmonary Artery Pressure (mPAP). It is invasive, costly, time-consuming and carries risks. In this paper, for the first time, we explore the estimation of mPAP from videos of noninvasive Cardiac Magnetic Resonance Imaging. To enhance the predictive capabilities of Deep Learning models used for this task, we introduce an additional modality in the form of demographic features and clinical measurements. Inspired by all-Multilayer Perceptron architectures, we present TabMixer, a novel module enabling the integration of imaging and tabular data through spatial, temporal and channel mixing. Specifically, we present the first approach that utilizes Multilayer Perceptrons to interchange tabular information with imaging features in vision models. We test TabMixer for mPAP estimation and show that it enhances the performance of Convolutional Neural Networks, 3D-MLP and Vision Transformers while being competitive with previous modules for imaging and tabular data. Our approach has the potential to improve clinical processes involving both modalities, particularly in noninvasive mPAP estimation, thus, significantly enhancing the quality of life for individuals affected by Pulmonary Hypertension. We provide a source code for using TabMixer at https://github.com/SanoScience/TabMixer.

Read more

9/14/2024

Cross-Phase Mutual Learning Framework for Pulmonary Embolism Identification on Non-Contrast CT Scans
Total Score

0

Cross-Phase Mutual Learning Framework for Pulmonary Embolism Identification on Non-Contrast CT Scans

Bizhe Bai, Yan-Jie Zhou, Yujian Hu, Tony C. W. Mok, Yilang Xiang, Le Lu, Hongkun Zhang, Minfeng Xu

Pulmonary embolism (PE) is a life-threatening condition where rapid and accurate diagnosis is imperative yet difficult due to predominantly atypical symptomatology. Computed tomography pulmonary angiography (CTPA) is acknowledged as the gold standard imaging tool in clinics, yet it can be contraindicated for emergency department (ED) patients and represents an onerous procedure, thus necessitating PE identification through non-contrast CT (NCT) scans. In this work, we explore the feasibility of applying a deep-learning approach to NCT scans for PE identification. We propose a novel Cross-Phase Mutual learNing framework (CPMN) that fosters knowledge transfer from CTPA to NCT, while concurrently conducting embolism segmentation and abnormality classification in a multi-task manner. The proposed CPMN leverages the Inter-Feature Alignment (IFA) strategy that enhances spatial contiguity and mutual learning between the dual-pathway network, while the Intra-Feature Discrepancy (IFD) strategy can facilitate precise segmentation of PE against complex backgrounds for single-pathway networks. For a comprehensive assessment of the proposed approach, a large-scale dual-phase dataset containing 334 PE patients and 1,105 normal subjects has been established. Experimental results demonstrate that CPMN achieves the leading identification performance, which is 95.4% and 99.6% in patient-level sensitivity and specificity on NCT scans, indicating the potential of our approach as an economical, accessible, and precise tool for PE identification in clinical practice.

Read more

7/17/2024