Intelligent Cardiac Auscultation for Murmur Detection via Parallel-Attentive Models with Uncertainty Estimation

Read original: arXiv:2405.03953 - Published 5/8/2024 by Zixing Zhang, Tao Pang, Jing Han, Bjorn W. Schuller
Total Score

0

🔎

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Heart murmurs are common signs of cardiovascular diseases that can provide early clues about cardiac abnormalities.
  • Current research methods often focus on model accuracy, overlooking other important aspects like interpretability and prediction uncertainty.
  • This paper introduces a heart murmur detection method using a parallel-attentive model with two branches: one based on self-attention and the other on convolutional networks.
  • The model also incorporates an uncertainty estimation method using Monte Carlo Dropout and temperature scaling to improve the reliability of predictions.

Plain English Explanation

Heart murmurs are unusual sounds that can be heard when listening to the heart. They are often an early indication that something is wrong with the heart. While current research on detecting heart murmurs typically focuses on making the most accurate models, this paper takes a different approach.

The researchers developed a new method that uses a parallel neural network with two different components. One part looks at the overall pattern of the heart murmur, while the other focuses on the details. This allows the model to capture both the big picture and the small nuances of the heart sound. Unlike some previous methods that struggle with complex patterns in the data, this parallel structure is better able to handle the long-term dependencies in the heart murmur recordings.

In addition, the researchers recognized that for medical applications, it's important to not just have an accurate model, but also to understand how certain the model is about its predictions. To address this, they incorporated a technique called Monte Carlo Dropout that allows the model to estimate the uncertainty in its outputs. They also calibrated the model's predictions to make them more reliable.

When tested on a dataset of heart murmur recordings, this new method achieved state-of-the-art performance, accurately detecting heart murmurs 79.8% of the time and correctly classifying them 65.1% of the time. These results represent an improvement over previous approaches to this problem.

Technical Explanation

The proposed heart murmur detection method uses a parallel-attentive model consisting of two branches: one based on a self-attention module and the other on a convolutional neural network. The self-attention branch is designed to capture long-term dependencies in the sequential heart sound data, while the convolutional branch focuses on extracting local and global features.

The researchers incorporated an uncertainty estimation technique based on Monte Carlo Dropout into their model. This allows the model to not only make predictions, but also provide estimates of the uncertainty associated with those predictions. Additionally, they employed temperature scaling to calibrate the predictions of their probabilistic model, improving its reliability.

In experiments conducted on the CirCor Digiscope dataset, the proposed method achieved a weighted accuracy of 79.8% and an F1 score of 65.1% for heart murmur detection, outperforming state-of-the-art approaches. This improvement in performance can be attributed to the model's ability to effectively capture both the local and global features of heart murmurs, as well as its incorporation of uncertainty estimation and calibration techniques.

Critical Analysis

The paper presents a promising approach to heart murmur detection, but it also acknowledges several limitations and areas for further research. For example, the authors note that the dataset used in the experiments is relatively small, and they suggest that testing the model on larger and more diverse datasets would be valuable.

Additionally, while the incorporation of uncertainty estimation is a strength of the model, the paper does not provide a detailed analysis of how the uncertainty estimates are used in clinical decision-making. Further research is needed to understand the practical implications of incorporating uncertainty information into the heart murmur detection process.

Another potential limitation is the interpretability of the parallel-attentive model. While the authors claim that the model is better equipped to handle long-term dependencies in the data, the inherent complexity of the architecture may make it challenging to understand the specific mechanisms behind the model's predictions. Exploring more interpretable approaches could be a valuable direction for future research.

Conclusion

This paper introduces a novel heart murmur detection method that combines a parallel-attentive neural network architecture with effective uncertainty estimation and calibration techniques. The results demonstrate state-of-the-art performance on the CirCor Digiscope dataset, highlighting the potential of this approach to improve the early detection of cardiovascular diseases.

By addressing important aspects beyond just model accuracy, such as interpretability and uncertainty, this research represents a step forward in developing more robust and clinically-relevant machine learning models for medical applications. As the field of AI-powered healthcare continues to evolve, studies like this one will play a crucial role in ensuring that these technologies are reliable, transparent, and beneficial to patients and healthcare providers.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Total Score

0

Intelligent Cardiac Auscultation for Murmur Detection via Parallel-Attentive Models with Uncertainty Estimation

Zixing Zhang, Tao Pang, Jing Han, Bjorn W. Schuller

Heart murmurs are a common manifestation of cardiovascular diseases and can provide crucial clues to early cardiac abnormalities. While most current research methods primarily focus on the accuracy of models, they often overlook other important aspects such as the interpretability of machine learning algorithms and the uncertainty of predictions. This paper introduces a heart murmur detection method based on a parallel-attentive model, which consists of two branches: One is based on a self-attention module and the other one is based on a convolutional network. Unlike traditional approaches, this structure is better equipped to handle long-term dependencies in sequential data, and thus effectively captures the local and global features of heart murmurs. Additionally, we acknowledge the significance of understanding the uncertainty of model predictions in the medical field for clinical decision-making. Therefore, we have incorporated an effective uncertainty estimation method based on Monte Carlo Dropout into our model. Furthermore, we have employed temperature scaling to calibrate the predictions of our probabilistic model, enhancing its reliability. In experiments conducted on the CirCor Digiscope dataset for heart murmur detection, our proposed method achieves a weighted accuracy of 79.8% and an F1 of 65.1%, representing state-of-the-art results.

Read more

5/8/2024

Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
Total Score

0

Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram

Jingping Nie, Ran Liu, Behrooz Mahasseni, Erdrin Azemi, Vikramjit Mitra

Acoustic signals are crucial for health monitoring, particularly heart sounds which provide essential data like heart rate and detect cardiac anomalies such as murmurs. This study utilizes a publicly available phonocardiogram (PCG) dataset to estimate heart rate using model-driven methods and extends the best-performing model to a multi-task learning (MTL) framework for simultaneous heart rate estimation and murmur detection. Heart rate estimates are derived using a sliding window technique on heart sound snippets, analyzed with a combination of acoustic features (Mel spectrogram, cepstral coefficients, power spectral density, root mean square energy). Our findings indicate that a 2D convolutional neural network (textbf{texttt{2dCNN}}) is most effective for heart rate estimation, achieving a mean absolute error (MAE) of 1.312 bpm. We systematically investigate the impact of different feature combinations and find that utilizing all four features yields the best results. The MTL model (textbf{texttt{2dCNN-MTL}}) achieves accuracy over 95% in murmur detection, surpassing existing models, while maintaining an MAE of 1.636 bpm in heart rate estimation, satisfying the requirements stated by Association for the Advancement of Medical Instrumentation (AAMI).

Read more

7/29/2024

🤿

Total Score

0

FunnelNet: An End-to-End Deep Learning Framework to Monitor Digital Heart Murmur in Real-Time

Md Jobayer, Md. Mehedi Hasan Shawon, Md Rakibul Hasan, Shreya Ghosh, Tom Gedeon, Md Zakir Hossain

Objective: Heart murmurs are abnormal sounds caused by turbulent blood flow within the heart. Several diagnostic methods are available to detect heart murmurs and their severity, such as cardiac auscultation, echocardiography, phonocardiogram (PCG), etc. However, these methods have limitations, including extensive training and experience among healthcare providers, cost and accessibility of echocardiography, as well as noise interference and PCG data processing. This study aims to develop a novel end-to-end real-time heart murmur detection approach using traditional and depthwise separable convolutional networks. Methods: Continuous wavelet transform (CWT) was applied to extract meaningful features from the PCG data. The proposed network has three parts: the Squeeze net, the Bottleneck, and the Expansion net. The Squeeze net generates a compressed data representation, whereas the Bottleneck layer reduces computational complexity using a depthwise-separable convolutional network. The Expansion net is responsible for up-sampling the compressed data to a higher dimension, capturing tiny details of the representative data. Results: For evaluation, we used four publicly available datasets and achieved state-of-the-art performance in all datasets. Furthermore, we tested our proposed network on two resource-constrained devices: a Raspberry PI and an Android device, stripping it down into a tiny machine learning model (TinyML), achieving a maximum of 99.70%. Conclusion: The proposed model offers a deep learning framework for real-time accurate heart murmur detection within limited resources. Significance: It will significantly result in more accessible and practical medical services and reduced diagnosis time to assist medical professionals. The code is publicly available at TBA.

Read more

5/17/2024

🔎

Total Score

0

Exploring Pre-trained General-purpose Audio Representations for Heart Murmur Detection

Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino

To reduce the need for skilled clinicians in heart sound interpretation, recent studies on automating cardiac auscultation have explored deep learning approaches. However, despite the demands for large data for deep learning, the size of the heart sound datasets is limited, and no pre-trained model is available. On the contrary, many pre-trained models for general audio tasks are available as general-purpose audio representations. This study explores the potential of general-purpose audio representations pre-trained on large-scale datasets for transfer learning in heart murmur detection. Experiments on the CirCor DigiScope heart sound dataset show that the recent self-supervised learning Masked Modeling Duo (M2D) outperforms previous methods with the results of a weighted accuracy of 0.832 and an unweighted average recall of 0.713. Experiments further confirm improved performance by ensembling M2D with other models. These results demonstrate the effectiveness of general-purpose audio representation in processing heart sounds and open the way for further applications. Our code is available online which runs on a 24 GB consumer GPU at https://github.com/nttcslab/m2d/tree/master/app/circor

Read more

4/29/2024