Contactless seismocardiography via Gunnar-Farneback optical flow
0
Sign in to get full access
Overview
- Contactless seismocardiography using Gunnar-Farneback optical flow
- Supported by the National Science Foundation and Mississippi Institutions of Higher Learning
- Focuses on vision-based monitoring of heart vibrations for cardiovascular health assessment
Plain English Explanation
Seismocardiography is a technique that measures the subtle movements and vibrations of the heart, which can provide insights into cardiovascular health. Traditionally, this has required contact-based sensors attached to the body. This paper explores a contactless approach, using video cameras to track the heart's movements without any physical attachment.
The key innovation is the use of the Gunnar-Farneback optical flow algorithm, which can detect and analyze the subtle motions of the chest wall caused by the beating heart. By processing these video-based measurements, the researchers were able to obtain seismocardiographic signals that are comparable to those from traditional contact-based methods.
This contactless approach has several advantages. It is non-invasive and comfortable for the patient, as no sensors need to be attached. It also has the potential to enable continuous, long-term monitoring of cardiovascular health, which could be useful for early detection of issues or tracking recovery after treatment.
Technical Explanation
The paper describes a system for contactless seismocardiography using the Gunnar-Farneback optical flow algorithm. Optical flow is a computer vision technique that can detect and quantify the motion of objects in a video stream.
In this case, the researchers used optical flow to track the subtle movements of the chest wall caused by the beating heart. By analyzing these motions, they were able to extract seismocardiographic signals that are comparable to those obtained from traditional contact-based sensors.
The experiment involved recording video of participants' chests using a high-speed camera, then applying the Gunnar-Farneback algorithm to the video to estimate the optical flow. The resulting motion vectors were used to generate seismocardiographic signals, which were then compared to signals from a contact-based seismocardiograph for validation.
The results showed a strong correlation between the contactless and contact-based seismocardiographic signals, demonstrating the potential of this approach for remote cardiovascular monitoring without the need for any physical attachment to the body.
Critical Analysis
The paper presents a promising approach to contactless seismocardiography, but it also acknowledges several limitations and areas for further research.
One key limitation is the need for a high-speed camera to capture the subtle chest wall motions. This may limit the practical applicability of the technique, as high-speed cameras can be expensive and bulky. The researchers suggest exploring the use of lower-cost, lower-frame-rate cameras in future work.
Additionally, the experiments were conducted in a controlled laboratory setting, and the researchers note that the performance of the system may be affected by factors such as clothing, body hair, and lighting conditions in real-world scenarios. Further testing in more diverse and realistic settings would be necessary to fully evaluate the robustness and reliability of the approach.
Another area for future research is the potential integration of this contactless seismocardiography system with other remote cardiovascular monitoring techniques, such as photoplethysmography (PPG) or electrocardiography (ECG), to provide a more comprehensive assessment of cardiovascular health.
Conclusion
This paper presents a novel approach to contactless seismocardiography using Gunnar-Farneback optical flow, which has the potential to enable non-invasive, continuous monitoring of cardiovascular health. The results demonstrate the feasibility of this technique and its ability to generate seismocardiographic signals comparable to traditional contact-based methods.
While the current system has some limitations, the researchers have identified several areas for further development and refinement. Overcoming these challenges could lead to the broader adoption of contactless seismocardiography, potentially revolutionizing the way we monitor and assess cardiovascular health in the future.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Contactless seismocardiography via Gunnar-Farneback optical flow
Mohammad Muntasir Rahman, Amirtaha Taebi
Seismocardiography (SCG) has gained significant attention due to its potential applications in monitoring cardiac health and diagnosing cardiovascular conditions. Conventional SCG methods rely on accelerometers attached to the chest, which can be uncomfortable or inconvenient. In recent years, researchers have explored non-contact methods to capture SCG signals, and one promising approach involves analyzing video recordings of the chest. In this study, we investigate a vision-based method based on the Gunnar-Farneback optical flow to extract SCG signals from the chest skin movements recorded by a smartphone camera. We compared the SCG signals extracted from the chest videos of four healthy subjects with those obtained from accelerometers and our previous method based on sticker tracking. Our results demonstrated that the vision-based SCG signals extracted by the proposed method closely resembled those from accelerometers and stickers, although these signals were captured from slightly different locations. The mean squared error between the vision-based SCG signals and accelerometer-based signals was found to be within a reasonable range, especially between signals on head-to-foot direction (0.2$<$MSE$<$1.5). Additionally, heart rates derived from the vision-based SCG exhibited good agreement with the gold-standard ECG measurements, with a mean difference of 0.8 bpm. These results indicate the potential of this non-invasive method in health monitoring and diagnostics.
Read more8/20/2024
0
Ghost imaging-based Non-contact Heart Rate Detection
Jianming Yu, Yuchen He, Bin Li, Hui Chen, Huaibin Zheng, Jianbin Liu, Zhuo Xu
Remote heart rate measurement is an increasingly concerned research field, usually using remote photoplethysmography (rPPG) to collect heart rate information through video data collection. However, in certain specific scenarios (such as low light conditions, intense lighting, and non-line-of-sight situations), traditional imaging methods fail to capture image information effectively, that may lead to difficulty or inability in measuring heart rate. To address these limitations, this study proposes using ghost imaging as a substitute for traditional imaging in the aforementioned scenarios. The mean absolute error between experimental measurements and reference true values is 4.24 bpm.Additionally, the bucket signals obtained by the ghost imaging system can be directly processed using digital signal processing techniques, thereby enhancing personal privacy protection.
Read more6/6/2024
0
Continuous 3D Myocardial Motion Tracking via Echocardiography
Chengkang Shen, Hao Zhu, You Zhou, Yu Liu, Si Yi, Lili Dong, Weipeng Zhao, David J. Brady, Xun Cao, Zhan Ma, Yi Lin
Myocardial motion tracking stands as an essential clinical tool in the prevention and detection of cardiovascular diseases (CVDs), the foremost cause of death globally. However, current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions, hindering the early identification of myocardial dysfunction. To address these challenges, this paper introduces the Neural Cardiac Motion Field (NeuralCMF). NeuralCMF leverages implicit neural representation (INR) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart. This method surpasses pixel-wise limitations by offering the capability to continuously query the precise shape and motion of the myocardium at any specific point throughout the cardiac cycle, enhancing the detailed analysis of cardiac dynamics beyond traditional speckle tracking. Notably, NeuralCMF operates without the need for paired datasets, and its optimization is self-supervised through the physics knowledge priors in both space and time dimensions, ensuring compatibility with both 2D and 3D echocardiogram video inputs. Experimental validations across three representative datasets support the robustness and innovative nature of the NeuralCMF, marking significant advantages over existing state-of-the-art methods in cardiac imaging and motion tracking.
Read more6/28/2024
0
Unsupervised 4D Cardiac Motion Tracking with Spatiotemporal Optical Flow Networks
Long Teng, Wei Feng, Menglong Zhu, Xinchao Li
Cardiac motion tracking from echocardiography can be used to estimate and quantify myocardial motion within a cardiac cycle. It is a cost-efficient and effective approach for assessing myocardial function. However, ultrasound imaging has the inherent characteristics of spatially low resolution and temporally random noise, which leads to difficulties in obtaining reliable annotation. Thus it is difficult to perform supervised learning for motion tracking. In addition, there is no end-to-end unsupervised method currently in the literature. This paper presents a motion tracking method where unsupervised optical flow networks are designed with spatial reconstruction loss and temporal-consistency loss. Our proposed loss functions make use of the pair-wise and temporal correlation to estimate cardiac motion from noisy background. Experiments using a synthetic 4D echocardiography dataset has shown the effectiveness of our approach, and its superiority over existing methods on both accuracy and running speed. To the best of our knowledge, this is the first work performed that uses unsupervised end-to-end deep learning optical flow network for 4D cardiac motion tracking.
Read more7/8/2024