OMuSense-23: A Multimodal Dataset for Contactless Breathing Pattern Recognition and Biometric Analysis
0
👁️
Sign in to get full access
Overview
- The paper introduces the Oulu Multi Sensing (OMuSense-23) dataset, which includes biosignals from a mmWave radar and an RGB-D camera.
- The dataset features data from 50 individuals in three poses (standing, sitting, lying down) and four breathing pattern activities (regular breathing, reading, guided breathing, apnea).
- The paper provides a detailed overview of the dataset, the data acquisition protocol, and a baseline evaluation of tasks like biometrics, breathing pattern recognition, and pose identification.
Plain English Explanation
The research paper presents a new dataset called OMuSense-23 that could be very useful for researchers and developers working on non-contact biometrics and human activity recognition.
The dataset contains information collected from 50 different people using two types of sensors: a mmWave radar and an RGB-D camera. The researchers had the people stand, sit, and lie down, and then measured their breathing patterns in different scenarios, like normal breathing, reading out loud, controlled breathing, and even holding their breath.
By having this comprehensive dataset, researchers can use it to develop and test new AI models for things like identifying people based on their breathing and body movements, as well as recognizing different breathing patterns and body poses. The authors provide some initial results showing the dataset can achieve high accuracy on these types of tasks.
Overall, this new OMuSense-23 dataset seems like it could be a valuable resource for advancing research in non-contact sensing and activity recognition, which has important applications in healthcare, security, and beyond.
Technical Explanation
The OMuSense-23 dataset was created to address the lack of versatile, multimodal datasets in the field of non-contact biometrics and human activity recognition. The dataset includes biosignals captured using a mmWave radar and an RGB-D camera, with data collected from 50 individuals across three distinct poses (standing, sitting, lying down) and four specific breathing pattern activities (regular breathing, reading, guided breathing, apnea).
The paper provides a detailed overview of the dataset, including the data acquisition protocol. Participants were instructed to perform the different poses and breathing patterns, with the sensors continuously recording their biosignals. This resulted in a comprehensive dataset covering both typical scenarios (e.g. sitting with normal breathing) and critical conditions (e.g. lying down without breathing).
The authors also present baseline evaluations of several data analysis tasks using the OMuSense-23 dataset. Their results demonstrate the dataset's utility, achieving pose identification accuracy of 87% and breathing pattern activity recognition of 83% using features extracted from the biosignals.
Critical Analysis
The OMuSense-23 dataset represents an important contribution to the field of non-contact biometrics and human activity recognition. By providing a multimodal dataset with a diverse range of poses and breathing patterns, the researchers have created a valuable resource for developing and evaluating new AI models in this domain.
However, the paper does not discuss certain limitations or caveats of the dataset. For example, it would be helpful to know the demographic distribution of the 50 participants, as well as any potential biases or imbalances in the data. Additionally, the paper could have explored the challenges and considerations in synchronizing and fusing the data from the mmWave radar and RGB-D camera.
Furthermore, the baseline evaluations presented in the paper are relatively simple, focusing on pose identification and breathing pattern recognition. While these are important tasks, the dataset's potential could be better highlighted by demonstrating its applicability to a broader range of non-contact biometric and activity recognition problems.
Conclusion
The OMuSense-23 dataset represents a valuable contribution to the field of non-contact biometrics and human activity recognition. By providing a comprehensive, multimodal dataset with diverse poses and breathing patterns, the researchers have created a resource that can enable the development and evaluation of advanced AI models in this domain.
The dataset's potential applications span healthcare, security, and beyond, and its public availability will likely spur further innovation and progress in the field. While the paper could have explored certain limitations and expanded the baseline evaluations, the OMuSense-23 dataset remains a significant step forward in addressing the lack of versatile datasets in non-contact sensing and activity recognition.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
👁️
0
OMuSense-23: A Multimodal Dataset for Contactless Breathing Pattern Recognition and Biometric Analysis
Manuel Lage Ca~nellas, Le Nguyen, Anirban Mukherjee, Constantino 'Alvarez Casado, Xiaoting Wu, Praneeth Susarla, Sasan Sharifipour, Dinesh B. Jayagopi, Miguel Bordallo L'opez
In the domain of non-contact biometrics and human activity recognition, the lack of a versatile, multimodal dataset poses a significant bottleneck. To address this, we introduce the Oulu Multi Sensing (OMuSense-23) dataset that includes biosignals obtained from a mmWave radar, and an RGB-D camera. The dataset features data from 50 individuals in three distinct poses -- standing, sitting, and lying down -- each featuring four specific breathing pattern activities: regular breathing, reading, guided breathing, and apnea, encompassing both typical situations (e.g., sitting with normal breathing) and critical conditions (e.g., lying down without breathing). In our work, we present a detailed overview of the OMuSense-23 dataset, detailing the data acquisition protocol, describing the process for each participant. In addition, we provide, a baseline evaluation of several data analysis tasks related to biometrics, breathing pattern recognition and pose identification. Our results achieve a pose identification accuracy of 87% and breathing pattern activity recognition of 83% using features extracted from biosignals. The OMuSense-23 dataset is publicly available as resource for other researchers and practitioners in the field.
Read more7/9/2024
0
On the effectiveness of smartphone IMU sensors and Deep Learning in the detection of cardiorespiratory conditions
Lorenzo Simone, Luca Miglior, Vincenzo Gervasi, Luca Moroni, Emanuele Vignali, Emanuele Gasparotti, Simona Celi
This research introduces an innovative method for the early screening of cardiorespiratory diseases based on an acquisition protocol, which leverages commodity smartphone's Inertial Measurement Units (IMUs) and deep learning techniques. We collected, in a clinical setting, a dataset featuring recordings of breathing kinematics obtained by accelerometer and gyroscope readings from five distinct body regions. We propose an end-to-end deep learning pipeline for early cardiorespiratory disease screening, incorporating a preprocessing step segmenting the data into individual breathing cycles, and a recurrent bidirectional module capturing features from diverse body regions. We employed Leave-one-out-cross-validation with Bayesian optimization for hyperparameter tuning and model selection. The experimental results consistently demonstrated the superior performance of a bidirectional Long-Short Term Memory (Bi-LSTM) as a feature encoder architecture, yielding an average sensitivity of $0.81 pm 0.02$, specificity of $0.82 pm 0.05$, F1 score of $0.81 pm 0.02$, and accuracy of $80.2% pm 3.9$ across diverse seed variations. We also assessed generalization capabilities on a skewed distribution, comprising exclusively healthy patients not used in training, revealing a true negative rate of $74.8 % pm 4.5$. The sustained accuracy of predictions over time during breathing cycles within a single patient underscores the efficacy of the preprocessing strategy, highlighting the model's ability to discern significant patterns throughout distinct phases of the respiratory cycle. This investigation underscores the potential usefulness of widely available smartphones as devices for timely cardiorespiratory disease screening in the general population, in at-home settings, offering crucial assistance to public health efforts (especially during a pandemic outbreaks, such as the recent COVID-19).
Read more8/29/2024
0
MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals
Lei Yu, Jintao Fei, Xinyi Liu, Yang Yao, Jun Zhao, Guoxin Wang, Xin Li
Video-based physiology, exemplified by remote photoplethysmography (rPPG), extracts physiological signals such as pulse and respiration by analyzing subtle changes in video recordings. This non-contact, real-time monitoring method holds great potential for home settings. Despite the valuable contributions of public benchmark datasets to this technology, there is currently no dataset specifically designed for passive home monitoring. Existing datasets are often limited to close-up, static, frontal recordings and typically include only 1-2 physiological signals. To advance video-based physiology in real home settings, we introduce the MHAD dataset. It comprises 1,440 videos from 40 subjects, capturing 6 typical activities from 3 angles in a real home environment. Additionally, 5 physiological signals were recorded, making it a comprehensive video-based physiology dataset. MHAD is compatible with the rPPG-toolbox and has been validated using several unsupervised and supervised methods. Our dataset is publicly available at https://github.com/jdh-algo/MHAD-Dataset.
Read more9/17/2024
❗
0
Noncontact Respiratory Anomaly Detection Using Infrared Light-Wave Sensing
Md Zobaer Islam, Brenden Martin, Carly Gotcher, Tyler Martinez, John F. O'Hara, Sabit Ekin
Human respiratory rate and its pattern convey essential information about the physical and psychological states of the subject. Abnormal breathing can indicate fatal health issues leading to further diagnosis and treatment. Wireless light-wave sensing (LWS) using incoherent infrared light shows promise in safe, discreet, efficient, and non-invasive human breathing monitoring without raising privacy concerns. The respiration monitoring system needs to be trained on different types of breathing patterns to identify breathing anomalies.The system must also validate the collected data as a breathing waveform, discarding any faulty data caused by external interruption, user movement, or system malfunction. To address these needs, this study simulated normal and different types of abnormal respiration using a robot that mimics human breathing patterns. Then, time-series respiration data were collected using infrared light-wave sensing technology. Three machine learning algorithms, decision tree, random forest and XGBoost, were applied to detect breathing anomalies and faulty data. Model performances were evaluated through cross-validation, assessing classification accuracy, precision and recall scores. The random forest model achieved the highest classification accuracy of 96.75% with data collected at a 0.5m distance. In general, ensemble models like random forest and XGBoost performed better than a single model in classifying the data collected at multiple distances from the light-wave sensing setup.
Read more4/17/2024