A Dataset for Multi-intensity Continuous Human Activity Recognition through Passive Sensing
0
Sign in to get full access
Overview
- This paper presents a new dataset for multi-intensity continuous human activity recognition using passive sensing.
- The dataset captures a wide range of human activities at varying intensities, enabling the development of more robust activity recognition models.
- The paper also provides a detailed analysis of the dataset and establishes benchmarks for evaluating activity recognition algorithms.
Plain English Explanation
The paper describes a new dataset that can be used to train machine learning models to recognize different human activities, such as walking, running, or cooking. What makes this dataset unique is that it captures these activities at varying levels of intensity or effort, rather than just a single intensity level.
This is important because real-life human activities can occur at different intensities, and a model trained on a dataset with a limited range of intensities may not perform well in the real world. By including a wide range of activity intensities, the researchers hope to develop activity recognition models that are more robust and can better handle the natural variability of human behavior.
The dataset also includes detailed annotations and metadata, which allow researchers to analyze the data in depth and develop benchmarks for evaluating the performance of their activity recognition algorithms.
Technical Explanation
The researchers collected data using a variety of passive sensors, such as accelerometers and gyroscopes, to capture a wide range of human activities at different intensity levels. The dataset includes over 150 hours of continuous sensor data from 50 participants performing 20 different activities, including walking, running, climbing stairs, and household tasks.
Each activity was performed at three different intensity levels: low, medium, and high. This allows models to be trained on the nuances of how an activity may change in execution as the intensity increases or decreases.
The researchers also provide detailed metadata and annotations for the dataset, including information about the participants, the sensor configurations, and the specific details of each recorded activity. This enables researchers to analyze the dataset in depth and develop robust benchmarks for evaluating activity recognition algorithms.
Critical Analysis
The dataset presented in this paper is a valuable contribution to the field of human activity recognition, as it addresses an important limitation of existing datasets that typically focus on a limited range of activity intensities.
However, the researchers acknowledge that the dataset is limited to a relatively small number of participants and may not fully capture the diversity of human behavior. Additionally, the use of passive sensors, while convenient, may not provide the same level of detailed information as more intrusive wearable devices.
Further research could explore the use of additional sensor modalities, such as video or audio, to provide a more comprehensive view of human activities. Additionally, studies on the transferability of models trained on this dataset to real-world scenarios would be valuable in assessing its practical utility.
Conclusion
The dataset presented in this paper represents an important step forward in the field of human activity recognition. By capturing a wide range of activities at varying intensity levels, it enables the development of more robust and versatile activity recognition models that can better handle the natural variability of human behavior. The detailed annotations and metadata provided with the dataset also facilitate in-depth analysis and the establishment of standardized benchmarks for evaluating activity recognition algorithms.
While the dataset has some limitations, it is a valuable resource that can contribute to the advancement of ambient sensing and human-computer interaction technologies, with potential applications in areas such as healthcare, smart homes, and fitness monitoring.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
A Dataset for Multi-intensity Continuous Human Activity Recognition through Passive Sensing
Argha Sen, Anirban Das, Swadhin Pradhan, Sandip Chakraborty
Human activity recognition (HAR) is essential in healthcare, elder care, security, and human-computer interaction. The use of precise sensor data to identify activities passively and continuously makes HAR accessible and ubiquitous. Specifically, millimeter wave (mmWave) radar is promising for passive and continuous HAR due to its ability to penetrate non-metallic materials and provide high-resolution wireless sensing. Although mmWave sensors are effective at capturing macro-scale activities, like exercising, they fail to capture micro-scale activities, such as typing. In this paper, we introduce mmDoppler, a novel dataset that utilizes off-the-shelf (COTS) mmWave radar in order to capture both macro and micro-scale human movements using a machine-learning driven signal processing pipeline. The dataset includes seven subjects performing 19 distinct activities and employs adaptive doppler resolution to enhance activity recognition. By adjusting the radar's doppler resolution based on the activity type, our system captures subtle movements more precisely. mmDoppler includes range-doppler heatmaps, offering detailed motion dynamics, with data collected in a controlled environment with single as well as multiple subjects performing activities simultaneously. The dataset aims to bridge the gap in HAR systems by providing a more comprehensive and detailed resource for improving the robustness and accuracy of mmWave radar activity recognition.
Read more8/1/2024
0
Millimeter Wave Radar-based Human Activity Recognition for Healthcare Monitoring Robot
Zhanzhong Gu, Xiangjian He, Gengfa Fang, Chengpei Xu, Feng Xia, Wenjing Jia
Healthcare monitoring is crucial, especially for the daily care of elderly individuals living alone. It can detect dangerous occurrences, such as falls, and provide timely alerts to save lives. Non-invasive millimeter wave (mmWave) radar-based healthcare monitoring systems using advanced human activity recognition (HAR) models have recently gained significant attention. However, they encounter challenges in handling sparse point clouds, achieving real-time continuous classification, and coping with limited monitoring ranges when statically mounted. To overcome these limitations, we propose RobHAR, a movable robot-mounted mmWave radar system with lightweight deep neural networks for real-time monitoring of human activities. Specifically, we first propose a sparse point cloud-based global embedding to learn the features of point clouds using the light-PointNet (LPN) backbone. Then, we learn the temporal pattern with a bidirectional lightweight LSTM model (BiLiLSTM). In addition, we implement a transition optimization strategy, integrating the Hidden Markov Model (HMM) with Connectionist Temporal Classification (CTC) to improve the accuracy and robustness of the continuous HAR. Our experiments on three datasets indicate that our method significantly outperforms the previous studies in both discrete and continuous HAR tasks. Finally, we deploy our system on a movable robot-mounted edge computing platform, achieving flexible healthcare monitoring in real-world scenarios.
Read more5/6/2024
0
New!A Comprehensive Methodological Survey of Human Activity Recognition Across Divers Data Modalities
Jungpil Shin, Najmul Hassan, Abu Saleh Musa Miah1, Satoshi Nishimura
Human Activity Recognition (HAR) systems aim to understand human behaviour and assign a label to each action, attracting significant attention in computer vision due to their wide range of applications. HAR can leverage various data modalities, such as RGB images and video, skeleton, depth, infrared, point cloud, event stream, audio, acceleration, and radar signals. Each modality provides unique and complementary information suited to different application scenarios. Consequently, numerous studies have investigated diverse approaches for HAR using these modalities. This paper presents a comprehensive survey of the latest advancements in HAR from 2014 to 2024, focusing on machine learning (ML) and deep learning (DL) approaches categorized by input data modalities. We review both single-modality and multi-modality techniques, highlighting fusion-based and co-learning frameworks. Additionally, we cover advancements in hand-crafted action features, methods for recognizing human-object interactions, and activity detection. Our survey includes a detailed dataset description for each modality and a summary of the latest HAR systems, offering comparative results on benchmark datasets. Finally, we provide insightful observations and propose effective future research directions in HAR.
Read more9/17/2024
👁️
0
Towards LLM-Powered Ambient Sensor Based Multi-Person Human Activity Recognition
Xi Chen (M-PSI), Julien Cumin (M-PSI), Fano Ramparany (M-PSI), Dominique Vaufreydaz (M-PSI)
Human Activity Recognition (HAR) is one of the central problems in fields such as healthcare, elderly care, and security at home. However, traditional HAR approaches face challenges including data scarcity, difficulties in model generalization, and the complexity of recognizing activities in multi-person scenarios. This paper proposes a system framework called LAHAR, based on large language models. Utilizing prompt engineering techniques, LAHAR addresses HAR in multi-person scenarios by enabling subject separation and action-level descriptions of events occurring in the environment. We validated our approach on the ARAS dataset, and the results demonstrate that LAHAR achieves comparable accuracy to the state-of-the-art method at higher resolutions and maintains robustness in multi-person scenarios.
Read more7/16/2024