Optimizing Emotion Recognition with Wearable Sensor Data: Unveiling Patterns in Body Movements and Heart Rate through Random Forest Hyperparameter Tuning

Read original: arXiv:2408.03958 - Published 8/14/2024 by Zikri Kholifah Nur, Rifki Wijaya, Gia Septiana Wulandari
Total Score

0

👁️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This research explores using smartwatch sensor data and heart rate monitoring to detect individual emotions based on body movement and heart rate.
  • Emotions play a crucial role in human well-being, influencing mental health, quality of life, and physical/physiological responses.
  • The study was conducted by analyzing data from a previous research project by Juan C. Quiroz, PhD.
  • 50 participants wore smartwatches and heart rate monitors while completing a 250-meter walk, with their emotional states induced through audio-visual and audio stimuli.
  • The study examined three scenarios: watching a movie before walking, listening to music before walking, and listening to music while walking.
  • Baseline models and various machine learning algorithms, including Logistic Regression and Random Forest, were used to assess the impact of these activities on emotion detection.
  • The Random Forest model was further improved through hyperparameter tuning, leading to significant accuracy enhancements.

Plain English Explanation

This research explores using data from smartwatches and heart rate monitors to detect people's emotions based on their body movements and heart rates. Emotions play a crucial role in our well-being, influencing our mental health, quality of life, and even our physical and physiological responses.

The researchers analyzed data from a previous study conducted by Juan C. Quiroz, PhD. In this new study, 50 participants wore smartwatches and heart rate monitors while taking a 250-meter walk. The researchers tried to make the participants feel different emotions by showing them movies or playing music before or during the walk.

The researchers then used several machine learning models, including Logistic Regression and Random Forest, to see how well they could detect the participants' emotions based on the data from the smartwatches and heart rate monitors. They found that the Random Forest model, when tuned with additional parameters, performed the best, correctly identifying happy vs. sad emotions 86.63% of the time and happy vs. neutral vs. sad emotions 76.33% of the time.

Technical Explanation

The study explored the use of smartwatch sensor data and heart rate monitoring to discern individual emotions based on body movement and heart rate. The researchers used data from a previous study conducted by Juan C. Quiroz, PhD, which involved 50 participants wearing smartwatches and heart rate monitors while completing a 250-meter walk.

To induce different emotional states, the participants were exposed to audio-visual and audio stimuli, with their emotional states evaluated using the PANAS questionnaire. The researchers examined three scenarios: viewing a movie before walking, listening to music before walking, and listening to music while walking.

Baseline models were established using DummyClassifier with the 'most_frequent' strategy from the sklearn library. Various machine learning models, including Logistic Regression and Random Forest, were then employed to assess the impact of these activities on emotion detection. A novel approach was undertaken by incorporating hyperparameter tuning to the Random Forest model using RandomizedSearchCV.

The results showed significant improvements in the Random Forest model's performance after hyperparameter tuning, yielding mean accuracies of 86.63% for happy vs. sad and 76.33% for happy vs. neutral vs. sad. This demonstrates the potential of using smartwatch and heart rate data for emotion detection.

Critical Analysis

The research paper presents a novel approach to emotion detection using smartwatch sensor data and heart rate monitoring. The inclusion of hyperparameter tuning for the Random Forest model is a notable contribution, as it led to substantial accuracy improvements.

However, the study does have some limitations. The sample size of 50 participants may be relatively small, and the researchers did not explore the potential impact of factors such as age, gender, or individual physiological differences on emotion detection. Additionally, the study only examined three specific scenarios, and it would be valuable to investigate a broader range of emotional stimuli and activities.

Further research could explore the generalizability of the findings to more diverse populations and settings, as well as the potential integration of this approach into real-world applications, such as mental health monitoring or personalized emotional support systems. Ongoing work in this area could also investigate the combination of physiological data with other modalities, such as facial expressions or speech patterns, to enhance the accuracy and robustness of emotion detection.

Conclusion

This research demonstrates the potential of using smartwatch sensor data and heart rate monitoring to discern individual emotions based on body movement and heart rate. By incorporating hyperparameter tuning to the Random Forest model, the researchers were able to achieve significant improvements in emotion detection accuracy, highlighting the value of this approach.

The findings of this study could have important implications for mental health monitoring, personalized emotional support, and other applications that rely on understanding human emotions. As the field of affective computing continues to advance, this research contributes to the growing body of knowledge on leveraging physiological data for emotion recognition and could inspire further exploration in this promising area.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

👁️

Total Score

0

Optimizing Emotion Recognition with Wearable Sensor Data: Unveiling Patterns in Body Movements and Heart Rate through Random Forest Hyperparameter Tuning

Zikri Kholifah Nur, Rifki Wijaya, Gia Septiana Wulandari

This research delves into the utilization of smartwatch sensor data and heart rate monitoring to discern individual emotions based on body movement and heart rate. Emotions play a pivotal role in human life, influencing mental well-being, quality of life, and even physical and physiological responses. The data were sourced from prior research by Juan C. Quiroz, PhD. The study enlisted 50 participants who donned smartwatches and heart rate monitors while completing a 250-meter walk. Emotions were induced through both audio-visual and audio stimuli, with participants' emotional states evaluated using the PANAS questionnaire. The study scrutinized three scenarios: viewing a movie before walking, listening to music before walking, and listening to music while walking. Personal baselines were established using DummyClassifier with the 'most_frequent' strategy from the sklearn library, and various models, including Logistic Regression and Random Forest, were employed to gauge the impacts of these activities. Notably, a novel approach was undertaken by incorporating hyperparameter tuning to the Random Forest model using RandomizedSearchCV. The outcomes showcased substantial enhancements with hyperparameter tuning in the Random Forest model, yielding mean accuracies of 86.63% for happy vs. sad and 76.33% for happy vs. neutral vs. sad.

Read more

8/14/2024

SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches
Total Score

0

SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches

Kushan Choksi, Hongkai Chen, Karan Joshi, Sukrutha Jade, Shahriar Nirjon, Shan Lin

Recent research has demonstrated the capability of physiological signals to infer both user emotional and attention responses. This presents an opportunity for leveraging widely available physiological sensors in smartwatches, to detect real-time emotional cues in users, such as stress and excitement. In this paper, we introduce SensEmo, a smartwatch-based system designed for affective learning. SensEmo utilizes multiple physiological sensor data, including heart rate and galvanic skin response, to recognize a student's motivation and concentration levels during class. This recognition is facilitated by a personalized emotion recognition model that predicts emotional states based on degrees of valence and arousal. With real-time emotion and attention feedback from students, we design a Markov decision process-based algorithm to enhance student learning effectiveness and experience by by offering suggestions to the teacher regarding teaching content and pacing. We evaluate SensEmo with 22 participants in real-world classroom environments. Evaluation results show that SensEmo recognizes student emotion with an average of 88.9% accuracy. More importantly, SensEmo assists students to achieve better online learning outcomes, e.g., an average of 40.0% higher grades in quizzes, over the traditional learning without student emotional feedback.

Read more

7/16/2024

Chaos in Motion: Unveiling Robustness in Remote Heart Rate Measurement through Brain-Inspired Skin Tracking
Total Score

0

Chaos in Motion: Unveiling Robustness in Remote Heart Rate Measurement through Brain-Inspired Skin Tracking

Jie Wang, Jing Lian, Minjie Ma, Junqiang Lei, Chunbiao Li, Bin Li, Jizhao Liu

Heart rate is an important physiological indicator of human health status. Existing remote heart rate measurement methods typically involve facial detection followed by signal extraction from the region of interest (ROI). These SOTA methods have three serious problems: (a) inaccuracies even failures in detection caused by environmental influences or subject movement; (b) failures for special patients such as infants and burn victims; (c) privacy leakage issues resulting from collecting face video. To address these issues, we regard the remote heart rate measurement as the process of analyzing the spatiotemporal characteristics of the optical flow signal in the video. We apply chaos theory to computer vision tasks for the first time, thus designing a brain-inspired framework. Firstly, using an artificial primary visual cortex model to extract the skin in the videos, and then calculate heart rate by time-frequency analysis on all pixels. Our method achieves Robust Skin Tracking for Heart Rate measurement, called HR-RST. The experimental results show that HR-RST overcomes the difficulty of environmental influences and effectively tracks the subject movement. Moreover, the method could extend to other body parts. Consequently, the method can be applied to special patients and effectively protect individual privacy, offering an innovative solution.

Read more

4/12/2024

Emotion Detection through Body Gesture and Face
Total Score

0

Emotion Detection through Body Gesture and Face

Haoyang Liu

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems mainly rely on facial expression analysis and often ignore the rich emotional information conveyed through body language. To bridge this gap, this method leverages the Aff-Wild2 and DFEW databases to train and evaluate a model capable of recognizing seven basic emotions (angry, disgust, fear, happiness, sadness, surprise, and neutral) and estimating valence and continuous scales wakeup descriptor. Leverage OpenPose for pose estimation to extract detailed body posture and posture features from images and videos. These features serve as input to state-of-the-art neural network architectures, including ResNet, and ANN for emotion classification, and fully connected layers for valence arousal regression analysis. This bifurcation strategy can solve classification and regression problems in the field of emotion recognition. The project aims to contribute to the field of affective computing by enhancing the ability of machines to interpret and respond to human emotions in a more comprehensive and nuanced way. By integrating multimodal data and cutting-edge computational models, I aspire to develop a system that not only enriches human-computer interaction but also has potential applications in areas as diverse as mental health support, educational technology, and autonomous vehicle systems.

Read more

7/16/2024