Depth-Weighted Detection of Behaviours of Risk in People with Dementia using Cameras

Read original: arXiv:2408.15519 - Published 8/29/2024 by Pratik K. Mishra, Irene Ballester, Andrea Iaboni, Bing Ye, Kristine Newman, Alex Mihailidis, Shehroz S. Khan
Total Score

0

Depth-Weighted Detection of Behaviours of Risk in People with Dementia using Cameras

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a system for detecting behaviors of risk in people with dementia using depth cameras.
  • The approach uses depth information to improve the detection accuracy of risky behaviors compared to using RGB cameras alone.
  • The system aims to provide early warning of potentially dangerous situations to caregivers, improving safety for people with dementia.

Plain English Explanation

The researchers developed a technology to monitor people with dementia and detect behaviors that could put them at risk of harm. They used special cameras that can measure the depth or distance of objects in a room, in addition to capturing regular color images.

By incorporating this depth information, the system could more accurately identify risky behaviors, like someone losing their balance or wandering too close to a dangerous area. This allows the technology to alert caregivers when someone with dementia might be in a potentially unsafe situation, so they can intervene and prevent accidents or injuries.

The goal is to use this depth-enhanced monitoring system to improve the safety and well-being of people living with dementia, by providing an early warning system to their caregivers. This could help people with dementia maintain their independence and quality of life for longer, while also giving their caregivers more peace of mind.

Technical Explanation

The paper describes a depth-based behavior detection system for monitoring people with dementia. The approach uses RGB-D (color and depth) cameras to capture both visual and depth information about a person's movements and actions.

The system employs deep learning models trained to detect behaviors that could indicate a risk of falls, wandering, or other dangerous situations for people with dementia. By incorporating the depth data, the models can more accurately distinguish risky behaviors from normal, safe activities.

The researchers evaluated their depth-weighted approach against a baseline using only RGB cameras. The results showed the depth-enhanced system achieved significantly higher accuracy in detecting the targeted risk behaviors, demonstrating the value of leveraging both visual and depth information.

Critical Analysis

The paper provides a thorough technical explanation of the depth-weighted behavior detection system and presents promising results. However, the authors acknowledge several limitations and areas for future research.

One key limitation is the relatively small scale of the dataset used for training and evaluation, which was collected in a controlled lab environment. Further research is needed to assess the system's performance in real-world, uncontrolled settings with a more diverse population of people with dementia.

Additionally, the paper does not address potential privacy concerns related to the continuous monitoring of individuals with cameras, which could be a barrier to widespread adoption. Exploring techniques to protect the privacy of monitored individuals would be an important area for future work.

Finally, the paper does not discuss the integration of this system into a complete caregiving solution or its long-term impact on the quality of life and independence of people with dementia. Evaluating the practical benefits and user experience of such a system in an actual caregiving context would be a valuable next step.

Conclusion

This research presents a novel depth-weighted approach to detecting behaviors of risk in people with dementia using RGB-D cameras. By leveraging depth information in addition to visual data, the system can more accurately identify potentially dangerous situations, with the goal of providing early warnings to caregivers.

While the results are promising, further research is needed to validate the system's performance in real-world settings and address potential privacy concerns. Integrating this technology into a comprehensive caregiving solution and assessing its long-term impact on the lives of people with dementia and their caregivers would also be an important area for future work.

Overall, this research demonstrates the potential of depth-enhanced computer vision techniques to enhance the safety and independence of people living with dementia, which could have significant implications for improving their quality of life and supporting their caregivers.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Depth-Weighted Detection of Behaviours of Risk in People with Dementia using Cameras
Total Score

0

Depth-Weighted Detection of Behaviours of Risk in People with Dementia using Cameras

Pratik K. Mishra, Irene Ballester, Andrea Iaboni, Bing Ye, Kristine Newman, Alex Mihailidis, Shehroz S. Khan

The behavioural and psychological symptoms of dementia, such as agitation and aggression, present a significant health and safety risk in residential care settings. Many care facilities have video cameras in place for digital monitoring of public spaces, which can be leveraged to develop an automated behaviours of risk detection system that can alert the staff to enable timely intervention and prevent the situation from escalating. However, one of the challenges in our previous study was the presence of false alarms due to obstruction of view by activities happening close to the camera. To address this issue, we proposed a novel depth-weighted loss function to train a customized convolutional autoencoder to enforce equivalent importance to the events happening both near and far from the cameras; thus, helping to reduce false alarms and making the method more suitable for real-world deployment. The proposed method was trained using data from nine participants with dementia across three cameras situated in a specialized dementia unit and achieved an area under the curve of receiver operating characteristic of $0.852$, $0.81$ and $0.768$ for the three cameras. Ablation analysis was conducted for the individual components of the proposed method and the performance of the proposed method was investigated for participant-specific and sex-specific behaviours of risk detection. The proposed method performed reasonably well in detecting behaviours of risk in people with dementia motivating further research toward the development of a behaviours of risk detection system suitable for deployment in video surveillance systems in care facilities.

Read more

8/29/2024

🤖

Total Score

0

Gamified AI Approch for Early Detection of Dementia

Paramita Kundu Maji, Soubhik Acharya, Priti Paul, Sanjay Chakraborty, Saikat Basu

This paper aims to develop a new deep learning-inspired gaming approach for early detection of dementia. This research integrates a robust convolutional neural network (CNN)-based model for early dementia detection using health metrics data as well as facial image data through a cognitive assessment-based gaming application. We have collected 1000 data samples of health metrics dataset from Apollo Diagnostic Center Kolkata that is labeled as either demented or non-demented for the training of MOD-1D-CNN for the game level 1 and another dataset of facial images containing 1800 facial data that are labeled as either demented or non-demented is collected by our research team for the training of MOD-2D-CNN model in-game level 2. In our work, the loss for the proposed MOD-1D-CNN model is 0.2692 and the highest accuracy is 70.50% for identifying the dementia traits using real-life health metrics data. Similarly, the proposed MOD-2D-CNN model loss is 0.1755 and the highest accuracy is obtained here 95.72% for recognizing the dementia status using real-life face-based image data. Therefore, a rule-based weightage method is applied to combine both the proposed methods to achieve the final decision. The MOD-1D-CNN and MOD-2D-CNN models are more lightweight and computationally efficient alternatives because they have a significantly lower number of parameters when compared to the other state-of-the-art models. We have compared their accuracies and parameters with the other state-of-the-art deep learning models.

Read more

5/28/2024

🤿

Total Score

0

Deep Learning for Computer Vision based Activity Recognition and Fall Detection of the Elderly: a Systematic Review

F. Xavier Gaya-Morey, Cristina Manresa-Yee, Jose M. Buades-Rubio

As the percentage of elderly people in developed countries increases worldwide, the healthcare of this collective is a worrying matter, especially if it includes the preservation of their autonomy. In this direction, many studies are being published on Ambient Assisted Living (AAL) systems, which help to reduce the preoccupations raised by the independent living of the elderly. In this study, a systematic review of the literature is presented on fall detection and Human Activity Recognition (HAR) for the elderly, as the two main tasks to solve to guarantee the safety of elderly people living alone. To address the current tendency to perform these two tasks, the review focuses on the use of Deep Learning (DL) based approaches on computer vision data. In addition, different collections of data like DL models, datasets or hardware (e.g. depth or thermal cameras) are gathered from the reviewed studies and provided for reference in future studies. Strengths and weaknesses of existing approaches are also discussed and, based on them, our recommendations for future works are provided.

Read more

9/4/2024

Feasibility of assessing cognitive impairment via distributed camera network and privacy-preserving edge computing
Total Score

0

Feasibility of assessing cognitive impairment via distributed camera network and privacy-preserving edge computing

Chaitra Hegde, Yashar Kiarashi, Allan I Levey, Amy D Rodriguez, Hyeokhyen Kwon, Gari D Clifford

INTRODUCTION: Mild cognitive impairment (MCI) is characterized by a decline in cognitive functions beyond typical age and education-related expectations. Since, MCI has been linked to reduced social interactions and increased aimless movements, we aimed to automate the capture of these behaviors to enhance longitudinal monitoring. METHODS: Using a privacy-preserving distributed camera network, we collected movement and social interaction data from groups of individuals with MCI undergoing therapy within a 1700$m^2$ space. We developed movement and social interaction features, which were then used to train a series of machine learning algorithms to distinguish between higher and lower cognitive functioning MCI groups. RESULTS: A Wilcoxon rank-sum test revealed statistically significant differences between high and low-functioning cohorts in features such as linear path length, walking speed, change in direction while walking, entropy of velocity and direction change, and number of group formations in the indoor space. Despite lacking individual identifiers to associate with specific levels of MCI, a machine learning approach using the most significant features provided a 71% accuracy. DISCUSSION: We provide evidence to show that a privacy-preserving low-cost camera network using edge computing framework has the potential to distinguish between different levels of cognitive impairment from the movements and social interactions captured during group activities.

Read more

8/21/2024