Human Movement Forecasting with Loose Clothing

Read original: arXiv:2309.09237 - Published 4/15/2024 by Tianchen Shen, Irene Di Giulio, Matthew Howard
Total Score

0

🤷

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper investigates the performance of human motion prediction using clothing-attached sensors compared to body-attached sensors.
  • The results show that fabric-attached sensors can have better motion prediction performance than rigid-attached sensors.
  • Specifically, the fabric-attached sensor can improve the accuracy up to 40% and requires up to 80% less duration of the past trajectory to achieve high prediction accuracy (i.e., 95%) compared to the rigid-attached sensor.

Plain English Explanation

The paper looks at using sensors in clothing, known as electronic textile (e-textile) technology, to track and predict human movements. This is an alternative to attaching sensors directly to the body. The researchers found that the sensors in the clothing can actually do a better job of predicting future human movements compared to sensors attached to the body.

Specifically, the clothing-attached sensors were able to predict the person's movements with up to 40% higher accuracy compared to the body-attached sensors. Additionally, the clothing-attached sensors only needed to observe the person's movements for a much shorter period of time - up to 80% less time - to achieve a high level of prediction accuracy (95%).

This is a counterintuitive finding, as one might expect the sensors directly on the body to provide more accurate information about the person's movements. However, the loose fabric of the clothing appears to provide additional useful information that helps the prediction models work better.

This research could have important implications for areas like scene-aware human motion forecasting, reliable human pose forecasting, whole-body human motion forecasting, and remote perception analysis. By using clothing-attached sensors, these systems may be able to achieve better performance in predicting and understanding human movements.

Technical Explanation

The paper investigates the use of clothing-attached sensors, enabled by electronic textile (e-textile) technology, for human motion prediction and trajectory forecasting. This is motivated by recent findings that clothing-attached sensors can achieve higher activity recognition accuracy than body-attached sensors.

The researchers conducted experiments to compare the performance of human motion prediction using clothing-attached sensors versus body-attached sensors. They used statistical models learned from the movement of loose clothing to predict the motion patterns of the body, for both robotically simulated and real human behaviors.

Surprisingly, the results show that fabric-attached sensors can have better motion prediction performance than rigid-attached sensors. Specifically, the fabric-attached sensor can improve the accuracy up to 40% and requires up to 80% less duration of the past trajectory to achieve high prediction accuracy (i.e., 95%) compared to the rigid-attached sensor.

The researchers hypothesize that the loose fabric of the clothing provides additional useful information that helps the prediction models work better, despite the sensors being further from the body. This counterintuitive finding suggests that leveraging digital perceptual technologies for remote perception analysis can be a promising approach for robust human motion forecasting using e-textile sensors.

Critical Analysis

The paper presents a novel and counterintuitive finding that clothing-attached sensors can outperform body-attached sensors in human motion prediction. However, the research does have some limitations that should be considered.

First, the experiments were conducted in a relatively controlled setting, using either robotically simulated or real human behaviors. It's unclear how the performance would scale to more complex, real-world scenarios with more variability in human movements and environmental factors.

Additionally, the paper does not delve deeply into the underlying reasons for the improved performance of the clothing-attached sensors. While the authors hypothesize that the loose fabric provides additional useful information, more research is needed to fully understand the mechanisms at play.

Further research could also explore the generalizability of these findings to different types of human activities, clothing materials, and sensor technologies. Investigating the long-term reliability and robustness of the clothing-attached sensor approach would also be valuable.

Despite these limitations, the paper presents an intriguing and potentially impactful finding that challenges conventional assumptions about human motion tracking and prediction. The implications for applications like scene-aware human motion forecasting, whole-body human motion forecasting, and remote perception analysis are significant and warrant further exploration.

Conclusion

This paper presents a surprising finding that clothing-attached sensors can outperform body-attached sensors in human motion prediction and trajectory forecasting. The fabric-attached sensors were able to achieve up to 40% higher accuracy and required up to 80% less observation time to reach high prediction accuracy compared to rigid-attached sensors.

These results have important implications for the development of more effective and efficient human motion analysis systems, with potential applications in areas like scene-aware human motion forecasting, reliable human pose forecasting, and remote perception analysis. While the research has some limitations, it challenges conventional assumptions and opens up new avenues for further exploration in the field of human motion prediction and trajectory forecasting.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤷

Total Score

0

Human Movement Forecasting with Loose Clothing

Tianchen Shen, Irene Di Giulio, Matthew Howard

Human motion prediction and trajectory forecasting are essential in human motion analysis. Nowadays, sensors can be seamlessly integrated into clothing using cutting-edge electronic textile (e-textile) technology, allowing long-term recording of human movements outside the laboratory. Motivated by the recent findings that clothing-attached sensors can achieve higher activity recognition accuracy than body-attached sensors. This work investigates the performance of human motion prediction using clothing-attached sensors compared with body-attached sensors. It reports experiments in which statistical models learnt from the movement of loose clothing are used to predict motion patterns of the body of robotically simulated and real human behaviours. Counterintuitively, the results show that fabric-attached sensors can have better motion prediction performance than rigid-attached sensors. Specifically, The fabric-attached sensor can improve the accuracy up to 40% and requires up to 80% less duration of the past trajectory to achieve high prediction accuracy (i.e., 95%) compared to the rigid-attached sensor.

Read more

4/15/2024

Neural Garment Dynamics via Manifold-Aware Transformers
Total Score

0

Neural Garment Dynamics via Manifold-Aware Transformers

Peizhuo Li, Tuanfeng Y. Wang, Timur Levent Kesdogan, Duygu Ceylan, Olga Sorkine-Hornung

Data driven and learning based solutions for modeling dynamic garments have significantly advanced, especially in the context of digital humans. However, existing approaches often focus on modeling garments with respect to a fixed parametric human body model and are limited to garment geometries that were seen during training. In this work, we take a different approach and model the dynamics of a garment by exploiting its local interactions with the underlying human body. Specifically, as the body moves, we detect local garment-body collisions, which drive the deformation of the garment. At the core of our approach is a mesh-agnostic garment representation and a manifold-aware transformer network design, which together enable our method to generalize to unseen garment and body geometries. We evaluate our approach on a wide variety of garment types and motion sequences and provide competitive qualitative and quantitative results with respect to the state of the art.

Read more

7/9/2024

A Neural-Network-Based Approach for Loose-Fitting Clothing
Total Score

0

A Neural-Network-Based Approach for Loose-Fitting Clothing

Yongxu Jin, Dalton Omens, Zhenglin Geng, Joseph Teran, Abishek Kumar, Kenji Tashiro, Ronald Fedkiw

Since loose-fitting clothing contains dynamic modes that have proven to be difficult to predict via neural networks, we first illustrate how to coarsely approximate these modes with a real-time numerical algorithm specifically designed to mimic the most important ballistic features of a classical numerical simulation. Although there is some flexibility in the choice of the numerical algorithm used as a proxy for full simulation, it is essential that the stability and accuracy be independent from any time step restriction or similar requirements in order to facilitate real-time performance. In order to reduce the number of degrees of freedom that require approximations to their dynamics, we simulate rigid frames and use skinning to reconstruct a rough approximation to a desirable mesh; as one might expect, neural-network-based skinning seems to perform better than linear blend skinning in this scenario. Improved high frequency deformations are subsequently added to the skinned mesh via a quasistatic neural network (QNN). In contrast to recurrent neural networks that require a plethora of training data in order to adequately generalize to new examples, QNNs perform well with significantly less training data.

Read more

4/29/2024

A Graph-based Approach to Human Activity Recognition
Total Score

0

A Graph-based Approach to Human Activity Recognition

Thomas Peroutka, Ilir Murturi, Praveen Kumar Donta, Schahram Dustdar

Advanced wearable sensor devices have enabled the recording of vast amounts of movement data from individuals regarding their physical activities. This data offers valuable insights that enhance our understanding of how physical activities contribute to improved physical health and overall quality of life. Consequently, there is a growing need for efficient methods to extract significant insights from these rapidly expanding real-time datasets. This paper presents a methodology to efficiently extract substantial insights from these expanding datasets, focusing on professional sports but applicable to various human activities. By utilizing data from Inertial Measurement Units (IMU) and Global Navigation Satellite Systems (GNSS) receivers, athletic performance can be analyzed using directed graphs to encode knowledge of complex movements. Our approach is demonstrated on biathlon data and detects specific points of interest and complex movement sequences, facilitating the comparison and analysis of human physical performance.

Read more

8/20/2024