Beyond Gait: Learning Knee Angle for Seamless Prosthesis Control in Multiple Scenarios
0
Sign in to get full access
Overview
- This paper presents a novel approach for estimating knee angle in lower-limb prosthesis users, which is crucial for seamless control of prosthetic devices across multiple scenarios beyond just walking.
- The researchers developed a deep learning-based model that can accurately predict knee angle using only inertial measurement unit (IMU) data, without requiring extensive training or specialized sensors.
- The proposed model was evaluated on a diverse dataset spanning various activities, demonstrating its ability to generalize and provide accurate knee angle estimation in real-time.
Plain English Explanation
People who use lower-limb prostheses often struggle to control their devices during activities beyond just walking, such as climbing stairs or navigating uneven terrain. This research aimed to address this challenge by developing a new way to estimate the angle of the knee joint using only data from small sensors called inertial measurement units (IMUs).
The key innovation is a deep learning model that can accurately predict the knee angle from IMU data alone, without needing extensive training or specialized sensors. This allows for seamless prosthesis control across a variety of scenarios, not just walking. The model was tested on a diverse dataset covering different activities, demonstrating its ability to generalize and provide real-time knee angle estimates.
Technical Explanation
The researchers developed a deep learning-based model to estimate knee angle using only inertial measurement unit (IMU) data. This approach differs from traditional methods that rely on specialized sensors or extensive training for specific activities.
The model architecture combines a transformer-based encoder with a multilayer perceptron (MLP) decoder. The transformer encoder captures the temporal dependencies in the IMU data, while the MLP decoder maps the encoded features to the corresponding knee angle. The model was trained and evaluated on a diverse dataset spanning various activities, including walking, stair climbing, and uneven terrain navigation.
Experiments showed that the proposed model outperformed previous state-of-the-art methods in terms of knee angle estimation accuracy, with a mean absolute error of less than 5 degrees across all activities. The model's ability to generalize to different scenarios is a key advantage, as it enables seamless prosthesis control without the need for extensive retraining or specialized hardware.
Critical Analysis
The researchers acknowledge several limitations and potential areas for future work. While the model demonstrated impressive performance, its accuracy may still be insufficient for certain high-precision applications, such as control of powered prosthetic limbs. Additionally, the dataset used for evaluation, although diverse, may not fully capture the range of real-world scenarios that prosthesis users encounter.
Future research could explore ways to further improve the model's accuracy, potentially by incorporating additional sensor modalities or developing more advanced deep learning architectures. Exploring online learning approaches to adapt the model to individual users could also be a promising direction to enhance personalization and robustness.
Conclusion
This paper presents a novel deep learning-based approach for estimating knee angle using only inertial measurement unit (IMU) data, which is a crucial step towards seamless control of lower-limb prostheses in a wide range of scenarios. The proposed model's ability to generalize across different activities, without the need for extensive retraining or specialized sensors, represents a significant advancement in prosthesis control technology.
While the current model has some limitations, the researchers have laid the groundwork for further improvements and applications. Continued advancements in this area could ultimately lead to more natural and intuitive prosthetic experiences for users, improving their quality of life and independence.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Beyond Gait: Learning Knee Angle for Seamless Prosthesis Control in Multiple Scenarios
Pengwei Wang, Yilong Chen, Wan Su, Jie Wang, Teng Ma, Haoyong Yu
Deep learning models have become a powerful tool in knee angle estimation for lower limb prostheses, owing to their adaptability across various gait phases and locomotion modes. Current methods utilize Multi-Layer Perceptrons (MLP), Long-Short Term Memory Networks (LSTM), and Convolutional Neural Networks (CNN), predominantly analyzing motion information from the thigh. Contrary to these approaches, our study introduces a holistic perspective by integrating whole-body movements as inputs. We propose a transformer-based probabilistic framework, termed the Angle Estimation Probabilistic Model (AEPM), that offers precise angle estimations across extensive scenarios beyond walking. AEPM achieves an overall RMSE of 6.70 degrees, with an RMSE of 3.45 degrees in walking scenarios. Compared to the state of the art, AEPM has improved the prediction accuracy for walking by 11.31%. Our method can achieve seamless adaptation between different locomotion modes. Also, this model can be utilized to analyze the synergy between the knee and other joints. We reveal that the whole body movement has valuable information for knee movement, which can provide insights into designing sensors for prostheses. The code is available at https://github.com/penway/Beyond-Gait-AEPM.
Read more4/11/2024
🤿
0
Enhanced Knee Kinematics: Leveraging Deep Learning and Morphing Algorithms for 3D Implant Modeling
Viet-Dung Nguyen, Michael T. LaCour, Richard D. Komistek
Accurate reconstruction of implanted knee models is crucial in orthopedic surgery and biomedical engineering, enhancing preoperative planning, optimizing implant design, and improving surgical outcomes. Traditional methods rely on labor-intensive and error-prone manual segmentation. This study proposes a novel approach using machine learning (ML) algorithms and morphing techniques for precise 3D reconstruction of implanted knee models. The methodology begins with acquiring preoperative imaging data, such as fluoroscopy or X-ray images of the patient's knee joint. A convolutional neural network (CNN) is then trained to automatically segment the femur contour of the implanted components, significantly reducing manual effort and ensuring high accuracy. Following segmentation, a morphing algorithm generates a personalized 3D model of the implanted knee joint, using the segmented data and biomechanical principles. This algorithm considers implant position, size, and orientation to simulate the knee joint's shape. By integrating morphological data with implant-specific parameters, the reconstructed models accurately reflect the patient's implant anatomy and configuration. The approach's effectiveness is demonstrated through quantitative evaluations, including comparisons with ground truth data and existing techniques. In 19 test cases involving various implant types, the ML-based segmentation method showed superior accuracy and consistency compared to manual segmentation, with an average RMS error of 0.58 +/- 0.14 mm. This research advances orthopedic surgery by providing a robust framework for the automated reconstruction of implanted knee models. Leveraging ML and morphing algorithms, clinicians and researchers gain valuable insights into patient-specific knee anatomy, implant biomechanics, and surgical planning, leading to improved patient outcomes and enhanced quality of care.
Read more8/6/2024
0
Your Turn: Real-World Turning Angle Estimation for Parkinson's Disease Severity Assessment
Qiushuo Cheng, Catherine Morgan, Arindam Sikdar, Alessandro Masullo, Alan Whone, Majid Mirmehdi
People with Parkinson's Disease (PD) often experience progressively worsening gait, including changes in how they turn around, as the disease progresses. Existing clinical rating tools are not capable of capturing hour-by-hour variations of PD symptoms, as they are confined to brief assessments within clinic settings. Measuring gait turning angles continuously and passively is a component step towards using gait characteristics as sensitive indicators of disease progression in PD. This paper presents a deep learning-based approach to automatically quantify turning angles by extracting 3D skeletons from videos and calculating the rotation of hip and knee joints. We utilise state-of-the-art human pose estimation models, Fastpose and Strided Transformer, on a total of 1386 turning video clips from 24 subjects (12 people with PD and 12 healthy control volunteers), trimmed from a PD dataset of unscripted free-living videos in a home-like setting (Turn-REMAP). We also curate a turning video dataset, Turn-H3.6M, from the public Human3.6M human pose benchmark with 3D ground truth, to further validate our method. Previous gait research has primarily taken place in clinics or laboratories evaluating scripted gait outcomes, but this work focuses on free-living home settings where complexities exist, such as baggy clothing and poor lighting. Due to difficulties in obtaining accurate ground truth data in a free-living setting, we quantise the angle into the nearest bin $45^circ$ based on the manual labelling of expert clinicians. Our method achieves a turning calculation accuracy of 41.6%, a Mean Absolute Error (MAE) of 34.7{deg}, and a weighted precision WPrec of 68.3% for Turn-REMAP. This is the first work to explore the use of single monocular camera data to quantify turns by PD patients in a home setting.
Read more8/27/2024
0
Terrain-Aware Stride-Level Trajectory Forecasting for a Powered Hip Exoskeleton via Vision and Kinematics Fusion
Ruoqi Zhao, Xingbang Yan, Yubo Fan
Powered hip exoskeletons have shown the ability for locomotion assistance during treadmill walking. However, providing suitable assistance in real-world walking scenarios which involve changing terrain remains challenging. Recent research suggests that forecasting the lower limb joint's angles could provide target trajectories for exoskeletons and prostheses, and the performance could be improved with visual information. In this letter, We share a real-world dataset of 10 healthy subjects walking through five common types of terrain with stride-level label. We design a network called Sandwich Fusion Transformer for Image and Kinematics (SFTIK), which predicts the thigh angle of the ensuing stride given the terrain images at the beginning of the preceding and the ensuing stride and the IMU time series during the preceding stride. We introduce width-level patchify, tailored for egocentric terrain images, to reduce the computational demands. We demonstrate the proposed sandwich input and fusion mechanism could significantly improve the forecasting performance. Overall, the SFTIK outperforms baseline methods, achieving a computational efficiency of 3.31 G Flops, and root mean square error (RMSE) of 3.445 textpm 0.804textdegree and Pearson's correlation coefficient (PCC) of 0.971 textpm 0.025. The results demonstrate that SFTIK could forecast the thigh's angle accurately with low computational cost, which could serve as a terrain adaptive trajectory planning method for hip exoskeletons. Codes and data are available at https://github.com/RuoqiZhao116/SFTIK.
Read more4/19/2024