Efficient sEMG-based Cross-Subject Joint Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

Read original: arXiv:2404.07517 - Published 7/9/2024 by Xin Zhou, Chuang Lin, Can Wang, Xiaojiang Peng
Total Score

0

Efficient sEMG-based Cross-Subject Joint Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a hierarchical spiking attentional feature decomposition network for efficient cross-subject joint angle estimation from surface electromyography (sEMG) signals.
  • The method aims to improve the performance and generalization of sEMG-based joint angle prediction by incorporating attention mechanisms and spiking neural networks.
  • The proposed approach is evaluated on several benchmark datasets and demonstrates superior performance compared to existing techniques.

Plain English Explanation

The research in this paper is focused on using electrical signals from muscles, called surface electromyography (sEMG), to estimate the angles of human joints, such as the elbow or knee. This is an important task for applications like controlling robotic prosthetic limbs or monitoring physical rehabilitation.

The key innovation in this work is the use of a hierarchical spiking attentional feature decomposition network. This means the system has multiple layers that can focus on the most relevant parts of the sEMG signals to better predict the joint angles. It also uses a type of neural network inspired by how neurons in the brain communicate using electrical spikes.

The researchers tested their method on several datasets and found it outperformed other approaches for estimating joint angles from sEMG data, even when the system was tested on people it hadn't seen before. This suggests the method can generalize well and be applied to new users.

Technical Explanation

The paper proposes a hierarchical spiking attentional feature decomposition network for efficient cross-subject joint angle estimation from sEMG signals. The key components of the method include:

  1. Spiking Neural Network: The model uses a spiking neural network architecture, which is inspired by the way neurons in the brain communicate using electrical impulses. This can provide advantages in terms of computational efficiency and capturing temporal dynamics in the sEMG data.

  2. Attention Mechanism: The network incorporates an attention module that allows the model to focus on the most relevant features in the sEMG signals for predicting joint angles. This can improve the model's performance and generalization.

  3. Hierarchical Feature Decomposition: The network has a hierarchical structure that decomposes the sEMG features into multiple levels of abstraction. This can capture both local and global patterns in the data, further enhancing the model's ability to estimate joint angles accurately.

The proposed method is evaluated on several benchmark datasets, including those from Alzheimer's disease detection using PSG signals, StepNet for spatial-temporal part-aware gait analysis, and beyond gait for learning knee angle from seamless prosthesis. The results demonstrate the superiority of the proposed approach compared to existing techniques for cross-subject joint angle estimation from sEMG signals.

Critical Analysis

The paper presents a well-designed and comprehensive study on using spiking neural networks and attention mechanisms for efficient cross-subject joint angle estimation from sEMG data. The hierarchical feature decomposition approach and the evaluation on multiple benchmark datasets are particular strengths of the research.

However, the paper does not address some potential limitations and avenues for further research. For example, the performance of the method on real-world, noisy sEMG signals from everyday activities is not explored. Additionally, the interpretability and explainability of the attention mechanism could be further investigated to gain insights into the key factors influencing the joint angle predictions.

Leveraging digital perceptual technologies for remote perception analysis could also provide valuable context for expanding the applications of the proposed approach beyond laboratory settings.

Conclusion

This paper introduces an efficient sEMG-based cross-subject joint angle estimation method using a hierarchical spiking attentional feature decomposition network. The proposed approach demonstrates superior performance compared to existing techniques, suggesting it could be a valuable tool for applications such as robotic prosthetics, physical rehabilitation, and human-machine interaction. The innovative use of spiking neural networks and attention mechanisms highlights the potential of these techniques for enhancing the accuracy and generalization of sEMG-based joint angle prediction.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Efficient sEMG-based Cross-Subject Joint Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network
Total Score

0

Efficient sEMG-based Cross-Subject Joint Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

Xin Zhou, Chuang Lin, Can Wang, Xiaojiang Peng

As human-machine interaction systems are developing towards lightweight and pervasive direction, the role of simultaneous and proportional control (SPC) in human-machine interaction becomes increasingly prominent. However, existing continuous joint angle prediction algorithms based on surface electromyography (sEMG) typically incur high inference costs or are only applicable to specific subjects rather than cross-subject scenarios. Therefore, we proposed a hierarchical Spiking Attentional FEature decomposition Network (SAFE-Net) in order to reduce inference costs and improve recognition accuracy in cross-subject scenarios. This network first encodes the sEMG signals into neural spiking forms through a Spiking Sparse Attention Encoder (SSAE). The compressed features are then decomposed into kinematic features and biological features by a Spiking Attentional Feature Decomposition (SAFD) module. Finally, the kinematic features and biological features are decoded into joint angle values and subject identity, respectively. We validated the effectiveness of SAFE-Net on two datasets (SIAT-DB1 and SIAT-DB2) and compared it with two state-of-the-art methods, Informer and Spikformer. Experimental results demonstrate that, on the one hand, SSAE saves 39.1% and 37.5% power consumption respectively over them in terms of inference costs. On the other hand, SAFE-Net outperforms Informer and Spikformer in recognition accuracy on both datasets. This study showcased that the proposed SAFE-Net can provide accurate predictions in cross-subject scenarios, offering a promising vision for precise continuous control of lower limb rehabilitation exoskeleton robots.

Read more

7/9/2024

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network
Total Score

0

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

Weiyu Guo, Ying Sun, Yijie Xu, Ziyue Qiao, Yongkui Yang, Hui Xiong

Surface electromyography (sEMG) based gesture recognition offers a natural and intuitive interaction modality for wearable devices. Despite significant advancements in sEMG-based gesture-recognition models, existing methods often suffer from high computational latency and increased energy consumption. Additionally, the inherent instability of sEMG signals, combined with their sensitivity to distribution shifts in real-world settings, compromises model robustness. To tackle these challenges, we propose a novel SpGesture framework based on Spiking Neural Networks, which possesses several unique merits compared with existing methods: (1) Robustness: By utilizing membrane potential as a memory list, we pioneer the introduction of Source-Free Domain Adaptation into SNN for the first time. This enables SpGesture to mitigate the accuracy degradation caused by distribution shifts. (2) High Accuracy: With a novel Spiking Jaccard Attention, SpGesture enhances the SNNs' ability to represent sEMG features, leading to a notable rise in system accuracy. To validate SpGesture's performance, we collected a new sEMG gesture dataset which has different forearm postures, where SpGesture achieved the highest accuracy among the baselines ($89.26%$). Moreover, the actual deployment on the CPU demonstrated a system latency below 100ms, well within real-time requirements. This impressive performance showcases SpGesture's potential to enhance the applicability of sEMG in real-world scenarios. The code is available at https://anonymous.4open.science/r/SpGesture.

Read more

5/24/2024

🧠

Total Score

0

A Non-Intrusive Neural Quality Assessment Model for Surface Electromyography Signals

Cho-Yuan Lee, Kuan-Chen Wang, Kai-Chun Liu, Yu-Te Wang, Xugang Lu, Ping-Cheng Yeh, Yu Tsao

In practical scenarios involving the measurement of surface electromyography (sEMG) in muscles, particularly those areas near the heart, one of the primary sources of contamination is the presence of electrocardiogram (ECG) signals. To assess the quality of real-world sEMG data more effectively, this study proposes QASE-net, a new non-intrusive model that predicts the SNR of sEMG signals. QASE-net combines CNN-BLSTM with attention mechanisms and follows an end-to-end training strategy. Our experimental framework utilizes real-world sEMG and ECG data from two open-access databases, the Non-Invasive Adaptive Prosthetics Database and the MIT-BIH Normal Sinus Rhythm Database, respectively. The experimental results demonstrate the superiority of QASE-net over the previous assessment model, exhibiting significantly reduced prediction errors and notably higher linear correlations with the ground truth. These findings show the potential of QASE-net to substantially enhance the reliability and precision of sEMG quality assessment in practical applications.

Read more

6/14/2024

Geometric Neural Network based on Phase Space for BCI-EEG decoding
Total Score

0

Geometric Neural Network based on Phase Space for BCI-EEG decoding

Igor Carrara, Bruno Aristimunha, Marie-Constance Corsi, Raphael Y. de Camargo, Sylvain Chevallier, Th'eodore Papadopoulo

Objective: The integration of Deep Learning (DL) algorithms on brain signal analysis is still in its nascent stages compared to their success in fields like Computer Vision. This is particularly true for BCI, where the brain activity is decoded to control external devices without requiring muscle control. Electroencephalography (EEG) is a widely adopted choice for designing BCI systems due to its non-invasive and cost-effective nature and excellent temporal resolution. Still, it comes at the expense of limited training data, poor signal-to-noise, and a large variability across and within-subject recordings. Finally, setting up a BCI system with many electrodes takes a long time, hindering the widespread adoption of reliable DL architectures in BCIs outside research laboratories. To improve adoption, we need to improve user comfort using, for instance, reliable algorithms that operate with few electrodes. Approach: Our research aims to develop a DL algorithm that delivers effective results with a limited number of electrodes. Taking advantage of the Augmented Covariance Method and the framework of SPDNet, we propose the Phase-SPDNet architecture and analyze its performance and the interpretability of the results. The evaluation is conducted on 5-fold cross-validation, using only three electrodes positioned above the Motor Cortex. The methodology was tested on nearly 100 subjects from several open-source datasets using the Mother Of All BCI Benchmark (MOABB) framework. Main results: The results of our Phase-SPDNet demonstrate that the augmented approach combined with the SPDNet significantly outperforms all the current state-of-the-art DL architecture in MI decoding. Significance: This new architecture is explainable and with a low number of trainable parameters.

Read more

8/29/2024