Recurrent and Convolutional Neural Networks in Classification of EEG Signal for Guided Imagery and Mental Workload Detection
2405.16901
0
0
Abstract
The Guided Imagery technique is reported to be used by therapists all over the world in order to increase the comfort of patients suffering from a variety of disorders from mental to oncology ones and proved to be successful in numerous of ways. Possible support for the therapists can be estimation of the time at which subject goes into deep relaxation. This paper presents the results of the investigations of a cohort of 26 students exposed to Guided Imagery relaxation technique and mental task workloads conducted with the use of dense array electroencephalographic amplifier. The research reported herein aimed at verification whether it is possible to detect differences between those two states and to classify them using deep learning methods and recurrent neural networks such as EEGNet, Long Short-Term Memory-based classifier, 1D Convolutional Neural Network and hybrid model of 1D Convolutional Neural Network and Long Short-Term Memory. The data processing pipeline was presented from the data acquisition, through the initial data cleaning, preprocessing and postprocessing. The classification was based on two datasets: one of them using 26 so-called cognitive electrodes and the other one using signal collected from 256 channels. So far there have not been such comparisons in the application being discussed. The classification results are presented by the validation metrics such as: accuracy, recall, precision, F1-score and loss for each case. It turned out that it is not necessary to collect signals from all electrodes as classification of the cognitive ones gives the results similar to those obtained for the full signal and extending input to 256 channels does not add much value. In Disscussion there were proposed an optimal classifier as well as some suggestions concerning the prospective development of the project.
Create account to get full access
Overview
- This paper investigates the use of recurrent and convolutional neural networks to classify EEG (electroencephalogram) signals for two tasks: guided imagery and mental workload detection.
- EEG signals provide insights into brain activity, which can be used to assess cognitive states like mental workload and imagery.
- The researchers aimed to develop accurate models for these EEG-based classification tasks, which have applications in areas like brain-computer interfaces and cognitive monitoring.
Plain English Explanation
The paper focuses on using advanced machine learning techniques, specifically recurrent and convolutional neural networks, to analyze EEG data. EEG recordings measure the electrical activity in the brain and can provide information about what a person is thinking or experiencing.
The researchers were interested in two specific applications of this EEG analysis:
-
Guided Imagery: This refers to the ability to recognize when a person is engaged in visualizing or imagining something, based on their brain activity. This could be useful for applications like video game controls or assistive technologies.
-
Mental Workload Detection: This involves detecting the level of mental effort or concentration a person is exerting, also based on their EEG signals. This could be valuable for monitoring worker productivity, managing fatigue, or optimizing task difficulty.
By using advanced neural network models, the researchers aimed to build systems that can accurately classify these different mental states from the EEG data. This could lead to new technologies that can better understand and respond to a person's cognitive state in real-time.
Technical Explanation
The researchers constructed several different neural network architectures to tackle the EEG classification tasks. These included recurrent neural networks like LSTMs, as well as convolutional neural networks that could extract relevant features from the raw EEG signals.
They evaluated these models on two datasets - one for guided imagery and one for mental workload. The guided imagery dataset involved participants performing various visualization tasks, while the mental workload dataset had participants completing cognitively demanding exercises.
The neural networks were trained to predict the mental state (imagery vs. non-imagery, high vs. low workload) from the EEG data. The researchers compared the performance of their models to more traditional machine learning approaches, and also explored the use of transfer learning to leverage knowledge from one task for the other.
Critical Analysis
The paper provides a thorough exploration of using advanced deep learning techniques for EEG-based mental state classification. The researchers carefully designed their experiments and evaluated multiple model architectures to understand their relative strengths and weaknesses.
However, the paper does acknowledge some limitations. The datasets used were relatively small, which may constrain the models' ability to generalize. There is also the question of how well these laboratory-based findings would translate to real-world applications, where EEG signals may be noisier and the mental states more complex.
Additionally, the paper does not delve into the interpretability of the trained models - it's unclear what specific EEG features or brain regions the networks are utilizing to make their predictions. Further research could explore this to provide more insights into the neurophysiological underpinnings of the observed mental states.
Conclusion
This paper demonstrates the potential of advanced deep learning techniques, like recurrent and convolutional neural networks, to accurately classify EEG signals for cognitive tasks like guided imagery and mental workload detection. The findings suggest these models could enable new applications in brain-computer interfaces, cognitive monitoring, and adaptive systems that respond to a user's mental state.
While the research is promising, further work is needed to address the limitations and better understand the inner workings of the neural networks. Nonetheless, this study contributes valuable insights into the use of deep learning for EEG-based mental state recognition, which could have significant implications for the field of neural engineering and human-computer interaction.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
EEG classification for visual brain decoding with spatio-temporal and transformer based paradigms
Akanksha Sharma, Jyoti Nigam, Abhishek Rathore, Arnav Bhavsar
0
0
In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is based on a CNN-BiLSTM model. The other involves a CNN-Transformer architecture which inherently involves the more versatile attention based learning paradigm. In both cases, a special 1D-CNN feature extraction module is used to generate the initial embeddings with 1D convolutions in the time and the EEG channel domains. Considering the EEG signals are noisy, non stationary and the discriminative features are even less clear (than in semantically structured data such as text or image), we also follow a window-based classification followed by majority voting during inference, to yield labels at a signal level. To illustrate how brain patterns correlate with different image classes, we visualize t-SNE plots of the BiLSTM embeddings alongside brain activation maps for the top 10 classes. These visualizations provide insightful revelations into the distinct neural signatures associated with each visual category, showcasing the BiLSTM's capability to capture and represent the discriminative brain activity linked to visual stimuli. We demonstrate the performance of our approach on the updated EEG-Imagenet dataset with positive comparisons with state-of-the-art methods.
6/12/2024
EEG_RL-Net: Enhancing EEG MI Classification through Reinforcement Learning-Optimised Graph Neural Networks
Htoo Wai Aung, Jiao Jiao Li, Yang An, Steven W. Su
0
0
Brain-Computer Interfaces (BCIs) rely on accurately decoding electroencephalography (EEG) motor imagery (MI) signals for effective device control. Graph Neural Networks (GNNs) outperform Convolutional Neural Networks (CNNs) in this regard, by leveraging the spatial relationships between EEG electrodes through adjacency matrices. The EEG_GLT-Net framework, featuring the state-of-the-art EEG_GLT adjacency matrix method, has notably enhanced EEG MI signal classification, evidenced by an average accuracy of 83.95% across 20 subjects on the PhysioNet dataset. This significantly exceeds the 76.10% accuracy rate achieved using the Pearson Correlation Coefficient (PCC) method within the same framework. In this research, we advance the field by applying a Reinforcement Learning (RL) approach to the classification of EEG MI signals. Our innovative method empowers the RL agent, enabling not only the classification of EEG MI data points with higher accuracy, but effective identification of EEG MI data points that are less distinct. We present the EEG_RL-Net, an enhancement of the EEG_GLT-Net framework, which incorporates the trained EEG GCN Block from EEG_GLT-Net at an adjacency matrix density of 13.39% alongside the RL-centric Dueling Deep Q Network (Dueling DQN) block. The EEG_RL-Net model showcases exceptional classification performance, achieving an unprecedented average accuracy of 96.40% across 20 subjects within 25 milliseconds. This model illustrates the transformative effect of the RL in EEG MI time point classification.
5/3/2024
🌐
Bayesian Functional Connectivity and Graph Convolutional Network for Working Memory Load Classification
Harshini Gangapuram, Vidya Manian
0
0
Brain responses related to working memory originate from distinct brain areas and oscillate at different frequencies. EEG signals with high temporal correlation can effectively capture these responses. Therefore, estimating the functional connectivity of EEG for working memory protocols in different frequency bands plays a significant role in analyzing the brain dynamics with increasing memory and cognitive loads, which remains largely unexplored. The present study introduces a Bayesian structure learning algorithm to learn the functional connectivity of EEG in sensor space. Next, the functional connectivity graphs are taken as input to the graph convolutional network to classify the working memory loads. The intrasubject (subject-specific) classification performed on 154 subjects for six different verbal working memory loads produced the highest classification accuracy of 96% and average classification accuracy of 89%, outperforming state-of-the-art classification models proposed in the literature. Furthermore, the proposed Bayesian structure learning algorithm is compared with state-of-the-art functional connectivity estimation methods through intersubject and intrasubject statistical analysis of variance. The results also show that the alpha and theta bands have better classification accuracy than the beta band.
5/1/2024
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion
Dongyang Li, Chen Wei, Shiying Li, Jiachen Zou, Quanying Liu
0
0
How to decode human vision through neural signals has attracted a long-standing interest in neuroscience and machine learning. Modern contrastive learning and generative models improved the performance of fMRI-based visual decoding and reconstruction. However, the high cost and low temporal resolution of fMRI limit their applications in brain-computer interfaces (BCIs), prompting a high need for EEG-based visual reconstruction. In this study, we present an EEG-based visual reconstruction framework. It consists of a plug-and-play EEG encoder called the Adaptive Thinking Mapper (ATM), which is aligned with image embeddings, and a two-stage EEG guidance image generator that first transforms EEG features into image priors and then reconstructs the visual stimuli with a pre-trained image generator. Our approach allows EEG embeddings to achieve superior performance in image classification and retrieval tasks. Our two-stage image generation strategy vividly reconstructs images seen by humans. Furthermore, we analyzed the impact of signals from different time windows and brain regions on decoding and reconstruction. The versatility of our framework is demonstrated in the magnetoencephalogram (MEG) data modality. We report that EEG-based visual decoding achieves SOTA performance, highlighting the portability, low cost, and high temporal resolution of EEG, enabling a wide range of BCI applications. The code of ATM is available at https://github.com/dongyangli-del/EEG_Image_decode.
4/8/2024