A neuroergonomics model to evaluating nuclear power plants operators' performance under heat stress driven by ECG time-frequency spectrums and fNIRS prefrontal cortex network: a CNN-GAT fusion model

Read original: arXiv:2404.02439 - Published 4/4/2024 by Yan Zhang, Ming Jia, Meng Li, JianYu Wang, XiangMin Hu, ZhiHui Xu, Tao Chen
Total Score

0

A neuroergonomics model to evaluating nuclear power plants operators' performance under heat stress driven by ECG time-frequency spectrums and fNIRS prefrontal cortex network: a CNN-GAT fusion model

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper proposes a neuroergonomics model to evaluate the performance of nuclear power plant operators under heat stress conditions.
  • The model uses electrocardiogram (ECG) time-frequency spectrums and functional near-infrared spectroscopy (fNIRS) data from the prefrontal cortex to assess operator performance.
  • The model combines convolutional neural networks (CNNs) and graph attention networks (GATs) to analyze the physiological and neurological data.

Plain English Explanation

The researchers wanted to understand how heat stress affects the performance of workers who operate nuclear power plants. They developed a model that uses two types of data to evaluate the workers' abilities under hot conditions:

  1. Electrocardiogram (ECG) data, which measures the electrical activity of the heart. The researchers analyzed how the frequency patterns in the ECG data changed over time.

  2. Brain activity data collected using functional near-infrared spectroscopy (fNIRS). This technique shines infrared light on the brain and measures how much light is absorbed, which indicates brain activity in the prefrontal cortex region.

The model combines two advanced machine learning techniques - convolutional neural networks (CNNs) and graph attention networks (GATs) - to analyze the physiological and brain data. This allows the researchers to identify patterns that may indicate how heat stress impacts the operators' performance and decision-making abilities.

The goal is to use this model to help improve the design of nuclear power plant control rooms and training programs, ensuring operators can maintain high performance even in challenging environmental conditions.

Technical Explanation

The researchers collected ECG and fNIRS data from nuclear power plant operators performing tasks under heat stress conditions. The ECG data was used to generate time-frequency spectrograms, which capture changes in the heart's electrical activity over time.

The fNIRS data was used to construct a functional connectivity network of the prefrontal cortex, showing how different regions of the brain interact during the tasks.

The researchers then developed a hybrid model that combined a CNN and a GAT. The CNN was used to extract features from the ECG spectrograms, while the GAT analyzed the functional connectivity patterns in the fNIRS data.

By fusing the outputs of the CNN and GAT, the model was able to identify physiological and neurological markers that correlated with decreased operator performance under heat stress. This provides insights into the cognitive and physical effects of heat on the ability of nuclear power plant workers to monitor systems and make critical decisions.

Critical Analysis

The research presents a novel approach to evaluating operator performance in challenging environmental conditions, integrating multiple neurophysiological signals. The use of both ECG and fNIRS data provides a more comprehensive view of the operators' physiological and cognitive states.

However, the study was conducted in a controlled laboratory setting, and further validation in real-world nuclear power plant environments would be necessary to confirm the model's applicability. Additionally, the sample size was relatively small, and the generalizability of the findings to a broader population of nuclear power plant operators should be explored.

The fusion of CNN and GAT architectures is an interesting methodological choice, but the paper could have provided more details on the rationale behind this approach and how it compares to other possible modeling techniques.

Conclusion

This research offers a promising neuroergonomics model for assessing the performance of nuclear power plant operators under heat stress conditions. By combining ECG and fNIRS data, the model provides a multifaceted view of the physiological and cognitive effects of heat on operator decision-making and behavior.

The insights gained from this work could inform the design of more ergonomic control room environments and targeted training programs to enhance the resilience of nuclear power plant operators to extreme environmental stressors. Further research is needed to validate the model in real-world settings and explore its potential applications in other high-stakes, safety-critical industries.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

A neuroergonomics model to evaluating nuclear power plants operators' performance under heat stress driven by ECG time-frequency spectrums and fNIRS prefrontal cortex network: a CNN-GAT fusion model
Total Score

0

A neuroergonomics model to evaluating nuclear power plants operators' performance under heat stress driven by ECG time-frequency spectrums and fNIRS prefrontal cortex network: a CNN-GAT fusion model

Yan Zhang, Ming Jia, Meng Li, JianYu Wang, XiangMin Hu, ZhiHui Xu, Tao Chen

Operators experience complicated physiological and psychological states when exposed to extreme heat stress, which can impair cognitive function and decrease performance significantly, ultimately leading to severe secondary disasters. Therefore, there is an urgent need for a feasible technique to identify their abnormal states to enhance the reliability of human-cybernetics systems. With the advancement of deep learning in physiological modeling, a model for evaluating operators' performance driven by electrocardiogram (ECG) and functional near-infrared spectroscopy (fNIRS) was proposed, demonstrating high ecological validity. The model fused a convolutional neural network (CNN) backbone and a graph attention network (GAT) backbone to extract discriminative features from ECG time-frequency spectrums and fNIRS prefrontal cortex (PFC) network respectively with deeper neuroscience domain knowledge, and eventually achieved 0.90 AUC. Results supported that handcrafted features extracted by specialized neuroscience methods can alleviate overfitting. Inspired by the small-world nature of the brain network, the fNIRS PFC network was organized as an undirected graph and embedded by GAT. It is proven to perform better in information aggregation and delivery compared to a simple non-linear transformation. The model provides a potential neuroergonomics application for evaluating the human state in vital human-cybernetics systems under industry 5.0 scenarios.

Read more

4/4/2024

🏷️

Total Score

0

Functional near-infrared spectroscopy (fNIRS) and Eye tracking for Cognitive Load classification in a Driving Simulator Using Deep Learning

Mehshan Ahmed Khan, Houshyar Asadi, Mohammad Reza Chalak Qazani, Chee Peng Lim, Saied Nahavandi

Motion simulators allow researchers to safely investigate the interaction of drivers with a vehicle. However, many studies that use driving simulator data to predict cognitive load only employ two levels of workload, leaving a gap in research on employing deep learning methodologies to analyze cognitive load, especially in challenging low-light conditions. Often, studies overlook or solely focus on scenarios in bright daylight. To address this gap and understand the correlation between performance and cognitive load, this study employs functional near-infrared spectroscopy (fNIRS) and eye-tracking data, including fixation duration and gaze direction, during simulated driving tasks in low visibility conditions, inducing various mental workloads. The first stage involves the statistical estimation of useful features from fNIRS and eye-tracking data. ANOVA will be applied to the signals to identify significant channels from fNIRS signals. Optimal features from fNIRS, eye-tracking and vehicle dynamics are then combined in one chunk as input to the CNN and LSTM model to predict workload variations. The proposed CNN-LSTM model achieved 99% accuracy with neurological data and 89% with vehicle dynamics to predict cognitive load, indicating potential for real-time assessment of driver mental state and guide designers for the development of safe adaptive systems.

Read more

8/14/2024

🏷️

Total Score

0

Enhancing Cognitive Workload Classification Using Integrated LSTM Layers and CNNs for fNIRS Data Analysis

Mehshan Ahmed Khan, Houshyar Asadi, Mohammad Reza Chalak Qazani, Adetokunbo Arogbonlo, Siamak Pedrammehr, Adnan Anwar, Asim Bhatti, Saeid Nahavandi, Chee Peng Lim

Functional near-infrared spectroscopy (fNIRS) is employed as a non-invasive method to monitor functional brain activation by capturing changes in the concentrations of oxygenated haemoglobin (HbO) and deoxygenated haemo-globin (HbR). Various machine learning classification techniques have been utilized to distinguish cognitive states. However, conventional machine learning methods, although simpler to implement, undergo a complex pre-processing phase before network training and demonstrate reduced accuracy due to inadequate data preprocessing. Additionally, previous research in cog-nitive load assessment using fNIRS has predominantly focused on differ-sizeentiating between two levels of mental workload. These studies mainly aim to classify low and high levels of cognitive load or distinguish between easy and difficult tasks. To address these limitations associated with conven-tional methods, this paper conducts a comprehensive exploration of the im-pact of Long Short-Term Memory (LSTM) layers on the effectiveness of Convolutional Neural Networks (CNNs) within deep learning models. This is to address the issues related to spatial features overfitting and lack of tem-poral dependencies in CNN in the previous studies. By integrating LSTM layers, the model can capture temporal dependencies in the fNIRS data, al-lowing for a more comprehensive understanding of cognitive states. The primary objective is to assess how incorporating LSTM layers enhances the performance of CNNs. The experimental results presented in this paper demonstrate that the integration of LSTM layers with Convolutional layers results in an increase in the accuracy of deep learning models from 97.40% to 97.92%.

Read more

7/24/2024

🔮

Total Score

0

Block-As-Domain Adaptation for Workload Prediction from fNIRS Data

Jiyang Wang, Ayse Altay, Senem Velipasalar

Functional near-infrared spectroscopy (fNIRS) is a non-intrusive way to measure cortical hemodynamic activity. Predicting cognitive workload from fNIRS data has taken on a diffuse set of methods. To be applicable in real-world settings, models are needed, which can perform well across different sessions as well as different subjects. However, most existing works assume that training and testing data come from the same subjects and/or cannot generalize well across never-before-seen subjects. Additional challenges imposed by fNIRS data include the high variations in inter-subject fNIRS data and also in intra-subject data collected across different blocks of sessions. To address these issues, we propose an effective method, referred to as the class-aware-block-aware domain adaptation (CABA-DA) which explicitly minimize intra-session variance by viewing different blocks from the same subject same session as different domains. We minimize the intra-class domain discrepancy and maximize the inter-class domain discrepancy accordingly. In addition, we propose an MLPMixer-based model for cognitive load classification. Experimental results demonstrate the proposed model has better performance compared with three different baseline models on three public-available datasets of cognitive workload. Two of them are collected from n-back tasks and one of them is from finger tapping. From our experiments, we also show the proposed contrastive learning method can also improve baseline models we compared with.

Read more

5/2/2024