Block-As-Domain Adaptation for Workload Prediction from fNIRS Data

Read original: arXiv:2405.00213 - Published 5/2/2024 by Jiyang Wang, Ayse Altay, Senem Velipasalar
Total Score

0

🔮

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Functional near-infrared spectroscopy (fNIRS) is a non-invasive way to measure brain activity
  • Predicting cognitive workload from fNIRS data has used a variety of methods
  • To be useful in real-world settings, models need to perform well across different sessions and subjects
  • Existing work assumes training and testing data come from the same subjects, limiting generalization
  • fNIRS data has high variation between subjects and within the same subject across sessions
  • This paper proposes a new method called class-aware-block-aware domain adaptation (CABA-DA) to address these challenges

Plain English Explanation

The paper is about using functional near-infrared spectroscopy (fNIRS) to measure brain activity and predict a person's cognitive workload. fNIRS is a non-invasive technology that can track blood flow changes in the brain, which are linked to mental effort.

Predicting cognitive workload from fNIRS data has been done in various ways, but to be useful in real-world settings, the models need to work well across different people and testing sessions, not just the same person. The problem is that most existing methods can't generalize well to new people who weren't in the original training data.

There are also challenges with fNIRS data itself - it can vary a lot between people, and even change for the same person across different testing sessions. To address these issues, the researchers propose a new method called CABA-DA. This aims to minimize the differences in the fNIRS data within the same person's testing sessions, while also maximizing the differences between people with different cognitive workloads.

Along with the CABA-DA technique, the paper also introduces a new machine learning model based on an MLPMixer architecture for classifying cognitive workload levels. The authors show this combined approach outperforms other baseline methods on several publicly available fNIRS datasets.

Technical Explanation

The paper proposes a new method called class-aware-block-aware domain adaptation (CABA-DA) to address the challenges of predicting cognitive workload from functional near-infrared spectroscopy (fNIRS) data.

The key elements of the CABA-DA approach are:

  • Viewing different testing blocks from the same subject as separate "domains" to minimize intra-session variance
  • Explicitly minimizing the intra-class domain discrepancy and maximizing the inter-class domain discrepancy
  • Using this domain adaptation technique in conjunction with an MLPMixer-based classification model

The paper evaluates the proposed method on three public fNIRS datasets related to cognitive workload, including n-back tasks and finger tapping. Compared to baseline models, the CABA-DA approach demonstrates improved performance in classifying the level of cognitive load.

The authors also show that their contrastive learning-based domain adaptation can enhance the baseline models as well.

Critical Analysis

The paper presents a novel and effective approach to the challenge of predicting cognitive workload from fNIRS data, which is an important application for neuroergonomics and real-time cognitive load assessment.

However, the authors acknowledge some limitations of their work:

  • The method has only been evaluated on a few public datasets, and may not generalize as well to other tasks or settings
  • The high variability in fNIRS data remains a significant challenge, even with the CABA-DA approach
  • The paper does not address the problem of temporal differences across electrodes, which can also impact model performance

Additionally, while the CABA-DA technique is a promising contribution, it would be valuable to see how it compares to other domain adaptation or meta-learning methods that could also help with generalizing to new subjects.

Overall, this paper takes an important step towards making fNIRS-based cognitive workload prediction more practical for real-world applications, but there is still room for further research and refinement.

Conclusion

This paper proposes an effective method called CABA-DA to address the challenges of predicting cognitive workload from functional near-infrared spectroscopy (fNIRS) data. The key innovations are:

  • Treating different testing blocks from the same subject as separate "domains" to minimize intra-session variance
  • Explicitly optimizing the intra-class and inter-class domain discrepancies
  • Using this domain adaptation approach with an MLPMixer-based classification model

Experiments on several public fNIRS datasets show the proposed approach outperforms baseline methods, demonstrating its potential to make fNIRS-based cognitive load assessment more practical and generalizable to real-world settings. While the method has some limitations, it represents an important step forward in this important area of neuroergonomics and cognitive state monitoring.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔮

Total Score

0

Block-As-Domain Adaptation for Workload Prediction from fNIRS Data

Jiyang Wang, Ayse Altay, Senem Velipasalar

Functional near-infrared spectroscopy (fNIRS) is a non-intrusive way to measure cortical hemodynamic activity. Predicting cognitive workload from fNIRS data has taken on a diffuse set of methods. To be applicable in real-world settings, models are needed, which can perform well across different sessions as well as different subjects. However, most existing works assume that training and testing data come from the same subjects and/or cannot generalize well across never-before-seen subjects. Additional challenges imposed by fNIRS data include the high variations in inter-subject fNIRS data and also in intra-subject data collected across different blocks of sessions. To address these issues, we propose an effective method, referred to as the class-aware-block-aware domain adaptation (CABA-DA) which explicitly minimize intra-session variance by viewing different blocks from the same subject same session as different domains. We minimize the intra-class domain discrepancy and maximize the inter-class domain discrepancy accordingly. In addition, we propose an MLPMixer-based model for cognitive load classification. Experimental results demonstrate the proposed model has better performance compared with three different baseline models on three public-available datasets of cognitive workload. Two of them are collected from n-back tasks and one of them is from finger tapping. From our experiments, we also show the proposed contrastive learning method can also improve baseline models we compared with.

Read more

5/2/2024

🏷️

Total Score

0

Functional near-infrared spectroscopy (fNIRS) and Eye tracking for Cognitive Load classification in a Driving Simulator Using Deep Learning

Mehshan Ahmed Khan, Houshyar Asadi, Mohammad Reza Chalak Qazani, Chee Peng Lim, Saied Nahavandi

Motion simulators allow researchers to safely investigate the interaction of drivers with a vehicle. However, many studies that use driving simulator data to predict cognitive load only employ two levels of workload, leaving a gap in research on employing deep learning methodologies to analyze cognitive load, especially in challenging low-light conditions. Often, studies overlook or solely focus on scenarios in bright daylight. To address this gap and understand the correlation between performance and cognitive load, this study employs functional near-infrared spectroscopy (fNIRS) and eye-tracking data, including fixation duration and gaze direction, during simulated driving tasks in low visibility conditions, inducing various mental workloads. The first stage involves the statistical estimation of useful features from fNIRS and eye-tracking data. ANOVA will be applied to the signals to identify significant channels from fNIRS signals. Optimal features from fNIRS, eye-tracking and vehicle dynamics are then combined in one chunk as input to the CNN and LSTM model to predict workload variations. The proposed CNN-LSTM model achieved 99% accuracy with neurological data and 89% with vehicle dynamics to predict cognitive load, indicating potential for real-time assessment of driver mental state and guide designers for the development of safe adaptive systems.

Read more

8/14/2024

🏷️

Total Score

0

Enhancing Cognitive Workload Classification Using Integrated LSTM Layers and CNNs for fNIRS Data Analysis

Mehshan Ahmed Khan, Houshyar Asadi, Mohammad Reza Chalak Qazani, Adetokunbo Arogbonlo, Siamak Pedrammehr, Adnan Anwar, Asim Bhatti, Saeid Nahavandi, Chee Peng Lim

Functional near-infrared spectroscopy (fNIRS) is employed as a non-invasive method to monitor functional brain activation by capturing changes in the concentrations of oxygenated haemoglobin (HbO) and deoxygenated haemo-globin (HbR). Various machine learning classification techniques have been utilized to distinguish cognitive states. However, conventional machine learning methods, although simpler to implement, undergo a complex pre-processing phase before network training and demonstrate reduced accuracy due to inadequate data preprocessing. Additionally, previous research in cog-nitive load assessment using fNIRS has predominantly focused on differ-sizeentiating between two levels of mental workload. These studies mainly aim to classify low and high levels of cognitive load or distinguish between easy and difficult tasks. To address these limitations associated with conven-tional methods, this paper conducts a comprehensive exploration of the im-pact of Long Short-Term Memory (LSTM) layers on the effectiveness of Convolutional Neural Networks (CNNs) within deep learning models. This is to address the issues related to spatial features overfitting and lack of tem-poral dependencies in CNN in the previous studies. By integrating LSTM layers, the model can capture temporal dependencies in the fNIRS data, al-lowing for a more comprehensive understanding of cognitive states. The primary objective is to assess how incorporating LSTM layers enhances the performance of CNNs. The experimental results presented in this paper demonstrate that the integration of LSTM layers with Convolutional layers results in an increase in the accuracy of deep learning models from 97.40% to 97.92%.

Read more

7/24/2024

Domain Adaptation-Enhanced Searchlight: Enabling brain decoding from visual perception to mental imagery
Total Score

0

Domain Adaptation-Enhanced Searchlight: Enabling brain decoding from visual perception to mental imagery

Alexander Olza, David Soto, Roberto Santana

In cognitive neuroscience and brain-computer interface research, accurately predicting imagined stimuli is crucial. This study investigates the effectiveness of Domain Adaptation (DA) in enhancing imagery prediction using primarily visual data from fMRI scans of 18 subjects. Initially, we train a baseline model on visual stimuli to predict imagined stimuli, utilizing data from 14 brain regions. We then develop several models to improve imagery prediction, comparing different DA methods. Our results demonstrate that DA significantly enhances imagery prediction, especially with the Regular Transfer approach. We then conduct a DA-enhanced searchlight analysis using Regular Transfer, followed by permutation-based statistical tests to identify brain regions where imagery decoding is consistently above chance across subjects. Our DA-enhanced searchlight predicts imagery contents in a highly distributed set of brain regions, including the visual cortex and the frontoparietal cortex, thereby outperforming standard cross-domain classification methods. The complete code and data for this paper have been made openly available for the use of the scientific community.

Read more

8/6/2024