Identifying Functional Brain Networks of Spatiotemporal Wide-Field Calcium Imaging Data via a Long Short-Term Memory Autoencoder

Read original: arXiv:2405.19685 - Published 5/31/2024 by Xiaohui Zhang, Eric C Landsness, Lindsey M Brier, Wei Chen, Michelle J. Tang, Hanyang Miao, Jin-Moo Lee, Mark A. Anastasio, Joseph P. Culver
Total Score

0

📊

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a novel approach called LSTM-AER for identifying functional brain networks (FBNs) from wide-field calcium imaging (WFCI) data in mice.
  • LSTM-AER uses a long short-term memory (LSTM) autoencoder (AE) to learn spatial-temporal latent embeddings from WFCI data, and then applies ordinary least squares regression (R) to estimate FBNs.
  • The authors compare the FBNs identified by LSTM-AER to those obtained using traditional methods like seed-based correlation (SBC) analysis and independent component analysis (ICA).

Plain English Explanation

The paper discusses a new way to analyze brain activity data from mice. Researchers can use wide-field calcium imaging (WFCI) to measure changes in calcium levels in the brains of mice that have been genetically modified to produce a calcium-sensitive protein. This allows them to identify functional brain networks (FBNs) - groups of brain regions that work together to perform certain functions.

In this study, the researchers propose a method called LSTM-AER, which uses a type of neural network called a long short-term memory (LSTM) autoencoder (AE) to analyze the WFCI data. The LSTM-AE learns to extract important spatial and temporal patterns from the data, and then the researchers use a statistical technique called regression to estimate the FBNs.

The key advantage of LSTM-AER is that it can better account for differences between individual mice and shorter time periods of data, compared to traditional methods like seed-based correlation (SBC) and independent component analysis (ICA). The researchers show that the FBNs identified by LSTM-AER are similar to those found by SBC and ICA, but provide some additional insights.

Overall, this work demonstrates the potential of using unsupervised deep learning techniques like LSTM-AEs to analyze complex brain imaging data and map out the functional organization of the brain.

Technical Explanation

The researchers used WFCI to record neural calcium dynamics in mice expressing genetically encoded calcium indicators. This allowed them to identify FBNs, which are groups of brain regions that show coordinated activity and likely work together to perform certain functions.

Traditionally, FBNs have been estimated from WFCI data using two main methods: seed-based correlation (SBC) analysis and independent component analysis (ICA). However, these approaches have limitations, motivating the investigation of unsupervised representation learning techniques for this task.

The novel LSTM-AER method proposed in this work uses a long short-term memory (LSTM) autoencoder (AE) to learn spatial-temporal latent embeddings from the WFCI data. It then applies ordinary least squares regression (R) to estimate the FBNs from these learned representations.

The researchers compared the FBNs identified by LSTM-AER to those obtained using SBC and ICA. They found that the spatial FBN maps produced by LSTM-AER were similar to those derived by the traditional methods, but LSTM-AER was better able to account for intra-subject variation, data from a single hemisphere, shorter epoch lengths, and a tunable number of latent components.

These results demonstrate the potential of unsupervised deep learning-based approaches like LSTM-AER to identify and map FBNs from complex brain imaging data.

Critical Analysis

The paper provides a comprehensive and well-designed study to evaluate the performance of the proposed LSTM-AER method for identifying FBNs from WFCI data. The authors effectively highlight the limitations of existing approaches and demonstrate how LSTM-AER can address some of these shortcomings.

One potential caveat is that the study was conducted using data from only a single hemisphere of the mouse brain. It would be valuable to see how the LSTM-AER method performs when analyzing whole-brain WFCI data. Additionally, the authors acknowledge that the interpretability of the learned latent representations in the LSTM-AE component could be improved, which may be an area for further research.

While the results are promising, it would be helpful to see the LSTM-AER method tested on a wider range of WFCI datasets, including data from different experimental conditions or mouse models. This would provide a more comprehensive evaluation of the method's robustness and generalizability.

Overall, this work represents an important contribution to the field of functional brain mapping, and the LSTM-AER approach shows significant potential for advancing our understanding of the brain's complex network organization.

Conclusion

This paper introduces a novel deep learning-based method called LSTM-AER for identifying functional brain networks (FBNs) from wide-field calcium imaging (WFCI) data in mice. The key innovation of LSTM-AER is its use of a long short-term memory (LSTM) autoencoder to learn spatial-temporal latent representations from the WFCI data, which are then used to estimate the FBNs.

The results demonstrate that the FBNs identified by LSTM-AER are similar to those obtained using traditional methods like seed-based correlation (SBC) and independent component analysis (ICA), but with several advantages. LSTM-AER is better able to account for intra-subject variation, data from a single hemisphere, shorter epoch lengths, and a tunable number of latent components.

Overall, this work highlights the potential of unsupervised deep learning techniques to advance our understanding of the brain's functional organization. The LSTM-AER method could be a valuable tool for neuroscientists studying the complex neural dynamics underlying various cognitive and behavioral processes.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

📊

Total Score

0

Identifying Functional Brain Networks of Spatiotemporal Wide-Field Calcium Imaging Data via a Long Short-Term Memory Autoencoder

Xiaohui Zhang, Eric C Landsness, Lindsey M Brier, Wei Chen, Michelle J. Tang, Hanyang Miao, Jin-Moo Lee, Mark A. Anastasio, Joseph P. Culver

Wide-field calcium imaging (WFCI) that records neural calcium dynamics allows for identification of functional brain networks (FBNs) in mice that express genetically encoded calcium indicators. Estimating FBNs from WFCI data is commonly achieved by use of seed-based correlation (SBC) analysis and independent component analysis (ICA). These two methods are conceptually distinct and each possesses limitations. Recent success of unsupervised representation learning in neuroimage analysis motivates the investigation of such methods to identify FBNs. In this work, a novel approach referred as LSTM-AER, is proposed in which a long short-term memory (LSTM) autoencoder (AE) is employed to learn spatial-temporal latent embeddings from WFCI data, followed by an ordinary least square regression (R) to estimate FBNs. The goal of this study is to elucidate and illustrate, qualitatively and quantitatively, the FBNs identified by use of the LSTM-AER method and compare them to those from traditional SBC and ICA. It was observed that spatial FBN maps produced from LSTM-AER resembled those derived by SBC and ICA while better accounting for intra-subject variation, data from a single hemisphere, shorter epoch lengths and tunable number of latent components. The results demonstrate the potential of unsupervised deep learning-based approaches to identifying and mapping FBNs.

Read more

5/31/2024

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis
Total Score

0

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis

Yuxiang Wei, Anees Abrol, Reihaneh Hassanzadeh, Vince Calhoun

Recent advances in deep learning structured state space models, especially the Mamba architecture, have demonstrated remarkable performance improvements while maintaining linear complexity. In this study, we introduce functional spatiotemporal Mamba (FST-Mamba), a Mamba-based model designed for discovering neurological biomarkers using functional magnetic resonance imaging (fMRI). We focus on dynamic functional network connectivity (dFNC) derived from fMRI and propose a hierarchical spatiotemporal Mamba-based network that processes spatial and temporal information separately using Mamba-based encoders. Leveraging the topological uniqueness of the FNC matrix, we introduce a component-wise varied-scale aggregation (CVA) mechanism to aggregate connectivity across individual components within brain networks, enabling the model to capture both inter-component and inter-network information. To better handle the FNC data, we develop a new component-specific scanning order. Additionally, we propose symmetric rotary position encoding (SymRope) to encode the relative positions of each functional connection while considering the symmetric nature of the FNC matrix. Experimental results demonstrate significant improvements in the proposed FST-Mamba model on various brain-based classification and regression tasks. Our work reveals the substantial potential of attention-free sequence modeling in brain discovery.

Read more

8/26/2024

🏷️

Total Score

0

Spatio-Temporal Encoding of Brain Dynamics with Surface Masked Autoencoders

Simon Dahan, Logan Z. J. Williams, Yourong Guo, Daniel Rueckert, Emma C. Robinson

The development of robust and generalisable models for encoding the spatio-temporal dynamics of human brain activity is crucial for advancing neuroscientific discoveries. However, significant individual variation in the organisation of the human cerebral cortex makes it difficult to identify population-level trends in these signals. Recently, Surface Vision Transformers (SiTs) have emerged as a promising approach for modelling cortical signals, yet they face some limitations in low-data scenarios due to the lack of inductive biases in their architecture. To address these challenges, this paper proposes the surface Masked AutoEncoder (sMAE) and video surface Masked AutoEncoder (vsMAE) - for multivariate and spatio-temporal pre-training of cortical signals over regular icosahedral grids. These models are trained to reconstruct cortical feature maps from masked versions of the input by learning strong latent representations of cortical structure and function. Such representations translate into better modelling of individual phenotypes and enhanced performance in downstream tasks. The proposed approach was evaluated on cortical phenotype regression using data from the young adult Human Connectome Project (HCP) and developing HCP (dHCP). Results show that (v)sMAE pre-trained models improve phenotyping prediction performance on multiple tasks by $ge 26%$, and offer faster convergence relative to models trained from scratch. Finally, we show that pre-training vision transformers on large datasets, such as the UK Biobank (UKB), supports transfer learning to low-data regimes. Our code and pre-trained models are publicly available at https://github.com/metrics-lab/surface-masked-autoencoders .

Read more

6/12/2024

🤿

Total Score

0

A Deep Probabilistic Spatiotemporal Framework for Dynamic Graph Representation Learning with Application to Brain Disorder Identification

Sin-Yee Yap, Junn Yong Loo, Chee-Ming Ting, Fuad Noman, Raphael C. -W. Phan, Adeel Razi, David L. Dowe

Recent applications of pattern recognition techniques on brain connectome classification using functional connectivity (FC) are shifting towards acknowledging the non-Euclidean topology and causal dynamics of brain connectivity across time. In this paper, a deep spatiotemporal variational Bayes (DSVB) framework is proposed to learn time-varying topological structures in dynamic FC networks for identifying autism spectrum disorder (ASD) in human participants. The framework incorporates a spatial-aware recurrent neural network with an attention-based message passing scheme to capture rich spatiotemporal patterns across dynamic FC networks. To overcome model overfitting on limited training datasets, an adversarial training strategy is introduced to learn graph embedding models that generalize well to unseen brain networks. Evaluation on the ABIDE resting-state functional magnetic resonance imaging dataset shows that our proposed framework substantially outperforms state-of-the-art methods in identifying patients with ASD. Dynamic FC analyses with DSVB-learned embeddings reveal apparent group differences between ASD and healthy controls in brain network connectivity patterns and switching dynamics of brain states.

Read more

5/15/2024