Reconstructing physiological signals from fMRI across the adult lifespan

Read original: arXiv:2408.14453 - Published 8/27/2024 by Shiyu Wang, Ziyuan Xu, Yamin Li, Mara Mather, Roza G. Bayrak, Catie Chang
Total Score

0

🏋️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores using machine learning to infer key physiological signals like respiratory volume and heart rate directly from functional magnetic resonance imaging (fMRI) data.
  • fMRI can capture brain activity non-invasively, but physiological recordings are not always available, so the authors propose a novel framework to reconstruct respiratory and cardiac signals from fMRI alone.
  • Their Transformer-based models outperform previous approaches and can extract these physiological features from fMRI data across a wide range of adult ages, from 36 to 89 years old.

Plain English Explanation

The human brain and body work closely together to influence our behavior and health. Researchers can use a technique called functional magnetic resonance imaging (fMRI) to measure brain activity non-invasively. By modeling how the fMRI signals interact with the physiological dynamics of the body, scientists can gain new insights into brain function and potentially identify biomarkers of disease.

However, directly recording physiological signals like breathing and heart rate can be challenging, as it requires extra equipment and may be prone to artifacts. To overcome this, the researchers developed machine learning models that can extract these physiological features directly from the fMRI data. Their novel Transformer-based approach was able to reconstruct respiratory volume and heart rate fluctuations more accurately than previous methods, even when tested on older adults ranging from 36 to 89 years old.

By leveraging the power of attention mechanisms, the authors' models can better capture the complex relationships between brain activity and physiological signals. This advance could lead to new ways of using fMRI data to understand how the brain and body interact, with potential applications for monitoring health and detecting early signs of disease.

Technical Explanation

The researchers developed a novel Transformer-based architecture to reconstruct two key physiological signals - respiratory volume (RV) and heart rate (HR) - directly from resting-state fMRI data. This approach builds on previous work that used machine learning to extract physiological features from fMRI, but expands it to a wider age range of participants (36-89 years old), going beyond just healthy young adults and children.

The Transformer model, with its attention mechanisms, was able to outperform earlier methods, achieving median correlations of around 0.70 for RV and 0.62 for HR when comparing the predicted and measured signals. The authors also evaluated different training and fine-tuning strategies, finding that incorporating data from young adults helped improve the model's performance on the aging cohort.

This work demonstrates the potential of leveraging complex neural network architectures to extract physiological information directly from fMRI data, without requiring separate recordings. The ability to infer these signals across a wide adult age range suggests the models can capture meaningful relationships between brain activity and bodily functions, which could lead to new biomarkers and insights into brain-body interactions.

Critical Analysis

The authors acknowledge several limitations and areas for further research. First, while the models performed well on the aging cohort, the dataset was still relatively small, and testing on an even wider age range or clinical populations would be valuable. Additionally, the paper does not address potential challenges in translating this approach to real-world clinical settings, where data quality and acquisition constraints may differ from the controlled research environment.

Another important consideration is the possibility of confounding factors or artifacts in the fMRI data that could be influencing the physiological signal reconstruction. Further investigations into the precise mechanisms underlying the models' performance would help validate the approach and ensure the extracted features are truly reflective of the targeted physiological processes.

Overall, this research represents an important step forward in using machine learning to bridge the gap between brain activity and bodily functions. However, continued validation and exploration of the limitations and potential pitfalls will be crucial as the field moves towards real-world applications of this technology.

Conclusion

This paper presents a novel Transformer-based framework that can reconstruct key physiological signals like respiratory volume and heart rate directly from fMRI data, even in older adults. By leveraging attention mechanisms, the models outperform previous approaches and demonstrate the potential of using machine learning to infer brain-body interactions non-invasively.

While further research is needed to validate the robustness and generalizability of this technique, the authors' work represents an important advance in our understanding of how the brain and body work together. If successfully translated to clinical settings, this could lead to new biomarkers and monitoring capabilities for a wide range of health conditions. Overall, the study highlights the power of interdisciplinary approaches that combine neuroimaging, physiology, and cutting-edge machine learning.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🏋️

Total Score

0

Reconstructing physiological signals from fMRI across the adult lifespan

Shiyu Wang, Ziyuan Xu, Yamin Li, Mara Mather, Roza G. Bayrak, Catie Chang

Interactions between the brain and body are of fundamental importance for human behavior and health. Functional magnetic resonance imaging (fMRI) captures whole-brain activity noninvasively, and modeling how fMRI signals interact with physiological dynamics of the body can provide new insight into brain function and offer potential biomarkers of disease. However, physiological recordings are not always possible to acquire since they require extra equipment and setup, and even when they are, the recorded physiological signals may contain substantial artifacts. To overcome this limitation, machine learning models have been proposed to directly extract features of respiratory and cardiac activity from resting-state fMRI signals. To date, such work has been carried out only in healthy young adults and in a pediatric population, leaving open questions about the efficacy of these approaches on older adults. Here, we propose a novel framework that leverages Transformer-based architectures for reconstructing two key physiological signals - low-frequency respiratory volume (RV) and heart rate (HR) fluctuations - from fMRI data, and test these models on a dataset of individuals aged 36-89 years old. Our framework outperforms previously proposed approaches (attaining median correlations between predicted and measured signals of r ~ .698 for RV and r ~ .618 for HR), indicating the potential of leveraging attention mechanisms to model fMRI-physiological signal relationships. We also evaluate several model training and fine-tuning strategies, and find that incorporating young-adult data during training improves the performance when predicting physiological signals in the aging cohort. Overall, our approach successfully infers key physiological variables directly from fMRI data from individuals across a wide range of the adult lifespan.

Read more

8/27/2024

Machine Learning-based Estimation of Respiratory Fluctuations in a Healthy Adult Population using BOLD fMRI and Head Motion Parameters
Total Score

0

Machine Learning-based Estimation of Respiratory Fluctuations in a Healthy Adult Population using BOLD fMRI and Head Motion Parameters

Abdoljalil Addeh, Fernando Vega, Rebecca J. Williams, G. Bruce Pike, M. Ethan MacDonald

Motivation: In many fMRI studies, respiratory signals are often missing or of poor quality. Therefore, it could be highly beneficial to have a tool to extract respiratory variation (RV) waveforms directly from fMRI data without the need for peripheral recording devices. Goal(s): Investigate the hypothesis that head motion parameters contain valuable information regarding respiratory patter, which can help machine learning algorithms estimate the RV waveform. Approach: This study proposes a CNN model for reconstruction of RV waveforms using head motion parameters and BOLD signals. Results: This study showed that combining head motion parameters with BOLD signals enhances RV waveform estimation. Impact: It is expected that application of the proposed method will lower the cost of fMRI studies, reduce complexity, and decrease the burden on participants as they will not be required to wear a respiratory bellows.

Read more

5/2/2024

Multimodal Physiological Signals Representation Learning via Multiscale Contrasting for Depression Recognition
Total Score

0

Multimodal Physiological Signals Representation Learning via Multiscale Contrasting for Depression Recognition

Kai Shao, Rui Wang, Yixue Hao, Long Hu, Min Chen, Hans Arno Jacobsen

Depression recognition based on physiological signals such as functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) has made considerable progress. However, most existing studies ignore the complementarity and semantic consistency of multimodal physiological signals under the same stimulation task in complex spatio-temporal patterns. In this paper, we introduce a multimodal physiological signals representation learning framework using Siamese architecture via multiscale contrasting for depression recognition (MRLMC). First, fNIRS and EEG are transformed into different but correlated data based on a time-domain data augmentation strategy. Then, we design a spatio-temporal contrasting module to learn the representation of fNIRS and EEG through weight-sharing multiscale spatio-temporal convolution. Furthermore, to enhance the learning of semantic representation associated with stimulation tasks, a semantic consistency contrast module is proposed, aiming to maximize the semantic similarity of fNIRS and EEG. Extensive experiments on publicly available and self-collected multimodal physiological signals datasets indicate that MRLMC outperforms the state-of-the-art models. Moreover, our proposed framework is capable of transferring to multimodal time series downstream tasks.

Read more

6/27/2024

Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurement
Total Score

0

Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurement

Zijie Yue, Miaojing Shi, Hanli Wang, Shuai Ding, Qijun Chen, Shanlin Yang

Facial video-based remote physiological measurement is a promising research area for detecting human vital signs (e.g., heart rate, respiration frequency) in a non-contact way. Conventional approaches are mostly supervised learning, requiring extensive collections of facial videos and synchronously recorded photoplethysmography (PPG) signals. To tackle it, self-supervised learning has recently gained attentions; due to the lack of ground truth PPG signals, its performance is however limited. In this paper, we propose a novel self-supervised framework that successfully integrates the popular vision-language models (VLMs) into the remote physiological measurement task. Given a facial video, we first augment its positive and negative video samples with varying rPPG signal frequencies. Next, we introduce a frequency-oriented vision-text pair generation method by carefully creating contrastive spatio-temporal maps from positive and negative samples and designing proper text prompts to describe their relative ratios of signal frequencies. A pre-trained VLM is employed to extract features for these formed vision-text pairs and estimate rPPG signals thereafter. We develop a series of generative and contrastive learning mechanisms to optimize the VLM, including the text-guided visual map reconstruction task, the vision-text contrastive learning task, and the frequency contrastive and ranking task. Overall, our method for the first time adapts VLMs to digest and align the frequency-related knowledge in vision and text modalities. Extensive experiments on four benchmark datasets demonstrate that it significantly outperforms state of the art self-supervised methods.

Read more

7/12/2024