Enhancing 3T Retinotopic Maps Using Diffeomorphic Registration

Read original: arXiv:2405.01552 - Published 5/6/2024 by Negar Jalili-Mallak, Yanshuai Tu, Zhong-Lin Lu, Yalin Wang
Total Score

0

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This study aims to improve the accuracy of retinotopic mapping, which is the process of understanding how visual stimuli on the retina are represented in the visual cortex of the brain.
  • The researchers apply a technique called diffeomorphic registration to a dataset of retinotopic mapping data collected at 3T magnetic resonance imaging (MRI) resolution.
  • Diffeomorphic registration ensures that retinotopic maps are accurately aligned without introducing topological distortions.
  • The proposed method, called Diffeomorphic Registration for Retinotopic Maps (DRRM), significantly enhances the accuracy of retinotopic maps compared to existing approaches.

Plain English Explanation

The human visual system is remarkably complex, with information from the retina at the back of the eye being processed and interpreted by different regions of the brain's visual cortex. Retinotopic mapping aims to understand this mapping between the retina and the cortex, which is important for understanding how we perceive the world.

In this study, the researchers used a technique called diffeomorphic registration to analyze a dataset of retinotopic mapping data collected using 3T MRI. Diffeomorphic registration ensures that the retinotopic maps are accurately aligned without introducing any distortions or topological violations.

The researchers' method, called DRRM, leverages the Beltrami coefficient and topological condition to further enhance the accuracy of the retinotopic maps. This means that the maps are more faithful representations of the actual neural responses in the visual cortex.

By improving the accuracy of retinotopic mapping, this research could have important implications for our understanding of the visual system and its potential clinical applications, such as image reconstruction from fMRI data or robust registration of medical images.

Technical Explanation

The researchers applied diffeomorphic registration to the 3T NYU retinotopy dataset, which includes both analyze-PRF and mrVista data. Diffeomorphic registration is a technique that ensures the accurate alignment of retinotopic maps without introducing any topological violations, a crucial property for maintaining the integrity of the maps.

The proposed method, DRRM, quantifies the diffeomorphic condition and leverages the Beltrami coefficient and topological condition to significantly enhance the accuracy of the retinotopic maps. This means that the maps better reflect the underlying neural responses in the visual cortex.

The researchers evaluated DRRM against existing methods on various datasets, including 3T and 7T retinotopy data. The results demonstrate the superiority of DRRM in terms of retinotopic map accuracy, outperforming other approaches.

Critical Analysis

The researchers acknowledge that their method relies on the availability of high-quality retinotopic mapping data, which can be challenging to obtain, especially in clinical settings. Additionally, the performance of DRRM may be impacted by factors such as image resolution, signal-to-noise ratio, and the specific characteristics of the visual cortex being studied.

While the researchers have shown the effectiveness of DRRM on various datasets, it would be valuable to see its performance evaluated on a wider range of retinotopic mapping data, including data from different imaging modalities or experimental paradigms. This could help further validate the generalizability and robustness of the method.

Additionally, the researchers could explore the potential applications of DRRM in clinical settings, such as its use in the reconstruction of retinal visual images from fMRI data or in robust registration of medical images. This could demonstrate the practical value of their approach and its impact on real-world problems.

Conclusion

This study presents a significant advance in retinotopic mapping by applying diffeomorphic registration to retinotopic data. The proposed DRRM method ensures the accurate alignment of retinotopic maps without introducing topological distortions, leading to a substantial improvement in the accuracy of the maps.

The enhanced accuracy of retinotopic maps has the potential to contribute to our understanding of the visual system and its underlying neural mechanisms. Additionally, the application of DRRM could have important implications for clinical applications, such as image reconstruction from fMRI data and robust registration of medical images. Overall, this research represents a significant step forward in the field of retinotopic mapping and its practical applications.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Total Score

0

Enhancing 3T Retinotopic Maps Using Diffeomorphic Registration

Negar Jalili-Mallak, Yanshuai Tu, Zhong-Lin Lu, Yalin Wang

Retinotopic mapping aims to uncover the relationship between visual stimuli on the retina and neural responses on the visual cortical surface. This study advances retinotopic mapping by applying diffeomorphic registration to the 3T NYU retinotopy dataset, encompassing analyze-PRF and mrVista data. Diffeomorphic Registration for Retinotopic Maps (DRRM) quantifies the diffeomorphic condition, ensuring accurate alignment of retinotopic maps without topological violations. Leveraging the Beltrami coefficient and topological condition, DRRM significantly enhances retinotopic map accuracy. Evaluation against existing methods demonstrates DRRM's superiority on various datasets, including 3T and 7T retinotopy data. The application of diffeomorphic registration improves the interpretability of low-quality retinotopic maps, holding promise for clinical applications.

Read more

5/6/2024

Progressive Retinal Image Registration via Global and Local Deformable Transformations
Total Score

0

Progressive Retinal Image Registration via Global and Local Deformable Transformations

Yepeng Liu, Baosheng Yu, Tian Chen, Yuliang Gu, Bo Du, Yongchao Xu, Jun Cheng

Retinal image registration plays an important role in the ophthalmological diagnosis process. Since there exist variances in viewing angles and anatomical structures across different retinal images, keypoint-based approaches become the mainstream methods for retinal image registration thanks to their robustness and low latency. These methods typically assume the retinal surfaces are planar, and adopt feature matching to obtain the homography matrix that represents the global transformation between images. Yet, such a planar hypothesis inevitably introduces registration errors since retinal surface is approximately curved. This limitation is more prominent when registering image pairs with significant differences in viewing angles. To address this problem, we propose a hybrid registration framework called HybridRetina, which progressively registers retinal images with global and local deformable transformations. For that, we use a keypoint detector and a deformation network called GAMorph to estimate the global transformation and local deformable transformation, respectively. Specifically, we integrate multi-level pixel relation knowledge to guide the training of GAMorph. Additionally, we utilize an edge attention module that includes the geometric priors of the images, ensuring the deformation field focuses more on the vascular regions of clinical interest. Experiments on two widely-used datasets, FIRE and FLoRI21, show that our proposed HybridRetina significantly outperforms some state-of-the-art methods. The code is available at https://github.com/lyp-deeplearning/awesome-retinal-registration.

Read more

9/4/2024

Retinotopic Mapping Enhances the Robustness of Convolutional Neural Networks
Total Score

0

Retinotopic Mapping Enhances the Robustness of Convolutional Neural Networks

Jean-Nicolas J'er'emie, Emmanuel Dauc'e, Laurent U Perrinet

Foveated vision, a trait shared by many animals, including humans, has not been fully utilized in machine learning applications, despite its significant contributions to biological visual function. This study investigates whether retinotopic mapping, a critical component of foveated vision, can enhance image categorization and localization performance when integrated into deep convolutional neural networks (CNNs). Retinotopic mapping was integrated into the inputs of standard off-the-shelf convolutional neural networks (CNNs), which were then retrained on the ImageNet task. As expected, the logarithmic-polar mapping improved the network's ability to handle arbitrary image zooms and rotations, particularly for isolated objects. Surprisingly, the retinotopically mapped network achieved comparable performance in classification. Furthermore, the network demonstrated improved classification localization when the foveated center of the transform was shifted. This replicates a crucial ability of the human visual system that is absent in typical convolutional neural networks (CNNs). These findings suggest that retinotopic mapping may be fundamental to significant preattentive visual processes.

Read more

8/12/2024

🖼️

Total Score

0

Diffeomorphic Transformer-based Abdomen MRI-CT Deformable Image Registration

Yang Lei, Luke A. Matkovic, Justin Roper, Tonghe Wang, Jun Zhou, Beth Ghavidel, Mark McDonald, Pretesh Patel, Xiaofeng Yang

This paper aims to create a deep learning framework that can estimate the deformation vector field (DVF) for directly registering abdominal MRI-CT images. The proposed method assumed a diffeomorphic deformation. By using topology-preserved deformation features extracted from the probabilistic diffeomorphic registration model, abdominal motion can be accurately obtained and utilized for DVF estimation. The model integrated Swin transformers, which have demonstrated superior performance in motion tracking, into the convolutional neural network (CNN) for deformation feature extraction. The model was optimized using a cross-modality image similarity loss and a surface matching loss. To compute the image loss, a modality-independent neighborhood descriptor (MIND) was used between the deformed MRI and CT images. The surface matching loss was determined by measuring the distance between the warped coordinates of the surfaces of contoured structures on the MRI and CT images. The deformed MRI image was assessed against the CT image using the target registration error (TRE), Dice similarity coefficient (DSC), and mean surface distance (MSD) between the deformed contours of the MRI image and manual contours of the CT image. When compared to only rigid registration, DIR with the proposed method resulted in an increase of the mean DSC values of the liver and portal vein from 0.850 and 0.628 to 0.903 and 0.763, a decrease of the mean MSD of the liver from 7.216 mm to 3.232 mm, and a decrease of the TRE from 26.238 mm to 8.492 mm. The proposed deformable image registration method based on a diffeomorphic transformer provides an effective and efficient way to generate an accurate DVF from an MRI-CT image pair of the abdomen. It could be utilized in the current treatment planning workflow for liver radiotherapy.

Read more

5/7/2024