Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements

Read original: arXiv:2409.11391 - Published 9/18/2024 by Jipeng Yan, Shusei Kawara, Qingyuan Tan, Jingwen Zhu, Bingxue Wang, Matthieu Toulemonde, Honghai Liu, Ying Tan, Meng-Xing Tang
Total Score

0

Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper describes a new technique called 4D ultrasound-guided robotic tracking that enables 3D ultrasound localization microscopy with large tissue displacements.
  • The key innovation is the use of a robotic arm to actively track and compensate for large tissue movements during 3D ultrasound imaging.
  • This allows for high-resolution 3D imaging of dynamic biological processes over large tissue volumes.

Plain English Explanation

The research presented in this paper introduces a novel approach to 3D ultrasound imaging that can capture detailed, high-resolution details of moving tissues and organs. Conventional 3D ultrasound techniques are limited in their ability to image rapidly moving biological structures, as the movement can distort or blur the images.

To overcome this challenge, the researchers developed a system that uses a robotic arm to actively track the movements of the tissue being imaged. As the tissue moves, the robotic arm adjusts the position of the ultrasound probe to compensate, allowing the 3D imaging to maintain sharp focus and clarity even during large tissue displacements.

This "4D ultrasound-guided robotic tracking" technique enables a new type of 3D ultrasound imaging called "localization microscopy," which can resolve incredibly fine structural details within the moving tissue. The researchers demonstrated the capability of their system to image complex biological structures, such as the beating heart, with unprecedented resolution and clarity.

The ability to visualize dynamic biological processes at high resolution has many potential applications, such as [link to related research on transcranial 3D ultrasound localization microscopy] monitoring tumor growth, [link to related research on enhancing super-resolution ultrasound localization] studying the development of organs and tissues, and [link to related research on deep learning super-resolution ultrasound imaging] diagnosing various medical conditions.

Technical Explanation

The key innovation in this paper is the use of a robotic arm to actively track and compensate for large tissue movements during 3D ultrasound imaging. Conventional 3D ultrasound techniques are limited in their ability to image rapidly moving biological structures, as the movement can distort or blur the images.

To address this limitation, the researchers developed a system that integrates a robotic arm with a 3D ultrasound imaging system. The robotic arm is programmed to track the movements of the tissue being imaged and adjust the position of the ultrasound probe in real-time to compensate for the tissue's displacement. This "4D ultrasound-guided robotic tracking" technique enables the 3D ultrasound imaging to maintain sharp focus and clarity even during large tissue displacements.

The researchers then used this system to perform 3D ultrasound localization microscopy, a technique that can resolve incredibly fine structural details within the moving tissue. By combining the robotic tracking with advanced image processing algorithms, the researchers were able to achieve sub-wavelength resolution imaging of complex biological structures, such as the beating heart.

The researchers demonstrated the capabilities of their system through a series of experiments, including imaging the beating heart of a living animal and tracking the growth of a tumor over time. The results showed that the 4D ultrasound-guided robotic tracking system could capture high-resolution 3D images of dynamic biological processes with unprecedented clarity and detail.

Critical Analysis

One of the key strengths of this research is the practical application of the 4D ultrasound-guided robotic tracking system to enable high-resolution 3D imaging of complex, moving biological structures. The ability to maintain sharp focus and clarity during large tissue displacements is a significant advancement over conventional 3D ultrasound techniques.

However, the paper does not address some potential limitations of the system. For example, the researchers do not discuss the scalability of the robotic tracking system, nor do they explore the feasibility of integrating it into clinical workflows. [link to related research on data-driven imaging geometric recovery] Additionally, the paper does not delve into the potential challenges of translating this technology from animal studies to human patients, such as differences in tissue properties or anatomical variations.

Further research would be needed to address these limitations and explore the broader implications of this technology for medical imaging and diagnosis. For example, [link to related research on towards transcranial 3D ultrasound localization microscopy] the ability to image the brain with high resolution could have significant applications in neuroscience and neurological disease research.

Conclusion

The research presented in this paper represents a significant advancement in 3D ultrasound imaging, with the development of a 4D ultrasound-guided robotic tracking system that enables high-resolution localization microscopy of dynamic biological processes. By actively compensating for large tissue movements, this system opens up new possibilities for visualizing the complex structures and functions of the human body in unprecedented detail.

While the paper demonstrates the impressive capabilities of this technology, further research is needed to address potential limitations and explore its broader clinical applications. Nevertheless, the innovative approach and promising results highlighted in this work suggest that 4D ultrasound-guided robotic tracking could have a transformative impact on medical imaging and our understanding of the human body.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements
Total Score

0

New!Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements

Jipeng Yan, Shusei Kawara, Qingyuan Tan, Jingwen Zhu, Bingxue Wang, Matthieu Toulemonde, Honghai Liu, Ying Tan, Meng-Xing Tang

Super-Resolution Ultrasound (SRUS) imaging through localising and tracking microbubbles, also known as Ultrasound Localisation Microscopy (ULM), has demonstrated significant potential for reconstructing microvasculature and flows with sub-diffraction resolution in clinical diagnostics. However, imaging organs with large tissue movements, such as those caused by respiration, presents substantial challenges. Existing methods often require breath holding to maintain accumulation accuracy, which limits data acquisition time and ULM image saturation. To improve image quality in the presence of large tissue movements, this study introduces an approach integrating high-frame-rate ultrasound with online precise robotic probe control. Tested on a microvasculature phantom with translation motions up to 20 mm, twice the aperture size of the matrix array used, our method achieved real-time tracking of the moving phantom and imaging volume rate at 85 Hz, keeping majority of the target volume in the imaging field of view. ULM images of the moving cross channels in the phantom were successfully reconstructed in post-processing, demonstrating the feasibility of super-resolution imaging under large tissue motions. This represents a significant step towards ULM imaging of organs with large motion.

Read more

9/18/2024

Towards Transcranial 3D Ultrasound Localization Microscopy of the Nonhuman Primate Brain
Total Score

0

Towards Transcranial 3D Ultrasound Localization Microscopy of the Nonhuman Primate Brain

Paul Xing, Vincent Perrot, Adan Ulises Dominguez-Vargas, Stephan Quessy, Numa Dancause, Jean Provost

Hemodynamic changes occur in stroke and neurodegenerative diseases. Developing imaging techniques allowing the in vivo visualization and quantification of cerebral blood flow would help better understand the underlying mechanism of those cerebrovascular diseases. 3D ultrasound localization microscopy (ULM) is a novel technology that can map the microvasculature of the brain at large depth and has been mainly used until now in rodents. Here, we demonstrated the feasibility of 3D ULM of the nonhuman primate (NHP) brain with a single 256-channels programmable ultrasound scanner. We achieved a highly resolved vascular map of the macaque brain at large depth in presence of craniotomy and durectomy using an 8-MHz multiplexed matrix probe. We were able to distinguish vessels as small as 26.9 {mu}m. We also demonstrated that transcranial imaging of the macaque brain at similar depth was feasible using a 3-MHz probe and achieved a resolution of 60.4 {mu}m. This work paves the way to clinical application of 3D ULM.

Read more

4/5/2024

👨‍🏫

Total Score

0

Enhancing super-resolution ultrasound localisation through multi-frame deconvolution exploiting spatiotemporal coherence

Su Yan, Clotilde Vi'e, Marcelo Lerendegui, Herman Verinaz-Jadan, Jipeng Yan, Martina Tashkova, James Burn, Bingxue Wang, Gary Frost, Kevin G. Murphy, Meng-Xing Tang

Super-resolution ultrasound imaging through microbubble (MB) localisation and tracking, also known as ultrasound localisation microscopy, allows non-invasive sub-diffraction resolution imaging of microvasculature in animals and humans. The number of MBs localised from the acquired contrast-enhanced ultrasound (CEUS) images and the localisation precision directly influence the quality of the resulting super-resolution microvasculature images. However, non-negligible noise present in the CEUS images can make localising MBs challenging. To enhance the MB localisation performance, we propose a Multi-Frame Deconvolution (MF-Decon) framework that can exploit the spatiotemporal coherence inherent in the CEUS data, with new spatial and temporal regularisers designed based on total variation (TV) and regularisation by denoising (RED). Based on the MF-Decon framework, we introduce two novel methods: MF-Decon with spatial and temporal TVs (MF-Decon+3DTV) and MF-Decon with spatial RED and temporal TV (MF-Decon+RED+TV). Results from in silico simulations indicate that our methods outperform two widely used methods using deconvolution or normalised cross-correlation across all evaluation metrics, including precision, recall, $F_1$ score, mean and standard localisation errors. In particular, our methods improve MB localisation precision by up to 39% and recall by up to 12%. Super-resolution microvasculature maps generated with our methods on a publicly available in vivo rat brain dataset show less noise, better contrast, higher resolution and more vessel structures.

Read more

7/10/2024

🤿

Total Score

0

Deep Learning for Super-resolution Ultrasound Imaging with Spatiotemporal Data

Arthur David Redfern, Katherine G. Brown

Super-resolution ultrasound imaging (SRUS) is an active area of research as it brings up to a ten-fold improvement in the resolution of microvascular structures. The limitations to the clinical adoption of SRUS include long acquisition times and long image processing times. Both these limitations can be alleviated with deep learning approaches to the processing of SRUS images. In this study we propose an optimized architecture based on modern improvements to convolutional neural networks from the ConvNeXt architecture and further customize the choice of features to improve performance on the specific tasks of both MB detection and localization within a single network. We employ a spatiotemporal input of up to five successive image frames to increase the number of MBs detected. The output structure produces three classifications: a MB detection Boolean for each pixel in the central image frame, as well as x and z offsets at 4-fold subpixel resolution for each MB detected. Ultrasound simulations generated images based on the L22-14v transducer (Verasonics) for training and testing of the proposed SRUS-ConvNeXt network. In vivo image data of a mouse brain was used as further validation of the architecture. The proposed network had the highest performance as measured by F1 score when configured for a 3-frame spatiotemporal input. The smallest localization error of {lambda}/22 was achieved when the network was configured for a single input frame. The flexibility of the proposed architecture allows extension to 10-fold upscaling for SRUS images with a much lower impact to number of parameters and subsequent increase in inference time than typical U-Net style approaches. This network is promising in the quest to develop a SRUS deep network architecture for real time image formation.

Read more

8/5/2024