Autonomous Robotic Ultrasound System for Liver Follow-up Diagnosis: Pilot Phantom Study

Read original: arXiv:2405.05787 - Published 5/10/2024 by Tianpeng Zhang (SEAS, Harvard University), Sekeun Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School), Jerome Charton (CAMCA, Massachusetts General Hospital and Harvard Medical School), Haitong Ma (SEAS, Harvard University), Kyungsang Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School) and 4 others
Total Score

0

🤯

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces an autonomous robot ultrasound (US) system for liver follow-up scans in local communities.
  • The system uses 3D US-CT registration and deep learning-based segmentation to precisely map the robot to the target regions in the CT image.
  • This allows the robot to automatically navigate to and scan the target areas, reducing time and costs for healthcare providers and patients.

Plain English Explanation

The researchers have developed a new robotic system that can perform ultrasound scans on patients' livers without a human technician. The system starts with a CT scan that identifies the specific areas of the liver that need to be checked. The proposed framework holds the potential to significantly reduce time and costs for healthcare providers, clinicians, and follow-up patients, thereby addressing the increasing healthcare burden associated with chronic disease in local communities.

The robot then uses this information to locate the correct spots on the patient's body and conduct the ultrasound scan automatically. It does this by first making gentle contact with the patient's skin, then using advanced 3D imaging techniques to precisely map the robot's position to the CT scan. This enables the automatic localization of follow-up targets within the CT image, allowing the robot to navigate precisely to the target's surface.

The system's ability to accurately match the ultrasound images to the CT scan is crucial, as it allows the robot to find the right areas to scan without human guidance. Utilizing 3D US-CT registration and deep learning-based segmentation networks, we can achieve precise imaging of 3D hepatic veins, facilitating accurate coordinate mapping between CT and the robot.

Overall, this automated approach has the potential to save time and resources for both healthcare providers and patients, especially those in local communities who may have limited access to medical services. The proposed framework holds the potential to significantly reduce time and costs for healthcare providers, clinicians, and follow-up patients, thereby addressing the increasing healthcare burden associated with chronic disease in local communities.

Technical Explanation

The paper describes a novel autonomous robot ultrasound (US) system designed for liver follow-up scans in outpatient settings. Given a computed tomography (CT) image with the target regions of interest identified, the system carries out the autonomous follow-up scan in three steps:

  1. Initial robot contact with the patient's surface
  2. Coordinate mapping between the CT image and the robot's position
  3. Targeted US scanning of the areas of interest

Utilizing 3D US-CT registration and deep learning-based segmentation networks, the system can achieve precise imaging of the 3D hepatic veins, facilitating accurate coordinate mapping between the CT image and the robot. This enables the automatic localization of the follow-up targets within the CT image, allowing the robot to navigate precisely to the target's surface.

The evaluation of the ultrasound phantom confirms the quality of the US-CT registration and shows the robot reliably locates the targets in repeated trials. This demonstrates the system's ability to accurately perform the autonomous follow-up scans without human intervention.

Critical Analysis

The paper presents a promising approach to addressing the challenges of follow-up liver scans, particularly in local communities with limited access to medical services. By automating the process, the system has the potential to significantly reduce the time and costs associated with these procedures.

However, the researchers acknowledge that the system has only been tested on a phantom, and further evaluation with real patient data is needed to fully assess its performance and reliability. [Encourage readers to think critically about the research and form their own opinions]

Additionally, the paper does not address potential concerns about patient comfort or acceptance of the robotic system, which could be an important consideration for widespread adoption. [Raise any additional concerns or potential issues with the research that were not addressed in the paper]

Overall, the proposed framework represents an innovative application of robotics and medical imaging technologies to improve healthcare delivery. With further development and testing, this system could potentially make a meaningful impact on the management of chronic liver conditions in local communities.

Conclusion

This paper introduces an autonomous robot ultrasound system that can perform targeted liver scans without the need for a human technician. By using advanced 3D imaging techniques to precisely map the robot's position to a CT scan, the system can automatically navigate to and scan the areas of interest, reducing the time and costs associated with these follow-up procedures.

The proposed framework holds the potential to significantly reduce time and costs for healthcare providers, clinicians, and follow-up patients, thereby addressing the increasing healthcare burden associated with chronic disease in local communities. While further evaluation is needed, this innovative approach represents a promising step towards improving the accessibility and efficiency of healthcare services, particularly in underserved areas.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤯

Total Score

0

Autonomous Robotic Ultrasound System for Liver Follow-up Diagnosis: Pilot Phantom Study

Tianpeng Zhang (SEAS, Harvard University), Sekeun Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School), Jerome Charton (CAMCA, Massachusetts General Hospital and Harvard Medical School), Haitong Ma (SEAS, Harvard University), Kyungsang Kim (CAMCA, Massachusetts General Hospital and Harvard Medical School), Na Li (SEAS, Harvard University), Quanzheng Li (CAMCA, Massachusetts General Hospital and Harvard Medical School)

The paper introduces a novel autonomous robot ultrasound (US) system targeting liver follow-up scans for outpatients in local communities. Given a computed tomography (CT) image with specific target regions of interest, the proposed system carries out the autonomous follow-up scan in three steps: (i) initial robot contact to surface, (ii) coordinate mapping between CT image and robot, and (iii) target US scan. Utilizing 3D US-CT registration and deep learning-based segmentation networks, we can achieve precise imaging of 3D hepatic veins, facilitating accurate coordinate mapping between CT and the robot. This enables the automatic localization of follow-up targets within the CT image, allowing the robot to navigate precisely to the target's surface. Evaluation of the ultrasound phantom confirms the quality of the US-CT registration and shows the robot reliably locates the targets in repeated trials. The proposed framework holds the potential to significantly reduce time and costs for healthcare providers, clinicians, and follow-up patients, thereby addressing the increasing healthcare burden associated with chronic disease in local communities.

Read more

5/10/2024

🎯

Total Score

0

Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning

Huan Xu, Jinlin Wu, Guanglin Cao, Zhen Lei, Zhen Chen, Hongbin Liu

Ultrasound robots are increasingly used in medical diagnostics and early disease screening. However, current ultrasound robots lack the intelligence to understand human intentions and instructions, hindering autonomous ultrasound scanning. To solve this problem, we propose a novel Ultrasound Embodied Intelligence system that equips ultrasound robots with the large language model (LLM) and domain knowledge, thereby improving the efficiency of ultrasound robots. Specifically, we first design an ultrasound operation knowledge database to add expertise in ultrasound scanning to the LLM, enabling the LLM to perform precise motion planning. Furthermore, we devise a dynamic ultrasound scanning strategy based on a textit{think-observe-execute} prompt engineering, allowing LLMs to dynamically adjust motion planning strategies during the scanning procedures. Extensive experiments demonstrate that our system significantly improves ultrasound scan efficiency and quality from verbal commands. This advancement in autonomous medical scanning technology contributes to non-invasive diagnostics and streamlined medical workflows.

Read more

5/2/2024

Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics
Total Score

0

Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics

Huan Xu, Jinlin Wu, Guanglin Cao, Zhen Chen, Zhen Lei, Hongbin Liu

Ultrasonography has revolutionized non-invasive diagnostic methodologies, significantly enhancing patient outcomes across various medical domains. Despite its advancements, integrating ultrasound technology with robotic systems for automated scans presents challenges, including limited command understanding and dynamic execution capabilities. To address these challenges, this paper introduces a novel Ultrasound Embodied Intelligence system that synergistically combines ultrasound robots with large language models (LLMs) and domain-specific knowledge augmentation, enhancing ultrasound robots' intelligence and operational efficiency. Our approach employs a dual strategy: firstly, integrating LLMs with ultrasound robots to interpret doctors' verbal instructions into precise motion planning through a comprehensive understanding of ultrasound domain knowledge, including APIs and operational manuals; secondly, incorporating a dynamic execution mechanism, allowing for real-time adjustments to scanning plans based on patient movements or procedural errors. We demonstrate the effectiveness of our system through extensive experiments, including ablation studies and comparisons across various models, showcasing significant improvements in executing medical procedures from verbal commands. Our findings suggest that the proposed system improves the efficiency and quality of ultrasound scans and paves the way for further advancements in autonomous medical scanning technologies, with the potential to transform non-invasive diagnostics and streamline medical workflows.

Read more

6/19/2024

🔗

Total Score

0

Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound

Xihan Ma, Mingjie Zeng, Jeffrey C. Hill, Beatrice Hoffmann, Ziming Zhang, Haichong K. Zhang

Navigating the ultrasound (US) probe to the standardized imaging plane (SIP) for image acquisition is a critical but operator-dependent task in conventional freehand diagnostic US. Robotic US systems (RUSS) offer the potential to enhance imaging consistency by leveraging real-time US image feedback to optimize the probe pose, thereby reducing reliance on operator expertise. However, determining the proper approach to extracting generalizable features from the US images for probe pose adjustment remain challenging. In this work, we propose a SIP navigation framework for RUSS, exemplified in the context of robotic lung ultrasound (LUS). This framework facilitates automatic probe adjustment when in proximity to the SIP. This is achieved by explicitly extracting multiple anatomical features presented in real-time LUS images and performing non-patient-specific template matching to generate probe motion towards the SIP using image-based visual servoing (IBVS). This framework is further integrated with the active-sensing end-effector (A-SEE), a customized robot end-effector that leverages patient external body geometry to maintain optimal probe alignment with the contact surface, thus preserving US signal quality throughout the navigation. The proposed approach ensures procedural interpretability and inter-patient adaptability. Validation is conducted through anatomy-mimicking phantom and in-vivo evaluations involving five human subjects. The results show the framework's high navigation precision with the probe correctly located at the SIP for all cases, exhibiting positioning error of under 2 mm in translation and under 2 degree in rotation. These results demonstrate the navigation process's capability to accomondate anatomical variations among patients.

Read more

6/18/2024