High-precision surgical navigation using speckle structured light-based thoracoabdominal puncture robot

Read original: arXiv:2406.06478 - Published 6/11/2024 by Zezhao Guo, Yanzhong Guo, Zhanfang Zhao
Total Score

0

⚙️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper presents a new method for robotic surgical navigation that uses a speckle structured light camera to identify and track the patient's body surface.
  • The traditional reflective ball tracking method is challenging to apply on the irregular and smooth chest and abdomen surfaces, which have fluctuations due to breathing.
  • The proposed method uses a positioning recognition ring that can be well imaged under CT, allowing for integration of optical body surface tracking with in vivo imaging positioning.

Plain English Explanation

The paper describes a new way to help robots perform medical procedures more accurately. During some operations, doctors use robots to insert needles into the patient's body. The point where the needle goes in is on the chest or abdomen, which can be hard to track precisely.

The traditional method uses reflective balls attached to the skin, but this doesn't work well on the smooth, irregular chest and stomach area that changes shape as the patient breathes. Instead, the researchers developed a system that uses a special camera to map the 3D shape of the patient's body surface.

This camera projects a pattern of tiny speckles onto the skin and analyzes how they distort to create a detailed 3D model. The model is then fitted into a hollow ring that can be tracked with high precision, down to fractions of a millimeter.

The key benefit is that this 3D body mapping can be combined with CT scans of the patient's internal anatomy. This allows the robot to precisely align the external body surface with the hidden internal structures, enabling more accurate needle placement during procedures. The system can track motion in all six degrees of freedom (up/down, front/back, left/right, plus rotations) with sub-millimeter accuracy.

Technical Explanation

The paper presents a novel method for robotic surgical navigation that uses a speckle structured light camera to identify and fit the patient's body surface into a hollow positioning recognition ring. This approach differs from previous reflective ball optical markers or magnetic positioning techniques, which struggle to reliably track the irregular, smooth chest and abdomen surfaces that exhibit breathing-induced fluctuations.

The key innovation is using the speckle camera to create a 3D model of the body surface that can be precisely fitted into a 24mm diameter ring. Experimental results show this method achieves positioning accuracies between 0.033-0.563mm at 7-30 frames per second. Crucially, the ring material can be well imaged under CT scans, enabling the optical body surface tracking to be integrated with in vivo imaging positioning.

This allows the system to establish a unified coordinate system between the patient's internal and external anatomy, facilitating more accurate registration and needle placement during robotic puncture surgeries. The 6-degree-of-freedom motion sensing with sub-millimeter precision has broad application prospects for future autonomous ultrasound-guided procedures and cartilage segmentation.

Critical Analysis

The paper presents a promising new approach to robotic surgical navigation that addresses key limitations of existing methods. The use of a speckle structured light camera to create a detailed 3D model of the body surface is an innovative solution to the challenge of tracking irregular, deformable anatomy.

However, the paper does not provide much insight into the robustness of the system to factors like patient movement, clothing, or varying lighting conditions. It would be helpful to understand how the system might perform in real-world clinical settings beyond the controlled experimental setup described.

Additionally, the paper does not discuss the potential clinical workflow implications of integrating the optical body tracking with CT imaging. Practical considerations like radiation exposure, ease of use, and compatibility with existing surgical planning and navigation systems could be important factors in the real-world adoption of this technology.

Overall, the technical approach seems promising, but further research is needed to assess the system's performance, usability, and integration with existing clinical workflows and imaging modalities.

Conclusion

This paper presents a novel robotic surgical navigation method that uses a speckle structured light camera to precisely map and track the patient's body surface. By fitting this 3D body model into a hollow ring that can be imaged by CT scans, the system enables tight integration of external optical tracking with internal anatomical imaging.

The key benefits are improved accuracy for procedures like needle insertions, as well as the potential to expand the capabilities of autonomous robotic surgery systems. With sub-millimeter precision across six degrees of freedom, this technology could unlock new opportunities for advanced ultrasound-guided procedures and automated cartilage segmentation.

While further research is needed to assess real-world performance and clinical workflow integration, this innovative approach represents an exciting advance in the field of image-guided robotic surgery.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

⚙️

Total Score

0

High-precision surgical navigation using speckle structured light-based thoracoabdominal puncture robot

Zezhao Guo, Yanzhong Guo, Zhanfang Zhao

Abstract Background During percutaneous puncture robotic surgical navigation, the needle insertion point is positioned on the patient's chest and abdomen body surface. By locating any point on the soft skin tissue, it is difficult to apply the traditional reflective ball tracking method. The patient's chest and abdomen body surface has fluctuations in breathing and appears irregular. The chest and abdomen are regular and smooth, lacking obvious features, and it is challenging to locate the needle insertion point on the body surface. Methods This paper designs and experiments a method that is different from previous reflective ball optical markers or magnetic positioning surgical navigation and tracking methods. It is based on a speckle structured light camera to identify the patient's body surface and fit it into a hollow ring with a diameter of 24mm. Results Experimental results show that this method of the system can be small, flexible, and high-precision positioning of any body surface point at multiple angles, achieving a positioning accuracy of 0.033-0.563mm and an image of 7-30 frames/s. Conclusions The positioning recognition ring material used in this method can be well imaged under CT, so the optical positioning of the body surface and the in vivo imaging positioning under CT can be combined to form a unified patient's internal and external positioning world coordinates to achieve internal and external registration. Positioning integration. The system senses motion with six degrees of freedom, up and down, front and back, left and right, and all rotations, with sub-millimeter accuracy, and has broad application prospects in future puncture surgeries.

Read more

6/11/2024

👁️

Total Score

0

A Fourier-enhanced multi-modal 3D small object optical mark recognition and positioning method for percutaneous abdominal puncture surgical navigation

Zezhao Guo (College of information and Engineering, Hebei GEO University), Yanzhong Guo (Beijing Yingrui Pioneer Medical Technology Co., Ltd), Zhanfang Zhao (College of information and Engineering, Hebei GEO University)

Navigation for thoracoabdominal puncture surgery is used to locate the needle entry point on the patient's body surface. The traditional reflective ball navigation method is difficult to position the needle entry point on the soft, irregular, smooth chest and abdomen. Due to the lack of clear characteristic points on the body surface using structured light technology, it is difficult to identify and locate arbitrary needle insertion points. Based on the high stability and high accuracy requirements of surgical navigation, this paper proposed a novel method, a muti-modal 3D small object medical marker detection method, which identifies the center of a small single ring as the needle insertion point. Moreover, this novel method leverages Fourier transform enhancement technology to augment the dataset, enrich image details, and enhance the network's capability. The method extracts the Region of Interest (ROI) of the feature image from both enhanced and original images, followed by generating a mask map. Subsequently, the point cloud of the ROI from the depth map is obtained through the registration of ROI point cloud contour fitting. In addition, this method employs Tukey loss for optimal precision. The experimental results show this novel method proposed in this paper not only achieves high-precision and high-stability positioning, but also enables the positioning of any needle insertion point.

Read more

4/16/2024

🔗

Total Score

0

Guiding the Last Centimeter: Novel Anatomy-Aware Probe Servoing for Standardized Imaging Plane Navigation in Robotic Lung Ultrasound

Xihan Ma, Mingjie Zeng, Jeffrey C. Hill, Beatrice Hoffmann, Ziming Zhang, Haichong K. Zhang

Navigating the ultrasound (US) probe to the standardized imaging plane (SIP) for image acquisition is a critical but operator-dependent task in conventional freehand diagnostic US. Robotic US systems (RUSS) offer the potential to enhance imaging consistency by leveraging real-time US image feedback to optimize the probe pose, thereby reducing reliance on operator expertise. However, determining the proper approach to extracting generalizable features from the US images for probe pose adjustment remain challenging. In this work, we propose a SIP navigation framework for RUSS, exemplified in the context of robotic lung ultrasound (LUS). This framework facilitates automatic probe adjustment when in proximity to the SIP. This is achieved by explicitly extracting multiple anatomical features presented in real-time LUS images and performing non-patient-specific template matching to generate probe motion towards the SIP using image-based visual servoing (IBVS). This framework is further integrated with the active-sensing end-effector (A-SEE), a customized robot end-effector that leverages patient external body geometry to maintain optimal probe alignment with the contact surface, thus preserving US signal quality throughout the navigation. The proposed approach ensures procedural interpretability and inter-patient adaptability. Validation is conducted through anatomy-mimicking phantom and in-vivo evaluations involving five human subjects. The results show the framework's high navigation precision with the probe correctly located at the SIP for all cases, exhibiting positioning error of under 2 mm in translation and under 2 degree in rotation. These results demonstrate the navigation process's capability to accomondate anatomical variations among patients.

Read more

6/18/2024

Augmented Reality and Human-Robot Collaboration Framework for Percutaneous Nephrolithotomy: System Design, Implementation, and Performance Metrics
Total Score

0

Augmented Reality and Human-Robot Collaboration Framework for Percutaneous Nephrolithotomy: System Design, Implementation, and Performance Metrics

Junling Fu, Matteo Pecorella, Elisa Iovene, Maria Chiara Palumbo, Alberto Rota, Alberto Redaelli, Giancarlo Ferrigno, Elena De Momi

During Percutaneous Nephrolithotomy (PCNL) operations, the surgeon is required to define the incision point on the patient's back, align the needle to a pre-planned path, and perform puncture operations afterward. The procedure is currently performed manually using ultrasound or fluoroscopy imaging for needle orientation, which, however, implies limited accuracy and low reproducibility. This work incorporates Augmented Reality (AR) visualization with an optical see-through head-mounted display (OST-HMD) and Human-Robot Collaboration (HRC) framework to empower the surgeon's task completion performance. In detail, Eye-to-Hand calibration, system registration, and hologram model registration are performed to realize visual guidance. A Cartesian impedance controller is used to guide the operator during the needle puncture task execution. Experiments are conducted to verify the system performance compared with conventional manual puncture procedures and a 2D monitor-based visualisation interface. The results showed that the proposed framework achieves the lowest median and standard deviation error across all the experimental groups, respectively. Furthermore, the NASA-TLX user evaluation results indicate that the proposed framework requires the lowest workload score for task completion compared to other experimental setups. The proposed framework exhibits significant potential for clinical application in the PCNL task, as it enhances the surgeon's perception capability, facilitates collision-free needle insertion path planning, and minimises errors in task completion.

Read more

6/26/2024