Simultaneous Estimation of Shape and Force along Highly Deformable Surgical Manipulators Using Sparse FBG Measurement

Read original: arXiv:2404.16952 - Published 4/29/2024 by Yiang Lu, Bin Li, Wei Chen, Junyan Yan, Shing Shin Cheng, Jiangliu Wang, Jianshu Zhou, Qi Dou, Yun-hui Liu
Total Score

0

Simultaneous Estimation of Shape and Force along Highly Deformable Surgical Manipulators Using Sparse FBG Measurement

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a novel approach for simultaneously estimating the shape and force along highly deformable surgical manipulators using sparse fiber Bragg grating (FBG) measurements.
  • The method leverages a physics-based model and machine learning techniques to enable accurate and real-time shape and force estimation, which is crucial for various surgical applications.
  • The proposed FBG-based soft sensing tube design and the associated estimation framework offer a promising solution for enhancing the dexterity and safety of surgical manipulators.

Plain English Explanation

In the field of robotic surgery, there is a growing need for surgical tools that can precisely navigate and interact with delicate tissues and organs. Towards Robotised Palpation for Cancer Detection Through Online Force and Deformation Sensing and Soft E-Textile Sensor Enhanced Deep Learning for Efficient Tumor Boundary Estimation have explored ways to improve the sensing capabilities of surgical manipulators.

This paper introduces a novel approach that uses a sparse array of fiber Bragg grating (FBG) sensors embedded within a soft, deformable tube. These sensors can simultaneously measure the shape and the forces acting on the tube as it navigates through the body. By combining a physics-based model with machine learning techniques, the researchers were able to develop an efficient and accurate estimation framework that can track the tube's shape and the forces it encounters in real-time.

This is a crucial advancement, as it can help surgeons better control and guide the surgical manipulator, improving the dexterity and safety of surgical procedures. The ability to sense and respond to the forces acting on the tool can also enable Hybrid Force-Motion Control with Estimated Surface Normal, allowing the manipulator to adapt its behavior to the surrounding environment.

Technical Explanation

The researchers designed a soft sensing tube that incorporates a sparse array of FBG sensors. FBG sensors are optical fibers that can measure strain by detecting changes in the wavelength of light they transmit. By strategically placing these sensors along the tube, the researchers were able to capture the tube's deformation and the forces acting on it during use.

To estimate the shape and forces from the sparse FBG measurements, the team developed a physics-based model that describes the tube's mechanics. This model was then combined with machine learning techniques, such as Online Elasticity Estimation for Material Sorting Using Standard Robotic Hardware and Physics-Guided Shape from Template for Monocular Video, to enable real-time estimation of the tube's shape and the forces applied to it.

The proposed framework was evaluated through both simulation and experiments, demonstrating its ability to accurately track the shape and forces of the soft sensing tube. The results show the potential of this approach to enhance the dexterity and safety of surgical manipulators, ultimately improving patient outcomes.

Critical Analysis

The researchers have made a significant contribution by developing a novel sensing system and estimation framework for highly deformable surgical manipulators. The use of sparse FBG sensors and the integration of physics-based modeling with machine learning techniques are particularly noteworthy.

However, the paper does not address some potential limitations and areas for further research. For instance, the authors do not discuss the robustness of the system to variations in the tube's material properties or the effects of complex tissue interactions. Additionally, the scalability of the approach to longer or more complex manipulators remains to be explored.

Further research could investigate the integration of this sensing system with advanced control algorithms to enable more sophisticated manipulation capabilities. Exploring the use of additional sensing modalities, such as vision-based methods, could also enhance the robustness and versatility of the system.

Conclusion

This paper presents a promising solution for simultaneously estimating the shape and force along highly deformable surgical manipulators using sparse FBG measurements. The novel sensing tube design and the associated estimation framework offer a significant advancement in enhancing the dexterity and safety of surgical robotics.

The proposed approach has the potential to improve the precision and responsiveness of surgical tools, ultimately leading to better patient outcomes. As the field of robotic surgery continues to evolve, this work serves as an important step forward in developing more intelligent and adaptive surgical manipulators.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Simultaneous Estimation of Shape and Force along Highly Deformable Surgical Manipulators Using Sparse FBG Measurement
Total Score

0

Simultaneous Estimation of Shape and Force along Highly Deformable Surgical Manipulators Using Sparse FBG Measurement

Yiang Lu, Bin Li, Wei Chen, Junyan Yan, Shing Shin Cheng, Jiangliu Wang, Jianshu Zhou, Qi Dou, Yun-hui Liu

Recently, fiber optic sensors such as fiber Bragg gratings (FBGs) have been widely investigated for shape reconstruction and force estimation of flexible surgical robots. However, most existing approaches need precise model parameters of FBGs inside the fiber and their alignments with the flexible robots for accurate sensing results. Another challenge lies in online acquiring external forces at arbitrary locations along the flexible robots, which is highly required when with large deflections in robotic surgery. In this paper, we propose a novel data-driven paradigm for simultaneous estimation of shape and force along highly deformable flexible robots by using sparse strain measurement from a single-core FBG fiber. A thin-walled soft sensing tube helically embedded with FBG sensors is designed for a robotic-assisted flexible ureteroscope with large deflection up to 270 degrees and a bend radius under 10 mm. We introduce and study three learning models by incorporating spatial strain encoders, and compare their performances in both free space and constrained environments with contact forces at different locations. The experimental results in terms of dynamic shape-force sensing accuracy demonstrate the effectiveness and superiority of the proposed methods.

Read more

4/29/2024

Uncertainty-Aware Shape Estimation of a Surgical Continuum Manipulator in Constrained Environments using Fiber Bragg Grating Sensors
Total Score

0

Uncertainty-Aware Shape Estimation of a Surgical Continuum Manipulator in Constrained Environments using Fiber Bragg Grating Sensors

Alexander Schwarz, Arian Mehrfard, Golchehr Amirkhani, Henry Phalen, Justin H. Ma, Robert B. Grupp, Alejandro Martin-Gomez, Mehran Armand

Continuum Dexterous Manipulators (CDMs) are well-suited tools for minimally invasive surgery due to their inherent dexterity and reachability. Nonetheless, their flexible structure and non-linear curvature pose significant challenges for shape-based feedback control. The use of Fiber Bragg Grating (FBG) sensors for shape sensing has shown great potential in estimating the CDM's tip position and subsequently reconstructing the shape using optimization algorithms. This optimization, however, is under-constrained and may be ill-posed for complex shapes, falling into local minima. In this work, we introduce a novel method capable of directly estimating a CDM's shape from FBG sensor wavelengths using a deep neural network. In addition, we propose the integration of uncertainty estimation to address the critical issue of uncertainty in neural network predictions. Neural network predictions are unreliable when the input sample is outside the training distribution or corrupted by noise. Recognizing such deviations is crucial when integrating neural networks within surgical robotics, as inaccurate estimations can pose serious risks to the patient. We present a robust method that not only improves the precision upon existing techniques for FBG-based shape estimation but also incorporates a mechanism to quantify the models' confidence through uncertainty estimation. We validate the uncertainty estimation through extensive experiments, demonstrating its effectiveness and reliability on out-of-distribution (OOD) data, adding an additional layer of safety and precision to minimally invasive surgical robotics.

Read more

5/14/2024

An FBG-based Stiffness Estimation Sensor for In-vivo Diagnostics
Total Score

0

An FBG-based Stiffness Estimation Sensor for In-vivo Diagnostics

Behnam Moradkhani, Pejman Kheradmand, Harshith Jella, Kent K. Yamamoto, Alireza Tofangchi, Patrick J. Codd, Yash Chitalia

In-vivo tissue stiffness identification can be useful in pulmonary fibrosis diagnostics and minimally invasive tumor identification, among many other applications. In this work, we propose a palpation-based method for tissue stiffness estimation that uses a sensorized beam buckled onto the surface of a tissue. Fiber Bragg Gratings (FBGs) are used in our sensor as a shape-estimation modality to get real-time beam shape, even while the device is not visually monitored. A mechanical model is developed to predict the behavior of a buckling beam and is validated using finite element analysis and bench-top testing with phantom tissue samples (made of PDMS and PA-Gel). Bench-top estimations were conducted and the results were compared with the actual stiffness values. Mean RMSE and standard deviation (from the actual stiffnesses) values of 413.86 KPa and 313.82 KPa were obtained. Estimations for softer samples were relatively closer to the actual values. Ultimately, we used the stiffness sensor within a mock concentric tube robot as a demonstration of textit{in-vivo} sensor feasibility. Bench-top trials with and without the robot demonstrate the effectiveness of this unique sensing modality in textit{in-vivo} applications.

Read more

6/3/2024

Single-Fiber Optical Frequency Domain Reflectometry Shape Sensing of Continuum Manipulators with Planar Bending
Total Score

0

Single-Fiber Optical Frequency Domain Reflectometry Shape Sensing of Continuum Manipulators with Planar Bending

Mobina Tavangarifard, Wendy Rodriguez Ovalle, Farshid Alambeigi

To address the challenges associated with shape sensing of continuum manipulators (CMs) using Fiber Bragg Grating (FBG) optical fibers, we feature a unique shape sensing assembly utilizing solely a single Optical Frequency Domain Reflectometry (OFDR) fiber attached to a flat nitinol wire (NiTi). Integrating this easy-to-manufacture unique sensor with a long and soft CM with 170 mm length, we performed different experiments to evaluate its shape reconstruction ability. Results demonstrate phenomenal shape reconstruction accuracy for both C-shape (< 2 mm tip error, < 1.2 mm shape error) and J-shape (< 3.4 mm tip error, < 2.3 mm shape error) experiments.

Read more

5/29/2024