Safe haptic teleoperations of admittance controlled robots with virtualization of the force feedback

2404.07672

YC

0

Reddit

0

Published 4/12/2024 by Lorenzo Pagliara, Enrico Ferrentino, Andrea Chiacchio, Giovanni Russo
Safe haptic teleoperations of admittance controlled robots with virtualization of the force feedback

Abstract

Haptic teleoperations play a key role in extending human capabilities to perform complex tasks remotely, employing a robotic system. The impact of haptics is far-reaching and can improve the sensory awareness and motor accuracy of the operator. In this context, a key challenge is attaining a natural, stable and safe haptic human-robot interaction. Achieving these conflicting requirements is particularly crucial for complex procedures, e.g. medical ones. To address this challenge, in this work we develop a novel haptic bilateral teleoperation system (HBTS), featuring a virtualized force feedback, based on the motion error generated by an admittance controlled robot. This approach allows decoupling the force rendering system from the control of the interaction: the rendered force is assigned with the desired dynamics, while the admittance control parameters are separately tuned to maximize interaction performance. Furthermore, recognizing the necessity to limit the forces exerted by the robot on the environment, to ensure a safe interaction, we embed a saturation strategy of the motion references provided by the haptic device to admittance control. We validate the different aspects of the proposed HBTS, through a teleoperated blackboard writing experiment, against two other architectures. The results indicate that the proposed HBTS improves the naturalness of teleoperation, as well as safety and accuracy of the interaction.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a method for safe haptic teleoperation of admittance-controlled robots with virtualization of force feedback.
  • The proposed approach aims to improve the safety and stability of remote robot control by leveraging an admittance control framework and a virtual environment for force feedback.

Plain English Explanation

In this research, the authors developed a new way to remotely control robots in a safe and stable manner. Typically, when operating a robot from a distance, the operator relies on force feedback - feeling the forces the robot experiences - to guide their actions. However, this can be challenging and lead to instability.

The researchers addressed this by using an admittance control approach, which allows the robot to respond more naturally to the operator's commands. Additionally, they created a virtual environment to provide the force feedback, rather than directly transmitting the forces from the physical robot.

This combination of admittance control and virtualized force feedback helps to improve the safety and stability of the teleoperation, making it easier for the operator to control the robot remotely without worrying about losing control or damaging the robot or its surroundings.

Technical Explanation

The core of the proposed approach is an admittance control framework, which allows the robot to behave more like a compliant object that responds naturally to the operator's inputs. This is in contrast to the more common impedance control, where the robot acts more like a rigid object.

To provide the operator with force feedback, the researchers created a virtual environment that simulates the interaction between the robot and its surroundings. This virtual force feedback is then transmitted to the operator's haptic device, allowing them to feel the forces without directly coupling the operator and the physical robot.

The researchers conducted experiments to validate their approach, demonstrating improved stability and safety compared to traditional teleoperation methods. The results suggest that this combined admittance control and virtualized force feedback approach can enhance the operator's ability to control the robot remotely while mitigating the risks of instability and potential damage.

Critical Analysis

The authors acknowledge that their approach relies on an accurate simulation of the robot's interactions within the virtual environment. If there are discrepancies between the virtual model and the physical reality, the force feedback provided to the operator may not accurately reflect the actual forces experienced by the robot. This could potentially lead to unexpected behaviors or loss of control.

Additionally, the paper does not extensively discuss the computational requirements or latency implications of the virtualized force feedback approach. In a real-time teleoperation scenario, any significant delays or lags in the force feedback could compromise the operator's ability to effectively control the robot.

Further research could explore methods to improve the fidelity of the virtual environment, as well as investigate strategies to minimize latency and ensure reliable, high-performance force feedback transmission. Integrating awareness-augmented telepresence capabilities could also enhance the operator's situational understanding and decision-making during remote robot control.

Conclusion

This paper presents a novel approach to improving the safety and stability of haptic teleoperation of admittance-controlled robots. By combining admittance control with a virtualized force feedback system, the researchers have developed a method that can enhance the operator's ability to control the robot remotely while mitigating the risks associated with traditional teleoperation.

While the approach shows promise, further research is needed to address potential limitations, such as the fidelity of the virtual environment and the latency of force feedback transmission. Nonetheless, this work represents an important step towards more reliable and intuitive remote robot control, with potential applications in various domains, from industrial automation to surgical robotics.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly

Lorenzo Pagliara, Vincenzo Petrone, Enrico Ferrentino, Pasquale Chiacchio

YC

0

Reddit

0

As human space exploration evolves toward longer voyages farther from our home planet, in-situ resource utilization (ISRU) becomes increasingly important. Haptic teleoperations are one of the technologies by which such activities can be carried out remotely by humans, whose expertise is still necessary for complex activities. In order to perform precision tasks with effectiveness, the operator must experience ease of use and accuracy. The same features are demanded to reduce the complexity of the training procedures and the associated learning time for operators without a specific background in robotic teleoperations. Haptic teleoperation systems, that allow for a natural feeling of forces, need to cope with the trade-off between accurate movements and workspace extension. Clearly, both of them are required for typical ISRU tasks. In this work, we develop a new concept of operations and suitable human-robot interfaces to achieve sample collection and assembly with ease of use and accuracy. In the proposed operational concept, the teleoperation space is extended by executing automated trajectories, offline planned at the control station. In three different experimental scenarios, we validate the end-to-end system involving the control station and the robotic asset, by assessing the contribution of haptics to mission success, the system robustness to consistent delays, and the ease of training new operators.

Read more

6/14/2024

šŸ“ˆ

Integrating Visuo-tactile Sensing with Haptic Feedback for Teleoperated Robot Manipulation

Noah Becker, Erik Gattung, Kay Hansel, Tim Schneider, Yaonan Zhu, Yasuhisa Hasegawa, Jan Peters

YC

0

Reddit

0

Telerobotics enables humans to overcome spatial constraints and allows them to physically interact with the environment in remote locations. However, the sensory feedback provided by the system to the operator is often purely visual, limiting the operator's dexterity in manipulation tasks. In this work, we address this issue by equipping the robot's end-effector with high-resolution visuotactile GelSight sensors. Using low-cost MANUS-Gloves, we provide the operator with haptic feedback about forces acting at the points of contact in the form of vibration signals. We propose two different methods for estimating these forces; one based on estimating the movement of markers on the sensor surface and one deep-learning approach. Additionally, we integrate our system into a virtual-reality teleoperation pipeline in which a human operator controls both arms of a Tiago robot while receiving visual and haptic feedback. We believe that integrating haptic feedback is a crucial step for dexterous manipulation in teleoperated robotic systems.

Read more

5/1/2024

MoveTouch: Robotic Motion Capturing System with Wearable Tactile Display to Achieve Safe HRI

MoveTouch: Robotic Motion Capturing System with Wearable Tactile Display to Achieve Safe HRI

Ali Alabbas, Miguel Altamirano Cabrera, Mohamed Sayed, Oussama Alyounes, Qian Liu, Dzmitry Tsetserukou

YC

0

Reddit

0

The collaborative robot market is flourishing as there is a trend towards simplification, modularity, and increased flexibility on the production line. But when humans and robots are collaborating in a shared environment, the safety of humans should be a priority. We introduce a novel wearable robotic system to enhance safety during Human Robot Interaction (HRI). The proposed wearable robot is designed to hold a fiducial marker and maintain its visibility to the tracking system, which, in turn, localizes the user's hand with good accuracy and low latency and provides haptic feedback on the user's wrist. The haptic feedback guides the user's hand movement during collaborative tasks in order to increase safety and enhance collaboration efficiency. A user study was conducted to assess the recognition and discriminability of ten designed haptic patterns applied to the volar and dorsal parts of the user's wrist. As a result, four patterns with a high recognition rate were chosen to be incorporated into our system. A second experiment was carried out to evaluate the system integration into real-world collaborative tasks.

Read more

5/9/2024

Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Advancing Robotic Surgery: Affordable Kinesthetic and Tactile Feedback Solutions for Endotrainers

Bharath Rajiv Nair, Aravinthkumar T., B. Vinod

YC

0

Reddit

0

The proliferation of robot-assisted minimally invasive surgery highlights the need for advanced training tools such as cost-effective robotic endotrainers. Current surgical robots often lack haptic feedback, which is crucial for providing surgeons with a real-time sense of touch. This absence can impact the surgeon's ability to perform delicate operations effectively. To enhance surgical training and address this deficiency, we have integrated a cost-effective haptic feedback system into a robotic endotrainer. This system incorporates both kinesthetic (force) and tactile feedback, improving the fidelity of surgical simulations and enabling more precise control during operations. Our system incorporates an innovative, cost-effective Force/Torque sensor utilizing optoelectronic technology, specifically designed to accurately detect forces and moments exerted on surgical tools with a 95% accuracy, providing essential kinesthetic feedback. Additionally, we implemented a tactile feedback mechanism that informs the surgeon of the gripping forces between the tool's tip and the tissue. This dual feedback system enhances the fidelity of training simulations and the execution of robotic surgeries, promoting broader adoption and safer practices.

Read more

6/27/2024