Haptic-Based Bilateral Teleoperation of Aerial Manipulator for Extracting Wedged Object with Compensation of Human Reaction Time

Read original: arXiv:2405.01361 - Published 5/3/2024 by Jeonghyun Byun, Dohyun Eom, H. Jin Kim
Total Score

0

Haptic-Based Bilateral Teleoperation of Aerial Manipulator for Extracting Wedged Object with Compensation of Human Reaction Time

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a haptic-based bilateral teleoperation system for an aerial manipulator to extract a wedged object.
  • The system compensates for human reaction time to improve performance and safety.
  • Experiments were conducted to evaluate the effectiveness of the proposed approach.

Plain English Explanation

The paper describes a robotic system that can be controlled remotely using touch-based feedback. The robot is designed to operate in the air and can manipulate objects, specifically ones that are stuck or wedged in place.

To make the remote control more effective, the system accounts for the natural delay in a human's reaction time. This helps the robot respond to the user's commands more smoothly and precisely, which is important for safely extracting the wedged object.

Experiments were carried out to test the capabilities of this haptic-based link to "Integrating Visuo-Tactile Sensing and Haptic Feedback for Teleoperated Robotic Systems" teleoperation system. The results demonstrate the system's ability to effectively control the aerial manipulator and extract the wedged object.

Technical Explanation

The paper describes a haptic-based bilateral teleoperation system for an aerial manipulator that can be used to extract a wedged object. The system incorporates a compensation mechanism to account for human reaction time, which is a critical factor in ensuring safe and effective remote control.

The aerial manipulator is equipped with force sensors that provide haptic feedback to the human operator. This allows the operator to feel the forces encountered by the manipulator during the extraction process. To enhance the system's responsiveness, a reaction time compensation algorithm is implemented. This algorithm predicts the human operator's reaction time and adjusts the control commands accordingly, improving the synchronization between the operator's inputs and the manipulator's actions.

Experiments were conducted to evaluate the performance of the proposed system. The results demonstrate the system's ability to effectively control the aerial manipulator and extract the wedged object, with the reaction time compensation mechanism improving the overall system performance and safety.

Critical Analysis

The paper presents a novel approach to addressing the challenges of remote control for aerial manipulators, particularly in the context of extracting wedged objects. The incorporation of haptic feedback and reaction time compensation is a promising strategy to enhance the operator's situational awareness and improve the overall system's responsiveness and safety.

However, the paper does not provide extensive details on the specific algorithms and techniques used for the reaction time compensation. Additionally, the experiments are limited in scope, and further testing in more complex and realistic scenarios would be needed to fully assess the system's capabilities and limitations.

It would also be valuable to explore the potential integration of this system with other technologies, such as link to "Safe Haptic Teleoperations of Admittance-Controlled Robots with Virtualization", to further enhance the system's robustness and versatility.

Conclusion

The paper presents a haptic-based bilateral teleoperation system for an aerial manipulator that can effectively extract wedged objects. The system's key innovation is the incorporation of a reaction time compensation mechanism, which helps to improve the system's responsiveness and safety.

The experimental results demonstrate the effectiveness of the proposed approach, suggesting its potential for applications in various domains, such as link to "Bimanual Teleoperation Framework for a Light-Duty Underwater Vehicle" or link to "Intuitive Telemanipulation of Hyper-Redundant Snake Robots within Confined Spaces". Further research and development in this area could lead to more advanced robotic systems capable of safely and effectively operating in complex environments.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Haptic-Based Bilateral Teleoperation of Aerial Manipulator for Extracting Wedged Object with Compensation of Human Reaction Time
Total Score

0

Haptic-Based Bilateral Teleoperation of Aerial Manipulator for Extracting Wedged Object with Compensation of Human Reaction Time

Jeonghyun Byun, Dohyun Eom, H. Jin Kim

Bilateral teleoperation of an aerial manipulator facilitates the execution of industrial missions thanks to the combination of the aerial platform's maneuverability and the ability to conduct complex tasks with human supervision. Heretofore, research on such operations has focused on flying without any physical interaction or exerting a pushing force on a contact surface that does not involve abrupt changes in the interaction force. In this paper, we propose a human reaction time compensating haptic-based bilateral teleoperation strategy for an aerial manipulator extracting a wedged object from a static structure (i.e., plug-pulling), which incurs an abrupt decrease in the interaction force and causes additional difficulty for an aerial platform. A haptic device composed of a 4-degree-of-freedom robotic arm and a gripper is made for the teleoperation of aerial wedged object-extracting tasks, and a haptic-based teleoperation method to execute the aerial manipulator by the haptic device is introduced. We detect the extraction of the object by the estimation of the external force exerted on the aerial manipulator and generate reference trajectories for both the aerial manipulator and the haptic device after the extraction. As an example of the extraction of a wedged object, we conduct comparative plug-pulling experiments with a quadrotor-based aerial manipulator. The results validate that the proposed bilateral teleoperation method reduces the overshoot in the aerial manipulator's position and ensures fast recovery to its initial position after extracting the wedged object.

Read more

5/3/2024

Safe haptic teleoperations of admittance controlled robots with virtualization of the force feedback
Total Score

0

Safe haptic teleoperations of admittance controlled robots with virtualization of the force feedback

Lorenzo Pagliara, Enrico Ferrentino, Andrea Chiacchio, Giovanni Russo

Haptic teleoperations play a key role in extending human capabilities to perform complex tasks remotely, employing a robotic system. The impact of haptics is far-reaching and can improve the sensory awareness and motor accuracy of the operator. In this context, a key challenge is attaining a natural, stable and safe haptic human-robot interaction. Achieving these conflicting requirements is particularly crucial for complex procedures, e.g. medical ones. To address this challenge, in this work we develop a novel haptic bilateral teleoperation system (HBTS), featuring a virtualized force feedback, based on the motion error generated by an admittance controlled robot. This approach allows decoupling the force rendering system from the control of the interaction: the rendered force is assigned with the desired dynamics, while the admittance control parameters are separately tuned to maximize interaction performance. Furthermore, recognizing the necessity to limit the forces exerted by the robot on the environment, to ensure a safe interaction, we embed a saturation strategy of the motion references provided by the haptic device to admittance control. We validate the different aspects of the proposed HBTS, through a teleoperated blackboard writing experiment, against two other architectures. The results indicate that the proposed HBTS improves the naturalness of teleoperation, as well as safety and accuracy of the interaction.

Read more

4/12/2024

📈

Total Score

0

Integrating Visuo-tactile Sensing with Haptic Feedback for Teleoperated Robot Manipulation

Noah Becker, Erik Gattung, Kay Hansel, Tim Schneider, Yaonan Zhu, Yasuhisa Hasegawa, Jan Peters

Telerobotics enables humans to overcome spatial constraints and allows them to physically interact with the environment in remote locations. However, the sensory feedback provided by the system to the operator is often purely visual, limiting the operator's dexterity in manipulation tasks. In this work, we address this issue by equipping the robot's end-effector with high-resolution visuotactile GelSight sensors. Using low-cost MANUS-Gloves, we provide the operator with haptic feedback about forces acting at the points of contact in the form of vibration signals. We propose two different methods for estimating these forces; one based on estimating the movement of markers on the sensor surface and one deep-learning approach. Additionally, we integrate our system into a virtual-reality teleoperation pipeline in which a human operator controls both arms of a Tiago robot while receiving visual and haptic feedback. We believe that integrating haptic feedback is a crucial step for dexterous manipulation in teleoperated robotic systems.

Read more

5/1/2024

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly
Total Score

0

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly

Lorenzo Pagliara, Vincenzo Petrone, Enrico Ferrentino, Pasquale Chiacchio

As human space exploration evolves toward longer voyages farther from our home planet, in-situ resource utilization (ISRU) becomes increasingly important. Haptic teleoperations are one of the technologies by which such activities can be carried out remotely by humans, whose expertise is still necessary for complex activities. In order to perform precision tasks with effectiveness, the operator must experience ease of use and accuracy. The same features are demanded to reduce the complexity of the training procedures and the associated learning time for operators without a specific background in robotic teleoperations. Haptic teleoperation systems, that allow for a natural feeling of forces, need to cope with the trade-off between accurate movements and workspace extension. Clearly, both of them are required for typical ISRU tasks. In this work, we develop a new concept of operations and suitable human-robot interfaces to achieve sample collection and assembly with ease of use and accuracy. In the proposed operational concept, the teleoperation space is extended by executing automated trajectories, offline planned at the control station. In three different experimental scenarios, we validate the end-to-end system involving the control station and the robotic asset, by assessing the contribution of haptics to mission success, the system robustness to consistent delays, and the ease of training new operators.

Read more

6/14/2024