Re-expression of manual expertise through semi-automatic control of a teleoperated system

Read original: arXiv:2407.16278 - Published 7/24/2024 by Erwann Landais (AUCTUS), Nasser Rezzoug (RoBioSS), Vincent Padois (AUCTUS)
Total Score

0

🤯

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The chemical industry faces environmental challenges, leading to a search for new solvents.
  • This domain relies heavily on manual, visual inspection tasks by human experts.
  • Protective barriers like fume hoods and gloveboxes can cause postural discomfort over time.
  • Teleoperated robots could alleviate these constraints, but must accurately reproduce the users' expertise.
  • The intuitiveness of the system, including transparency of actions and feedback relevance, is crucial.
  • The extent of rotational movements and task interactivity complicate the problem for industrial robots.

Plain English Explanation

The chemical industry is constantly searching for new, more environmentally-friendly solvents. However, this work often involves manual, visual tasks performed by human experts, who must use protective barriers like fume hoods and gloveboxes. While these safeguards are necessary, they can lead to physical discomfort over time.

One potential solution is to use teleoperated robots to carry out these tasks remotely. This could alleviate the postural issues caused by the protective equipment. But for this to work, the robot system must be able to accurately reproduce the expertise and intuitive motions of the human experts.

The challenge lies in the complex nature of the tasks, which involve a lot of rotational movements and interactive elements. This makes it difficult for industrial robots to both execute the movements and provide transparent, responsive control to the user. Integrating visuo-tactile sensing and haptic feedback could help, but the core problem remains.

The researchers propose an approach that separates the control of the robot's path (the sequence of positions) from the control of the trajectory (the speed and direction of movement along that path). This allows the user to choose a safe, generic path and then modulate the trajectory in real-time. While this limits the interaction possibilities, it may enable the task to be performed effectively through teleoperation.

Technical Explanation

To address the challenges of teleoperated robotic manipulation in the chemical industry, the researchers propose a two-part control scheme. The first part controls the overall path the robot takes, defining a sequence of spatial poses. The second part controls the specific trajectory, including the speed and direction of movement along that path.

This separation of path and trajectory control aims to balance the need for precise, responsive movements with the safety and transparency requirements of the task. By allowing the user to choose a generic, secure path and then modulate the trajectory in real-time, the system can reproduce the manual characteristics of the task without overwhelming the motor capabilities of industrial robots.

To test this hypothesis, the researchers designed an experiment involving a reading task with similar characteristics to the target chemical manipulation application, but with less danger. Participants performed the reading task using different variants of the trajectory modulation control. This allowed the researchers to evaluate the effectiveness of the approach in enabling users to accurately reproduce the desired motions through teleoperation.

Critical Analysis

The researchers acknowledge that their proposed solution, while helpful, still significantly limits the interaction possibilities compared to direct manual manipulation. The extent of rotational movements and the highly interactive nature of the chemical tasks pose ongoing challenges for industrial robot control and transparency.

Additional research may be needed to further improve the fidelity and responsiveness of the teleoperated system, potentially through advances in visuo-tactile sensing, haptic feedback, or vision-based robotic manipulation techniques. Exploring hands-free teleoperation approaches or bilateral teleoperation control may also yield further improvements.

Overall, the researchers have proposed a promising approach to enabling teleoperated robotic manipulation in the chemical industry, but significant challenges remain in fully reproducing the expertise and intuitive control of human experts.

Conclusion

The search for new solvents in the chemical industry is driving the need for improved robotic manipulation capabilities. The researchers have presented a two-part control scheme that separates path and trajectory control to balance the complex requirements of these tasks. While this approach shows promise, further advancements in areas like sensing, feedback, and control will be necessary to fully enable effective teleoperation and alleviate the postural constraints faced by human experts.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤯

Total Score

0

Re-expression of manual expertise through semi-automatic control of a teleoperated system

Erwann Landais (AUCTUS), Nasser Rezzoug (RoBioSS), Vincent Padois (AUCTUS)

While the search for new solvents in the chemical industry is of uttermost importance with respect to environmental considerations, this domain remains strongly tied to highly manual and visual inspection tasks by human experts. As the manipulated chemicals may imply a critical danger (CMR substances), mechanical protection barrier are used (fume hoods, gloveboxes). This, in turn, can induce postural discomfort in the long term. Carrying out this task using a remotely controlled robot to reproduce the desired vial motions would alleviate these postural constraints. Nevertheless, the adoption of such a system will depend on its ability to transcribe the users' expertise. Particular attention must be paid to the intuitiveness of the system : transparency of the actions performed, relevance of the perceptual feedback, etc. and, in particular, the fidelity of the movements performed in relation to the user's commands. However, the extent of the rotational movements to be generated and the task interactivity complicates the problem both from the point of view of the motor capacities of industrial robots and for the transparency/responsiveness of the control.To tackle the problen of guaranteeing a secure and reactive expression of the manual characteristics of this task, we propose to separate the control of movement into two parts: control of the path (set of spatial poses) and of the trajectories associated with this path (speed, direction of travel along the path). The user can then partially control the robot's movements, by choosing the type of generic, secure path and modulating the trajectory performed on this path in real time. Although this drastically limits the possibilities for interaction, we assume that this teleoperated system can enable this type of observation task to be carried out as effectively as for direct manipulation. This hypothesis was tested through an experiment in which a reading task, less dangerous but with similar characteristics to the application task, had to be performed using different variants of trajectory modulation. This experiment consisted in reading words printed on four white capsules (dimensions 6 x 12 mm) placed into cylindrical vials ( dimensions 16 mm x 70 mm). Four randomly selected vials were tested by each variant. Firstly, users had to perform the task via direct handling, then under conditions secured by a protection barrier. Users were then invited to perform the task using different trajectory modulation variants (modulation and passive viewing of a pre-recorded video, modulation of the trajectory of a Franka-Emika Panda robot performing the task in real time in front of a monocular Logitech Brio 4K camera). After each trial of a variant, users evaluate different aspects of this variant (manual and visual performance, ease of use, acceptability of the interface) through a questionnaire. During the trials, various objective criteria are also measured (number and nature of interaction with the interface, time and degree of success in the task). This experiment was carried out with 37 subjects (age : 27$pm$5, 20 females). The data recorded showed that the proportion of successes, as well as the subjects' perceptions of visual performance, comfort of use and acceptability of the interface, were similar and high for all the variants. This suggests that this task is indeed achievable via the proposed interface. However, data also showed that average task completion times when using the trajectory modulation variants were significantly higher than handling by hand variants, which implies that the proposed remote semi-automatic control procedure fails to achieve satisfactory performance regarding execution time. An interface allowing more reactive manipulation of the vial's movements seems necessary, and will be tested in a future experiment.

Read more

7/24/2024

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly
Total Score

0

Human-Robot Interface for Teleoperated Robotized Planetary Sample Collection and Assembly

Lorenzo Pagliara, Vincenzo Petrone, Enrico Ferrentino, Pasquale Chiacchio

As human space exploration evolves toward longer voyages farther from our home planet, in-situ resource utilization (ISRU) becomes increasingly important. Haptic teleoperations are one of the technologies by which such activities can be carried out remotely by humans, whose expertise is still necessary for complex activities. In order to perform precision tasks with effectiveness, the operator must experience ease of use and accuracy. The same features are demanded to reduce the complexity of the training procedures and the associated learning time for operators without a specific background in robotic teleoperations. Haptic teleoperation systems, that allow for a natural feeling of forces, need to cope with the trade-off between accurate movements and workspace extension. Clearly, both of them are required for typical ISRU tasks. In this work, we develop a new concept of operations and suitable human-robot interfaces to achieve sample collection and assembly with ease of use and accuracy. In the proposed operational concept, the teleoperation space is extended by executing automated trajectories, offline planned at the control station. In three different experimental scenarios, we validate the end-to-end system involving the control station and the robotic asset, by assessing the contribution of haptics to mission success, the system robustness to consistent delays, and the ease of training new operators.

Read more

6/14/2024

📈

Total Score

0

Integrating Visuo-tactile Sensing with Haptic Feedback for Teleoperated Robot Manipulation

Noah Becker, Erik Gattung, Kay Hansel, Tim Schneider, Yaonan Zhu, Yasuhisa Hasegawa, Jan Peters

Telerobotics enables humans to overcome spatial constraints and allows them to physically interact with the environment in remote locations. However, the sensory feedback provided by the system to the operator is often purely visual, limiting the operator's dexterity in manipulation tasks. In this work, we address this issue by equipping the robot's end-effector with high-resolution visuotactile GelSight sensors. Using low-cost MANUS-Gloves, we provide the operator with haptic feedback about forces acting at the points of contact in the form of vibration signals. We propose two different methods for estimating these forces; one based on estimating the movement of markers on the sensor surface and one deep-learning approach. Additionally, we integrate our system into a virtual-reality teleoperation pipeline in which a human operator controls both arms of a Tiago robot while receiving visual and haptic feedback. We believe that integrating haptic feedback is a crucial step for dexterous manipulation in teleoperated robotic systems.

Read more

5/1/2024

User-customizable Shared Control for Robot Teleoperation via Virtual Reality
Total Score

0

User-customizable Shared Control for Robot Teleoperation via Virtual Reality

Rui Luo, Mark Zolotas, Drake Moore, Taskin Padir

Shared control can ease and enhance a human operator's ability to teleoperate robots, particularly for intricate tasks demanding fine control over multiple degrees of freedom. However, the arbitration process dictating how much autonomous assistance to administer in shared control can confuse novice operators and impede their understanding of the robot's behavior. To overcome these adverse side-effects, we propose a novel formulation of shared control that enables operators to tailor the arbitration to their unique capabilities and preferences. Unlike prior approaches to customizable shared control where users could indirectly modify the latent parameters of the arbitration function by issuing a feedback command, we instead make these parameters observable and directly editable via a virtual reality (VR) interface. We present our user-customizable shared control method for a teleoperation task in SE(3), known as the buzz wire game. A user study is conducted with participants teleoperating a robotic arm in VR to complete the game. The experiment spanned two weeks per subject to investigate longitudinal trends. Our findings reveal that users allowed to interactively tune the arbitration parameters across trials generalize well to adaptations in the task, exhibiting improvements in precision and fluency over direct teleoperation and conventional shared control.

Read more

8/15/2024