MoveTouch: Robotic Motion Capturing System with Wearable Tactile Display to Achieve Safe HRI
2405.04899
0
0
Abstract
The collaborative robot market is flourishing as there is a trend towards simplification, modularity, and increased flexibility on the production line. But when humans and robots are collaborating in a shared environment, the safety of humans should be a priority. We introduce a novel wearable robotic system to enhance safety during Human Robot Interaction (HRI). The proposed wearable robot is designed to hold a fiducial marker and maintain its visibility to the tracking system, which, in turn, localizes the user's hand with good accuracy and low latency and provides haptic feedback on the user's wrist. The haptic feedback guides the user's hand movement during collaborative tasks in order to increase safety and enhance collaboration efficiency. A user study was conducted to assess the recognition and discriminability of ten designed haptic patterns applied to the volar and dorsal parts of the user's wrist. As a result, four patterns with a high recognition rate were chosen to be incorporated into our system. A second experiment was carried out to evaluate the system integration into real-world collaborative tasks.
Create account to get full access
Overview
- Proposes a robotic motion capture system called "MoveTouch" with a wearable tactile display to enable safe human-robot interaction (HRI)
- Combines motion capture and haptic feedback to give users a sense of touch and control when interacting with robots
- Aims to improve the safety and effectiveness of HRI by providing users with better awareness and control
Plain English Explanation
The paper describes a new system called "MoveTouch" that combines motion capture and haptic (touch) feedback to enable safer and more effective human-robot interaction (HRI). The key idea is to give users a sense of touch and control when interacting with robots, which can improve safety and effectiveness.
The MoveTouch system uses wearable sensors to track the user's movements and a tactile display to provide haptic feedback. This allows the user to feel and control the robot more intuitively, unlike traditional teleoperation systems. The researchers tested the system with various tasks and found it improved user performance and reduced the risk of collisions compared to using a robot without haptic feedback.
Technical Explanation
The core of the MoveTouch system is the integration of motion capture and haptic feedback. The user wears a set of inertial measurement units (IMUs) that track their body movements in real-time. This motion data is then used to control a robot in a teleoperation scenario.
To provide haptic feedback, the system includes a wearable tactile display that uses small actuators to stimulate the user's skin. This allows the user to feel the forces and contacts experienced by the robot, giving them a better sense of the robot's state and interactions. The researchers developed algorithms to map the robot's sensor data to appropriate tactile stimulation patterns.
The team evaluated MoveTouch in various tasks, such as object manipulation and navigation, and compared user performance to a traditional teleoperation setup without haptic feedback. They found that the haptic feedback improved task completion times, reduced collisions, and increased user confidence and situational awareness.
Critical Analysis
The MoveTouch system presents a promising approach to improving the safety and effectiveness of human-robot interaction. By providing users with a more natural and intuitive control interface through motion capture and haptic feedback, it addresses some of the key challenges in teleoperation and HRI.
However, the paper does not discuss some potential limitations of the system. For example, the wearable sensors and tactile display may be cumbersome or uncomfortable for prolonged use, which could impact user acceptance and adoption. Additionally, the accuracy and reliability of the motion capture and haptic feedback components could be further explored.
It would also be interesting to see how the MoveTouch system performs in more complex, dynamic, or safety-critical scenarios, such as collaborative manufacturing tasks or search and rescue operations. Further research could investigate the system's scalability, robustness, and potential integration with other advanced HRI technologies, such as augmented reality or multi-modal sensing.
Conclusion
The MoveTouch system proposed in this paper represents an important step towards safer and more intuitive human-robot interaction. By combining motion capture and haptic feedback, it provides users with a more natural and immersive way to control and interact with robots, which can improve task performance and reduce the risk of accidents or collisions. While the system has some limitations that warrant further research, the core concept of integrating tactile feedback with robotic control has significant potential to enhance a wide range of HRI applications, from industrial manufacturing to healthcare and beyond.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
š
Integrating Visuo-tactile Sensing with Haptic Feedback for Teleoperated Robot Manipulation
Noah Becker, Erik Gattung, Kay Hansel, Tim Schneider, Yaonan Zhu, Yasuhisa Hasegawa, Jan Peters
0
0
Telerobotics enables humans to overcome spatial constraints and allows them to physically interact with the environment in remote locations. However, the sensory feedback provided by the system to the operator is often purely visual, limiting the operator's dexterity in manipulation tasks. In this work, we address this issue by equipping the robot's end-effector with high-resolution visuotactile GelSight sensors. Using low-cost MANUS-Gloves, we provide the operator with haptic feedback about forces acting at the points of contact in the form of vibration signals. We propose two different methods for estimating these forces; one based on estimating the movement of markers on the sensor surface and one deep-learning approach. Additionally, we integrate our system into a virtual-reality teleoperation pipeline in which a human operator controls both arms of a Tiago robot while receiving visual and haptic feedback. We believe that integrating haptic feedback is a crucial step for dexterous manipulation in teleoperated robotic systems.
5/1/2024
Safe haptic teleoperations of admittance controlled robots with virtualization of the force feedback
Lorenzo Pagliara, Enrico Ferrentino, Andrea Chiacchio, Giovanni Russo
0
0
Haptic teleoperations play a key role in extending human capabilities to perform complex tasks remotely, employing a robotic system. The impact of haptics is far-reaching and can improve the sensory awareness and motor accuracy of the operator. In this context, a key challenge is attaining a natural, stable and safe haptic human-robot interaction. Achieving these conflicting requirements is particularly crucial for complex procedures, e.g. medical ones. To address this challenge, in this work we develop a novel haptic bilateral teleoperation system (HBTS), featuring a virtualized force feedback, based on the motion error generated by an admittance controlled robot. This approach allows decoupling the force rendering system from the control of the interaction: the rendered force is assigned with the desired dynamics, while the admittance control parameters are separately tuned to maximize interaction performance. Furthermore, recognizing the necessity to limit the forces exerted by the robot on the environment, to ensure a safe interaction, we embed a saturation strategy of the motion references provided by the haptic device to admittance control. We validate the different aspects of the proposed HBTS, through a teleoperated blackboard writing experiment, against two other architectures. The results indicate that the proposed HBTS improves the naturalness of teleoperation, as well as safety and accuracy of the interaction.
4/12/2024
Towards Robotic Haptic Proxies in Virtual Reality
Eric Godden, Matthew Pan
0
0
This work represents the initial development of a haptic display system for increased presence in virtual experiences. The developed system creates a two-way connection between a virtual space, mediated through a virtual reality headset, and a physical space, mediated through a robotic manipulator, creating the foundation for future haptic display development using the haptic proxy framework. Here, we assesses hand-tracking performance of the Meta Quest Pro headset, examining hand tracking latency and static positional error to characterize performance of our system.
6/10/2024
Advancements in Tactile Hand Gesture Recognition for Enhanced Human-Machine Interaction
Chiara Fumelli, Anirvan Dutta, Mohsen Kaboli
0
0
Motivated by the growing interest in enhancing intuitive physical Human-Machine Interaction (HRI/HVI), this study aims to propose a robust tactile hand gesture recognition system. We performed a comprehensive evaluation of different hand gesture recognition approaches for a large area tactile sensing interface (touch interface) constructed from conductive textiles. Our evaluation encompassed traditional feature engineering methods, as well as contemporary deep learning techniques capable of real-time interpretation of a range of hand gestures, accommodating variations in hand sizes, movement velocities, applied pressure levels, and interaction points. Our extensive analysis of the various methods makes a significant contribution to tactile-based gesture recognition in the field of human-machine interaction.
5/28/2024