You'll Never Walk Alone: An Experiment on Controlling the Mobile Robot 'Spot' with Voice and Gestures

Read original: arXiv:2407.11218 - Published 7/18/2024 by Renchi Zhang, Jesse van der Linden, Dimitra Dodou, Harleigh Seyffert, Yke Bauke Eisma, Joost C. F. de Winter
Total Score

0

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Robots are becoming more intelligent and can perform autonomous tasks like navigation.
  • However, human oversight remains crucial for directing mobile robots.
  • This study compared two hands-free control methods: voice control and gesture control.
  • The methods were tested with the human stationary and walking freely with the robot.
  • The researchers hypothesized that walking with the robot would lead to higher intuitiveness and better task performance.

Plain English Explanation

The paper explores two ways for humans to control and guide mobile robots without using their hands: voice commands and hand gestures. The researchers wanted to see how these control methods would work when the human is standing still versus walking alongside the robot.

The researchers thought that if the human walks with the robot, it would feel more natural and intuitive to control it, since the human's movements would be better aligned with the robot's movements. This stimulus-response compatibility theory suggests that when the human's actions match the robot's actions, it's easier to control the robot.

The study had 218 participants guide a four-legged robot named Spot using voice commands or hand gestures, both while standing still and while walking with the robot. After each trial, participants rated how intuitive the control method was. The researchers also interviewed participants to understand their preferences.

The results showed that voice control while walking with the robot was the most intuitive and preferred method. Gesture control while standing still caused confusion, as participants had trouble with left/right commands. However, 29% of participants still preferred gesture control, saying it made them feel more engaged and visually connected to the robot.

An analysis of the participants' movements revealed that they tended to position themselves behind the robot, especially when using gesture controls while walking. This suggests the importance of physical alignment between the human and robot for effective control.

Technical Explanation

The study used a 2x2 within-subject design, where 218 participants guided the quadrupedal robot Spot using 90 degree rotation and walk-forward commands through voice control and gesture control, both while stationary and while walking freely with the robot.

The researchers hypothesized that walking with Spot would lead to higher intuitiveness ratings and better task performance compared to standing still, due to increased stimulus-response compatibility when the human's movements align with the robot's.

After each trial, participants rated the intuitiveness of the command mapping. Post-experiment interviews were also conducted to gather participant preferences. An odometry-based analysis revealed that participants tended to position themselves behind Spot, particularly in the gesture control condition when allowed to walk.

The results showed that voice control combined with walking with Spot was the most favored and intuitive method. Gesture control while standing caused confusion for left/right commands. However, 29% of participants preferred gesture control, citing increased task engagement and visual congruence as reasons.

Critical Analysis

The paper provides valuable insights into the effectiveness of different control methods for guiding mobile robots. The researchers' hypothesis about the importance of human-robot physical alignment for intuitive control is supported by the findings.

However, the study is limited to a specific robot (Spot) and a fairly constrained set of commands (90 degree rotation and walk-forward). Further research could explore a wider range of robot capabilities and control inputs to see how the findings scale.

Additionally, the study only looked at short-term task performance and subjective ratings of intuitiveness. Longer-term studies may reveal different patterns of usage and preferences as users become more familiar with the control methods.

The researchers also acknowledge that improving the physical ergonomics and adjusting the gesture types could potentially improve the effectiveness of gesture control. Exploring these design factors in more depth could lead to better hybrid control systems that combine the strengths of voice and gesture inputs.

Overall, the paper provides a solid foundation for understanding the trade-offs between voice and gesture control for mobile robots, and highlights the importance of considering human-robot physical alignment when designing intuitive interfaces. Further research in this area could lead to more accessible and personalized robot control systems that enhance human-robot collaboration.

Conclusion

This study compared two hands-free methods, voice control and gesture control, for directing a mobile robot both when the human is stationary and when walking freely with the robot. The results showed that voice control combined with walking alongside the robot was the most intuitive and preferred approach.

The researchers' findings suggest that physical alignment between the human and robot is an important factor for effective control, as it allows for greater stimulus-response compatibility. This insight could inform the design of more natural and accessible robot control interfaces that leverage the strengths of both voice and gesture input.

Further research is needed to explore a wider range of robot capabilities, control inputs, and longer-term usage patterns. Improving the physical ergonomics and adjusting gesture types could also help enhance the effectiveness of gesture-based control. Overall, this study highlights the importance of considering human-robot physical alignment when developing intuitive control systems for mobile robots.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Total Score

0

You'll Never Walk Alone: An Experiment on Controlling the Mobile Robot 'Spot' with Voice and Gestures

Renchi Zhang, Jesse van der Linden, Dimitra Dodou, Harleigh Seyffert, Yke Bauke Eisma, Joost C. F. de Winter

Robots are becoming increasingly intelligent and can autonomously perform tasks such as navigating between locations. However, human oversight remains crucial. This study compared two hands-free methods for directing mobile robots: voice control and gesture control. These methods were tested with the human stationary and walking freely. We hypothesized that walking with the robot would lead to higher intuitiveness ratings and better task performance due to increased stimulus-response compatibility, assuming humans align themselves with the robot. In a 2x2 within-subject design, 218 participants guided the quadrupedal robot Spot using 90 degrees rotation and walk-forward commands. After each trial, participants rated the intuitiveness of the command mapping, while post-experiment interviews were used to gather the participants' preferences. Results showed that voice control combined with walking with Spot was the most favored and intuitive, while gesture control while standing caused confusion for left/right commands. Despite this, 29% of participants preferred gesture control, citing task engagement and visual congruence as reasons. An odometry-based analysis revealed that participants aligned behind Spot, particularly in the gesture control condition, when allowed to walk. In conclusion, voice control with walking produced the best outcomes. Improving physical ergonomics and adjusting gesture types could improve the effectiveness of gesture control.

Read more

7/18/2024

Non-verbal Interaction and Interface with a Quadruped Robot using Body and Hand Gestures: Design and User Experience Evaluation
Total Score

0

Non-verbal Interaction and Interface with a Quadruped Robot using Body and Hand Gestures: Design and User Experience Evaluation

Soohyun Shin, Trevor Evetts, Hunter Saylor, Hyunji Kim, Soojin Woo, Wonhwha Rhee, Seong-Woo Kim

In recent years, quadruped robots have attracted significant attention due to their practical advantages in maneuverability, particularly when navigating rough terrain and climbing stairs. As these robots become more integrated into various industries, including construction and healthcare, researchers have increasingly focused on developing intuitive interaction methods such as speech and gestures that do not require separate devices such as keyboards or joysticks. This paper aims at investigating a comfortable and efficient interaction method with quadruped robots that possess a familiar form factor. To this end, we conducted two preliminary studies to observe how individuals naturally interact with a quadruped robot in natural and controlled settings, followed by a prototype experiment to examine human preferences for body-based and hand-based gesture controls using a Unitree Go1 Pro quadruped robot. We assessed the user experience of 13 participants using the User Experience Questionnaire and measured the time taken to complete specific tasks. The findings of our preliminary results indicate that humans have a natural preference for communicating with robots through hand and body gestures rather than speech. In addition, participants reported higher satisfaction and completed tasks more quickly when using body gestures to interact with the robot. This contradicts the fact that most gesture-based control technologies for quadruped robots are hand-based. The video is available at https://youtu.be/rysv1p1zvp4.

Read more

9/2/2024

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
Total Score

0

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot

Rayna Hata, Narit Trikasemsak, Andrea Giudice, Stacy A. Doore

While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study investigated the potential for an industrial agile robot to perform guided navigation tasks. We developed two interface prototypes that allowed for spatial information between a human-robot pair: a voice-based app and a flexible, responsive handle. The participants (n=21) completed simple navigation tasks and a post-study survey about the prototype functionality and their trust in the robot. All participants successfully completed the navigation tasks and demonstrated the interface prototypes were able to pass spatial information between the human and the robot. Future work will include expanding the voice-based app to allow the robot to communicate obstacles to the handler and adding haptic signals to the handle design.

Read more

6/10/2024

Exploring the Potential of Robot-Collected Data for Training Gesture Classification Systems
Total Score

0

Exploring the Potential of Robot-Collected Data for Training Gesture Classification Systems

Alejandro Garcia-Sosa, Jose J. Quintana-Hernandez, Miguel A. Ferrer Ballester, Cristina Carmona-Duarte

Sensors and Artificial Intelligence (AI) have revolutionized the analysis of human movement, but the scarcity of specific samples presents a significant challenge in training intelligent systems, particularly in the context of diagnosing neurodegenerative diseases. This study investigates the feasibility of utilizing robot-collected data to train classification systems traditionally trained with human-collected data. As a proof of concept, we recorded a database of numeric characters using an ABB robotic arm and an Apple Watch. We compare the classification performance of the trained systems using both human-recorded and robot-recorded data. Our primary objective is to determine the potential for accurate identification of human numeric characters wearing a smartwatch using robotic movement as training data. The findings of this study offer valuable insights into the feasibility of using robot-collected data for training classification systems. This research holds broad implications across various domains that require reliable identification, particularly in scenarios where access to human-specific data is limited.

Read more

5/8/2024