Toward RAPS: the Robot Autonomy Perception Scale
0
Sign in to get full access
Overview
- The paper introduces the Robot Autonomy Perception Scale (RAPS), a new scale for measuring how people perceive the autonomy of robots.
- The RAPS scale was developed through a multi-stage process involving expert reviews, pilot testing, and large-scale validation.
- The scale aims to provide a standardized way to assess perceptions of robot autonomy, which is important for understanding human-robot interaction and trust.
Plain English Explanation
The paper describes the creation of a new measurement tool called the Robot Autonomy Perception Scale (RAPS). This scale is designed to help researchers and developers understand how people perceive the level of autonomy in robots.
Perceiving a robot as more or less autonomous can significantly impact how people interact with and trust that robot. The RAPS scale provides a standardized way to quantify these perceptions. It was developed through a careful process that involved getting feedback from experts, trying it out with small groups, and then validating it with a larger sample of people.
The goal is for the RAPS scale to become a widely used tool that enables more consistent and reliable assessments of robot autonomy. This can provide important insights to help design robots that are well-suited for effective and trusted interactions with humans. Understanding perceptions of robot autonomy is a key part of advancing human-robot interaction and building more autonomous robotic systems that can collaborate seamlessly with people.
Technical Explanation
The paper details the development of the Robot Autonomy Perception Scale (RAPS), a new instrument for measuring how people perceive the autonomy of robots. The RAPS scale was created through a multi-stage process:
- Expert Review: The initial item pool was reviewed by a panel of experts in human-robot interaction and autonomy to assess content validity.
- Pilot Testing: The scale was pilot tested with a small sample to further refine the items and response format.
- Large-Scale Validation: The finalized RAPS scale was then validated with a larger, more diverse sample to assess its psychometric properties, including reliability and construct validity.
The resulting RAPS scale contains 15 items that collectively measure different facets of perceived robot autonomy, such as the robot's decision-making ability, level of independence, and capacity for self-directed action. Participants rate each item on a 7-point Likert scale.
The validation process demonstrated that the RAPS scale has strong internal consistency and converges with related constructs like robot capability and perceived security. It also distinguished between robots with varying levels of autonomy, suggesting the scale can effectively capture nuanced differences in perceived autonomy.
Critical Analysis
The paper provides a rigorous and well-documented approach to developing the RAPS scale. The multi-stage process, including expert review and large-scale validation, helps ensure the scale has strong psychometric properties and can reliably measure perceptions of robot autonomy.
One potential limitation is that the validation was conducted in a single cultural context (the United States). Perceptions of robot autonomy may vary across different cultures, so further validation in diverse global settings would be valuable. Additionally, the scale was tested with static robot descriptions rather than live interactions, so its performance in real-world human-robot interaction scenarios remains to be seen.
While the RAPS scale represents an important step forward, continued research is needed to understand the complex and multifaceted nature of perceived robot autonomy. Factors like the robot's physical design, task context, and user characteristics may all influence these perceptions in ways that warrant further exploration.
Conclusion
The Robot Autonomy Perception Scale (RAPS) developed in this paper provides a valuable new tool for assessing how people perceive the autonomy of robots. By offering a standardized and psychometrically validated scale, the RAPS can enable more consistent and reliable measurements of this crucial aspect of human-robot interaction.
This advancement can lead to important insights that help shape the design and deployment of autonomous robotic systems that can effectively collaborate with humans in a wide range of applications, from security to assistive robotics. As the field of robotics continues to evolve, tools like the RAPS will be essential for understanding and optimizing the interactions between humans and increasingly autonomous machines.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Toward RAPS: the Robot Autonomy Perception Scale
Rafael Sousa Silva, Cailyn Smith, Lara Bezerra, Tom Williams
Human-robot interactions can change significantly depending on how autonomous humans perceive a robot to be. Yet, while previous work in the HRI community measured perceptions of human autonomy, there is little work on measuring perceptions of robot autonomy. In this paper, we present our progress toward the creation of the Robot Autonomy Perception Scale (RAPS): a theoretically motivated scale for measuring human perceptions of robot autonomy. We formulated a set of fifteen Likert scale items that are based on the definition of autonomy from Beer et al.'s work, which identifies five key autonomy components: ability to sense, ability to plan, ability to act, ability to act with an intent towards some goal, and an ability to do so without external control. We applied RAPS to an experimental context in which a robot communicated with a human teammate through different levels of Performative Autonomy (PA): an autonomy-driven strategy in which robots may perform a lower level of autonomy than they are truly capable of to increase human situational awareness. Our results present preliminary validation for RAPS by demonstrating its sensitivity to PA and motivate the further validation of RAPS.
Read more7/17/2024
0
A Measure for Level of Autonomy Based on Observable System Behavior
Jason M. Pittman
Contemporary artificial intelligence systems are pivotal in enhancing human efficiency and safety across various domains. One such domain is autonomous systems, especially in automotive and defense use cases. Artificial intelligence brings learning and enhanced decision-making to autonomy system goal-oriented behaviors and human independence. However, the lack of clear understanding of autonomy system capabilities hampers human-machine or machine-machine interaction and interdiction. This necessitates varying degrees of human involvement for safety, accountability, and explainability purposes. Yet, measuring the level autonomous capability in an autonomous system presents a challenge. Two scales of measurement exist, yet measuring autonomy presupposes a variety of elements not available in the wild. This is why existing measures for level of autonomy are operationalized only during design or test and evaluation phases. No measure for level of autonomy based on observed system behavior exists at this time. To address this, we outline a potential measure for predicting level of autonomy using observable actions. We also present an algorithm incorporating the proposed measure. The measure and algorithm have significance to researchers and practitioners interested in a method to blind compare autonomous systems at runtime. Defense-based implementations are likewise possible because counter-autonomy depends on robust identification of autonomous systems.
Read more7/23/2024
🌐
0
A Quantitative Autonomy Quantification Framework for Fully Autonomous Robotic Systems
Nasser Gyagenda (University of Siegen), Hubert Roth (University of Siegen)
Although autonomous functioning facilitates deployment of robotic systems in domains that admit limited human oversight on our planet and beyond, finding correspondence between task requirements and autonomous capability is still an open challenge. Consequently, a number of methods for quantifying autonomy have been proposed over the last three decades, but to our knowledge all these have no discernment of sub-mode features of variation of autonomy and some are based on metrics that violet the Goodhart's law. This paper focuses on the full autonomous mode and proposes a quantitative autonomy assessment framework based on task requirements. The framework starts by establishing robot task characteristics from which three autonomy metrics, namely requisite capability set, reliability and responsiveness are derived. These characteristics were founded on the realization that robots ultimately replace human skilled workers, from which a relationship between human job and robot task characteristics was established. Additionally, mathematical functions mapping metrics to autonomy as a two-part measure, namely of level and degree of autonomy are also presented. The distinction between level and degree of autonomy stemmed from the acknowledgment that autonomy is not just a question of existence, but also one of performance of requisite capability. The framework has been demonstrated on two case studies, namely autonomous vehicle at an on-road dynamic driving task and the DARPA subterranean challenge rules analysis. The framework provides not only a tool for quantifying autonomy, but also a regulatory interface and common language for autonomous systems developers and users. Its greatest feature is the ability to monitor system integrity when implemented online.
Read more4/12/2024
0
Measuring Transparency in Intelligent Robots
Georgios Angelopoulos, Dimitri Lacroix, Ricarda Wullenkord, Alessandra Rossi, Silvia Rossi, Friederike Eyssel
As robots become increasingly integrated into our daily lives, the need to make them transparent has never been more critical. Yet, despite its importance in human-robot interaction, a standardized measure of robot transparency has been missing until now. This paper addresses this gap by presenting the first comprehensive scale to measure perceived transparency in robotic systems, available in English, German, and Italian languages. Our approach conceptualizes transparency as a multidimensional construct, encompassing explainability, legibility, predictability, and meta-understanding. The proposed scale was a product of a rigorous three-stage process involving 1,223 participants. Firstly, we generated the items of our scale, secondly, we conducted an exploratory factor analysis, and thirdly, a confirmatory factor analysis served to validate the factor structure of the newly developed TOROS scale. The final scale encompasses 26 items and comprises three factors: Illegibility, Explainability, and Predictability. TOROS demonstrates high cross-linguistic reliability, inter-factor correlation, model fit, internal consistency, and convergent validity across the three cross-national samples. This empirically validated tool enables the assessment of robot transparency and contributes to the theoretical understanding of this complex construct. By offering a standardized measure, we facilitate consistent and comparable research in human-robot interaction in which TOROS can serve as a benchmark.
Read more9/2/2024