Assistance-Seeking in Human-Supervised Autonomy: Role of Trust and Secondary Task Engagement (Extended Version)
0
Sign in to get full access
Overview
- The paper examines how human trust and engagement with secondary tasks affect assistance-seeking behavior in human-supervised autonomous systems.
- Researchers conducted experiments where participants interacted with an autonomous vehicle in various scenarios, measuring their trust, secondary task engagement, and assistance-seeking patterns.
- The findings provide insights into how trust and multitasking can influence when and how humans choose to intervene and assist autonomous systems.
Plain English Explanation
The paper looks at how much humans trust autonomous systems and how engaged they are with other tasks can affect when they decide to step in and help the autonomous system. In the experiments, participants interacted with a self-driving car in different situations. The researchers measured how much the participants trusted the car, how focused they were on other tasks, and when they chose to take control and provide assistance to the car.
The key insights from the study are that trust and multitasking can significantly influence when and how humans decide to intervene and help an autonomous system. For example, if someone doesn't fully trust the autonomous system, they may be quicker to take over control. And if someone is very focused on another task, they may be less likely to notice when the autonomous system needs help. These findings can help design autonomous systems that better anticipate and respond to human assistance-seeking behavior.
Technical Explanation
The paper investigates the role of trust and secondary task engagement on assistance-seeking behavior in human-supervised autonomous systems. Researchers conducted a series of experiments where participants interacted with an autonomous vehicle in various driving scenarios.
The experimental setup involved participants monitoring the autonomous vehicle's performance while also engaging in a secondary cognitive task. Researchers measured the participants' trust in the autonomous system, their level of engagement with the secondary task, and when they chose to take over control and provide assistance to the vehicle.
The results showed that both trust and secondary task engagement had a significant impact on assistance-seeking behavior. Participants with lower trust in the autonomous system were more likely to intervene and take over control, even when the system was performing well. Additionally, participants who were highly engaged in the secondary task were less likely to notice when the autonomous system needed help, delaying their intervention.
These findings provide important insights into the complex interplay between humans and autonomous systems and how factors like trust and multitasking can shape assistance-seeking patterns. The researchers suggest that accounting for these human factors is crucial for designing autonomous systems that can better anticipate and respond to human needs for intervention and assistance.
Critical Analysis
The paper provides a well-designed and rigorous experimental study of assistance-seeking behavior in human-supervised autonomous systems. The researchers carefully controlled for factors like trust and secondary task engagement, allowing them to draw clear conclusions about their impact on intervention patterns.
However, the study does have some limitations. The experiments were conducted in a simulated environment, which may not fully capture the complexity and urgency of real-world scenarios where an autonomous system requires human assistance. Additionally, the study focused on a specific type of autonomous vehicle, and the findings may not generalize to other types of autonomous systems or applications.
Furthermore, the paper does not delve deeply into the potential implications of these findings for the design and deployment of human-supervised autonomous systems. For example, how can autonomous systems be designed to better facilitate appropriate assistance-seeking behavior from human supervisors, especially in high-stakes or time-sensitive situations?
Overall, the paper makes a valuable contribution to our understanding of the human factors that influence assistance-seeking in human-supervised autonomy. However, further research is needed to explore the broader implications and practical applications of these findings.
Conclusion
This study provides important insights into the role of trust and secondary task engagement in shaping assistance-seeking behavior in human-supervised autonomous systems. The findings suggest that these human factors can significantly influence when and how users choose to intervene and assist autonomous systems, which has important implications for the design and deployment of such systems.
By understanding these dynamics, researchers and engineers can work to develop autonomous systems that better anticipate and respond to human needs for intervention, ultimately leading to more effective and reliable human-machine collaboration. This study represents an important step forward in the ongoing effort to create autonomous systems that can seamlessly integrate with and augment human capabilities.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Assistance-Seeking in Human-Supervised Autonomy: Role of Trust and Secondary Task Engagement (Extended Version)
Dong Hae Mangalindan, Vaibhav Srivastava
Using a dual-task paradigm, we explore how robot actions, performance, and the introduction of a secondary task influence human trust and engagement. In our study, a human supervisor simultaneously engages in a target-tracking task while supervising a mobile manipulator performing an object collection task. The robot can either autonomously collect the object or ask for human assistance. The human supervisor also has the choice to rely upon or interrupt the robot. Using data from initial experiments, we model the dynamics of human trust and engagement using a linear dynamical system (LDS). Furthermore, we develop a human action model to define the probability of human reliance on the robot. Our model suggests that participants are more likely to interrupt the robot when their trust and engagement are low during high-complexity collection tasks. Using Model Predictive Control (MPC), we design an optimal assistance-seeking policy. Evaluation experiments demonstrate the superior performance of the MPC policy over the baseline policy for most participants.
Read more6/13/2024
0
Dynamic Human Trust Modeling of Autonomous Agents With Varying Capability and Strategy
Jason Dekarske (University of California, Davis), Zhaodan Kong (University of California, Davis), Sanjay Joshi (University of California, Davis)
Objective We model the dynamic trust of human subjects in a human-autonomy-teaming screen-based task. Background Trust is an emerging area of study in human-robot collaboration. Many studies have looked at the issue of robot performance as a sole predictor of human trust, but this could underestimate the complexity of the interaction. Method Subjects were paired with autonomous agents to search an on-screen grid to determine the number of outlier objects. In each trial, a different autonomous agent with a preassigned capability used one of three search strategies and then reported the number of outliers it found as a fraction of its capability. Then, the subject reported their total outlier estimate. Human subjects then evaluated statements about the agent's behavior, reliability, and their trust in the agent. Results 80 subjects were recruited. Self-reported trust was modeled using Ordinary Least Squares, but the group that interacted with varying capability agents on a short time order produced a better performing ARIMAX model. Models were cross-validated between groups and found a moderate improvement in the next trial trust prediction. Conclusion A time series modeling approach reveals the effects of temporal ordering of agent performance on estimated trust. Recency bias may affect how subjects weigh the contribution of strategy or capability to trust. Understanding the connections between agent behavior, agent performance, and human trust is crucial to improving human-robot collaborative tasks. Application The modeling approach in this study demonstrates the need to represent autonomous agent characteristics over time to capture changes in human trust.
Read more5/1/2024
🐍
0
Learning When to Ask for Help: Efficient Interactive Navigation via Implicit Uncertainty Estimation
Ifueko Igbinedion, Sertac Karaman
Robots operating alongside humans often encounter unfamiliar environments that make autonomous task completion challenging. Though improving models and increasing dataset size can enhance a robot's performance in unseen environments, data collection and model refinement may be impractical in every environment. Approaches that utilize human demonstrations through manual operation can aid in refinement and generalization, but often require significant data collection efforts to generate enough demonstration data to achieve satisfactory task performance. Interactive approaches allow for humans to provide correction to robot action in real time, but intervention policies are often based on explicit factors related to state and task understanding that may be difficult to generalize. Addressing these challenges, we train a lightweight interaction policy that allows robots to decide when to proceed autonomously or request expert assistance at estimated times of uncertainty. An implicit estimate of uncertainty is learned via evaluating the feature extraction capabilities of the robot's visual navigation policy. By incorporating part-time human interaction, robots recover quickly from their mistakes, significantly improving the odds of task completion. Incorporating part-time interaction yields an increase in success of 0.38 with only a 0.3 expert interaction rate within the Habitat simulation environment using a simulated human expert. We further show success transferring this approach to a new domain with a real human expert, improving success from less than 0.1 with an autonomous agent to 0.92 with a 0.23 human interaction rate. This approach provides a practical means for robots to interact and learn from humans in real-world settings.
Read more6/10/2024
0
Human Reactions to Incorrect Answers from Robots
Ponkoj Chandra Shill, Md. Azizul Hakim, Muhammad Jahanzeb Khan, Bashira Akter Anima
As robots grow more and more integrated into numerous industries, it is critical to comprehend how humans respond to their failures. This paper systematically studies how trust dynamics and system design are affected by human responses to robot failures. The three-stage survey used in the study provides a thorough understanding of human-robot interactions. While the second stage concentrates on interaction details, such as robot precision and error acknowledgment, the first stage collects demographic data and initial levels of trust. In the last phase, participants' perceptions are examined after the encounter, and trust dynamics, forgiveness, and propensity to suggest robotic technologies are evaluated. Results show that participants' trust in robotic technologies increased significantly when robots acknowledged their errors or limitations to participants and their willingness to suggest robots for activities in the future points to a favorable change in perception, emphasizing the role that direct engagement has in influencing trust dynamics. By providing useful advice for creating more sympathetic, responsive, and reliable robotic systems, the study advances the science of human-robot interaction and promotes a wider adoption of robotic technologies.
Read more7/8/2024