Dynamic Human Trust Modeling of Autonomous Agents With Varying Capability and Strategy
0
Sign in to get full access
Overview
- Examines how humans' trust in autonomous agents changes over time as the agents' capabilities and strategies vary
- Proposes a dynamic modeling approach to capture the complex, context-dependent nature of human trust
- Evaluates the model through simulations and experiments involving human participants
Plain English Explanation
This research explores how people's trust in autonomous agents, like robots or AI systems, evolves over time as the agents' capabilities and strategies change. The researchers recognized that trust is a complex, context-dependent phenomenon, so they developed a dynamic modeling approach to capture these nuances.
The study involved simulations and experiments with human participants to test the model. By observing how people's trust changed as the agents displayed different levels of competence and employed various strategies, the researchers aimed to gain a deeper understanding of the trust-building process between humans and autonomous systems.
This work is significant because as autonomous agents become more prevalent in our lives, it's crucial to understand the factors that influence human trust. By modeling these trust dynamics, the researchers hope to inform the design of autonomous systems that can build and maintain trust effectively over time.
Technical Explanation
The researchers proposed a dynamic human trust modeling approach to capture the complex, context-dependent nature of trust between humans and autonomous agents. Their model incorporates the agents' varying capabilities and strategic behaviors as key factors influencing trust.
Through simulations and experiments involving human participants, the researchers evaluated their model's ability to predict and explain the trust dynamics between humans and autonomous agents. The results showed that the model was effective in capturing the longitudinal changes in trust as the agents' capabilities and strategies varied.
Critical Analysis
The researchers acknowledged several caveats and limitations in their work. For example, the study focused on specific task scenarios and did not explore the generalization of the trust model to broader contexts. Additionally, the experiments involved relatively short interaction periods, which may not capture the long-term trust dynamics that can emerge in real-world interactions.
Further research is needed to validate the model's applicability in diverse settings and to investigate the impact of uncertainty on trust formation. Exploring the influence of individual differences and cultural factors on trust dynamics could also provide valuable insights.
Conclusion
This research presents a significant step forward in understanding the complex and dynamic nature of human trust in autonomous agents. By proposing a modeling approach that accounts for the agents' capabilities and strategies, the researchers have laid the groundwork for designing autonomous systems that can effectively build and maintain trust over time.
As autonomous agents become increasingly integrated into our daily lives, the insights gained from this work can inform the development of trustworthy and reliable systems that can seamlessly collaborate with humans to tackle a wide range of tasks and challenges.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Dynamic Human Trust Modeling of Autonomous Agents With Varying Capability and Strategy
Jason Dekarske (University of California, Davis), Zhaodan Kong (University of California, Davis), Sanjay Joshi (University of California, Davis)
Objective We model the dynamic trust of human subjects in a human-autonomy-teaming screen-based task. Background Trust is an emerging area of study in human-robot collaboration. Many studies have looked at the issue of robot performance as a sole predictor of human trust, but this could underestimate the complexity of the interaction. Method Subjects were paired with autonomous agents to search an on-screen grid to determine the number of outlier objects. In each trial, a different autonomous agent with a preassigned capability used one of three search strategies and then reported the number of outliers it found as a fraction of its capability. Then, the subject reported their total outlier estimate. Human subjects then evaluated statements about the agent's behavior, reliability, and their trust in the agent. Results 80 subjects were recruited. Self-reported trust was modeled using Ordinary Least Squares, but the group that interacted with varying capability agents on a short time order produced a better performing ARIMAX model. Models were cross-validated between groups and found a moderate improvement in the next trial trust prediction. Conclusion A time series modeling approach reveals the effects of temporal ordering of agent performance on estimated trust. Recency bias may affect how subjects weigh the contribution of strategy or capability to trust. Understanding the connections between agent behavior, agent performance, and human trust is crucial to improving human-robot collaborative tasks. Application The modeling approach in this study demonstrates the need to represent autonomous agent characteristics over time to capture changes in human trust.
Read more5/1/2024
0
Anytime Trust Rating Dynamics in a Human-Robot Interaction Task
Jason Dekarske, Gregory Bales, Zhaodan Kong, Sanjay Joshi
Objective We model factors contributing to rating timing for a single-dimensional, any-time trust in robotics measure. Background Many studies view trust as a slow-changing value after subjects complete a trial or at regular intervals. Trust is a multifaceted concept that can be measured simultaneously with a human-robot interaction. Method 65 subjects commanded a remote robot arm in a simulated space station. The robot picked and placed stowage commanded by the subject, but the robot's performance varied from trial to trial. Subjects rated their trust on a non-obtrusive trust slider at any time throughout the experiment. Results A Cox Proportional Hazards Model described the time it took subjects to rate their trust in the robot. A retrospective survey indicated that subjects based their trust on the robot's performance or outcome of the task. Strong covariates representing the task's state reflected this in the model. Conclusion Trust and robot task performance contributed little to the timing of the trust rating. The subjects' exit survey responses aligned with the assumption that the robot's task progress was the main reason for the timing of their trust rating. Application Measuring trust in a human-robot interaction task should take as little attention away from the task as possible. This trust rating technique lays the groundwork for single-dimensional trust queries that probe estimated human action.
Read more8/2/2024
0
Assistance-Seeking in Human-Supervised Autonomy: Role of Trust and Secondary Task Engagement (Extended Version)
Dong Hae Mangalindan, Vaibhav Srivastava
Using a dual-task paradigm, we explore how robot actions, performance, and the introduction of a secondary task influence human trust and engagement. In our study, a human supervisor simultaneously engages in a target-tracking task while supervising a mobile manipulator performing an object collection task. The robot can either autonomously collect the object or ask for human assistance. The human supervisor also has the choice to rely upon or interrupt the robot. Using data from initial experiments, we model the dynamics of human trust and engagement using a linear dynamical system (LDS). Furthermore, we develop a human action model to define the probability of human reliance on the robot. Our model suggests that participants are more likely to interrupt the robot when their trust and engagement are low during high-complexity collection tasks. Using Model Predictive Control (MPC), we design an optimal assistance-seeking policy. Evaluation experiments demonstrate the superior performance of the MPC policy over the baseline policy for most participants.
Read more6/13/2024
0
Trust Dynamics in Human-Autonomy Interaction: Uncover Associations between Trust Dynamics and Personal Characteristics
Hyesun Chung, X. Jessie Yang
While personal characteristics influence people's snapshot trust towards autonomous systems, their relationships with trust dynamics remain poorly understood. We conducted a human-subject experiment with 130 participants performing a simulated surveillance task aided by an automated threat detector. A comprehensive pre-experimental survey collected data on participants' personal characteristics across 12 constructs and 28 dimensions. Based on data collected in the experiment, we clustered participants' trust dynamics into three types and assessed differences among the three clusters in terms of personal characteristics, behaviors, performance, and post-experiment ratings. Participants were clustered into three groups, namely Bayesian decision makers, disbelievers, and oscillators. Results showed that the clusters differ significantly in seven personal characteristics: masculinity, positive affect, extraversion, neuroticism, intellect, performance expectancy, and high expectations. The disbelievers tend to have high neuroticism and low performance expectancy. The oscillators tend to have higher scores in masculinity, positive affect, extraversion and intellect. We also found significant differences in the behaviors and post-experiment ratings among the three groups. The disbelievers are the least likely to blindly follow the recommendations made by the automated threat detector. Based on the significant personal characteristics, we developed a decision tree model to predict cluster types with an accuracy of 70%.
Read more9/12/2024