What Did My Car Say? Autonomous Vehicle Explanation Errors, Context, and Personal Traits Impact Comfort, Reliance, Satisfaction, and Driving Confidence

Read original: arXiv:2409.05731 - Published 9/11/2024 by Robert Kaufman, Aaron Broukhim, David Kirsh, Nadir Weibel
Total Score

0

What Did My Car Say? Autonomous Vehicle Explanation Errors, Context, and Personal Traits Impact Comfort, Reliance, Satisfaction, and Driving Confidence

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper examines how errors in autonomous vehicle (AV) explanations, context, and personal traits impact user comfort, reliance, satisfaction, and driving confidence.
  • The researchers conducted a series of experiments to understand how these factors influence the user experience with AVs.
  • The findings provide insights into the importance of transparent and accurate AV explanations for building trust and acceptance of this emerging technology.

Plain English Explanation

The study explores how errors in the explanations provided by autonomous vehicles (AVs) can affect people's comfort, trust, satisfaction, and confidence when using these self-driving cars. The researchers wanted to understand how the context in which the AV is used and the individual characteristics of the user also play a role in shaping the user experience.

To do this, the researchers ran a series of experiments where they had people interact with simulated AVs. In some cases, the AV's explanations of its actions contained errors, while in others the explanations were accurate. The researchers also varied the driving context, such as whether the AV was operating in a city or on a highway. Additionally, they looked at how the user's own personal traits, like their general technology comfort and trust in automation, influenced their reactions.

The key findings were that errors in the AV's explanations significantly reduced people's comfort, reliance, satisfaction, and confidence in the driving experience. The context also mattered, with people feeling less comfortable in more complex urban environments. And individual differences, like a person's propensity to trust technology, shaped their responses as well.

These results highlight the importance of autonomous vehicles being able to provide clear, accurate, and transparent explanations of their actions. Errors or ambiguity in these explanations can undermine people's willingness to use and trust self-driving cars. The findings also suggest the need to design AV systems and interfaces that can adapt to the user and the driving situation to build the best overall experience.

Technical Explanation

The paper presents a series of studies investigating how errors in the explanations provided by autonomous vehicles (AVs), the context of use, and users' personal traits impact their comfort, reliance, satisfaction, and driving confidence with AVs.

In the first experiment, participants interacted with a simulated AV that either provided accurate or erroneous explanations of its actions. The researchers found that explanation errors significantly reduced users' comfort, reliance, satisfaction, and driving confidence.

The second experiment examined the role of driving context, comparing user experiences in urban versus highway environments. The results showed that users felt less comfortable and confident in the more complex urban setting, regardless of the accuracy of the AV's explanations.

The third experiment explored how individual differences, such as technology comfort and trust in automation, influenced reactions to the AV system. Users high in these traits reported greater comfort, reliance, satisfaction, and confidence, even when the AV made explanation errors.

Taken together, the findings highlight the importance of transparent and accurate AV explanations for building trust and acceptance of this emerging technology. The context of use and personal characteristics of the user also play a key role in shaping the overall user experience. These insights can inform the design of AV systems and interfaces that adapt to both the user and the driving environment.

Critical Analysis

The research presented in this paper provides valuable insights into the factors that influence user experiences with autonomous vehicles (AVs). By examining the impact of explanation errors, context, and personal traits, the authors have identified important design considerations for building trust and acceptance of this emerging technology.

One key limitation acknowledged by the authors is the use of simulated AV interactions rather than real-world driving experiences. While the controlled experimental setup allowed for systematic investigation of the variables of interest, it remains to be seen how well the findings translate to actual AV use. Further research involving on-road testing would help validate the conclusions.

Additionally, the paper focuses primarily on the user experience factors of comfort, reliance, satisfaction, and driving confidence. While these are undoubtedly important, there may be other relevant outcomes, such as safety behaviors, that were not assessed. Exploring a broader range of user responses could provide a more comprehensive understanding of the human-AV interaction.

Another area for potential further research is the interplay between explanation errors, context, and personal traits. The current studies examined these factors independently, but in real-world settings, they are likely to interact in complex ways. Investigating these dynamics could yield additional insights into how to design AV systems that can adapt to diverse user needs and driving situations.

Overall, this paper makes a valuable contribution to the growing body of research on autonomous vehicle technologies and human-machine interaction. The findings underscore the importance of transparent and accurate AV explanations, while also highlighting the need to consider contextual and individual factors in the design process. As AVs continue to evolve, these insights can help guide the development of systems that foster trust, comfort, and confidence among users.

Conclusion

This study provides important insights into the factors that influence user experiences with autonomous vehicles (AVs). The key findings demonstrate that errors in the explanations provided by AVs can significantly reduce user comfort, reliance, satisfaction, and driving confidence. The context of use, such as the complexity of the driving environment, and individual user traits, such as technology comfort and trust in automation, also play a crucial role in shaping these outcomes.

These results highlight the importance of designing AV systems that can deliver transparent, accurate, and adaptive explanations of their actions. Accurate and clear communication is essential for building trust and acceptance of this emerging technology. Additionally, the findings suggest the need to consider both the usage context and individual user characteristics when developing AV interfaces and interactions.

As autonomous vehicles continue to advance, these insights can help guide the design of systems that foster positive user experiences and facilitate the smooth integration of self-driving cars into our transportation landscape. By understanding the factors that influence user perceptions and behaviors, researchers and developers can work towards creating AV technologies that are not only technologically capable, but also responsive to the needs and preferences of the people who will rely on them.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

What Did My Car Say? Autonomous Vehicle Explanation Errors, Context, and Personal Traits Impact Comfort, Reliance, Satisfaction, and Driving Confidence
Total Score

0

What Did My Car Say? Autonomous Vehicle Explanation Errors, Context, and Personal Traits Impact Comfort, Reliance, Satisfaction, and Driving Confidence

Robert Kaufman, Aaron Broukhim, David Kirsh, Nadir Weibel

Explanations for autonomous vehicle (AV) decisions may build trust, however, explanations can contain errors. In a simulated driving study (n = 232), we tested how AV explanation errors, driving context characteristics (perceived harm and driving difficulty), and personal traits (prior trust and expertise) affected a passenger's comfort in relying on an AV, preference for control, confidence in the AV's ability, and explanation satisfaction. Errors negatively affected all outcomes. Surprisingly, despite identical driving, explanation errors reduced ratings of the AV's driving ability. Severity and potential harm amplified the negative impact of errors. Contextual harm and driving difficulty directly impacted outcome ratings and influenced the relationship between errors and outcomes. Prior trust and expertise were positively associated with outcome ratings. Results emphasize the need for accurate, contextually adaptive, and personalized AV explanations to foster trust, reliance, satisfaction, and confidence. We conclude with design, research, and deployment recommendations for trustworthy AV explanation systems.

Read more

9/11/2024

Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning
Total Score

0

Predicting Trust In Autonomous Vehicles: Modeling Young Adult Psychosocial Traits, Risk-Benefit Attitudes, And Driving Factors With Machine Learning

Robert Kaufman, Emi Lee, Manas Satish Bedmutha, David Kirsh, Nadir Weibel

Low trust remains a significant barrier to Autonomous Vehicle (AV) adoption. To design trustworthy AVs, we need to better understand the individual traits, attitudes, and experiences that impact people's trust judgements. We use machine learning to understand the most important factors that contribute to young adult trust based on a comprehensive set of personal factors gathered via survey (n = 1457). Factors ranged from psychosocial and cognitive attributes to driving style, experiences, and perceived AV risks and benefits. Using the explainable AI technique SHAP, we found that perceptions of AV risks and benefits, attitudes toward feasibility and usability, institutional trust, prior experience, and a person's mental model are the most important predictors. Surprisingly, psychosocial and many technology- and driving-specific factors were not strong predictors. Results highlight the importance of individual differences for designing trustworthy AVs for diverse groups and lead to key implications for future design and research.

Read more

9/16/2024

A Transparency Paradox? Investigating the Impact of Explanation Specificity and Autonomous Vehicle Perceptual Inaccuracies on Passengers
Total Score

0

A Transparency Paradox? Investigating the Impact of Explanation Specificity and Autonomous Vehicle Perceptual Inaccuracies on Passengers

Daniel Omeiza, Raunak Bhattacharyya, Marina Jirotka, Nick Hawes, Lars Kunze

Transparency in automated systems could be afforded through the provision of intelligible explanations. While transparency is desirable, might it lead to catastrophic outcomes (such as anxiety), that could outweigh its benefits? It's quite unclear how the specificity of explanations (level of transparency) influences recipients, especially in autonomous driving (AD). In this work, we examined the effects of transparency mediated through varying levels of explanation specificity in AD. We first extended a data-driven explainer model by adding a rule-based option for explanation generation in AD, and then conducted a within-subject lab study with 39 participants in an immersive driving simulator to study the effect of the resulting explanations. Specifically, our investigation focused on: (1) how different types of explanations (specific vs. abstract) affect passengers' perceived safety, anxiety, and willingness to take control of the vehicle when the vehicle perception system makes erroneous predictions; and (2) the relationship between passengers' behavioural cues and their feelings during the autonomous drives. Our findings showed that passengers felt safer with specific explanations when the vehicle's perception system had minimal errors, while abstract explanations that hid perception errors led to lower feelings of safety. Anxiety levels increased when specific explanations revealed perception system errors (high transparency). We found no significant link between passengers' visual patterns and their anxiety levels. Our study suggests that passengers prefer clear and specific explanations (high transparency) when they originate from autonomous vehicles (AVs) with optimal perceptual accuracy.

Read more

8/19/2024

People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior
Total Score

0

People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior

Balint Gyevnar, Stephanie Droop, Tadeg Quillien, Shay B. Cohen, Neil R. Bramley, Christopher G. Lucas, Stefano V. Albrecht

Cognitive science can help us understand which explanations people might expect, and in which format they frame these explanations, whether causal, counterfactual, or teleological (i.e., purpose-oriented). Understanding the relevance of these concepts is crucial for building good explainable AI (XAI) which offers recourse and actionability. Focusing on autonomous driving, a complex decision-making domain, we report empirical data from two surveys on (i) how people explain the behavior of autonomous vehicles in 14 unique scenarios (N1=54), and (ii) how they perceive these explanations in terms of complexity, quality, and trustworthiness (N2=356). Participants deemed teleological explanations significantly better quality than counterfactual ones, with perceived teleology being the best predictor of perceived quality and trustworthiness. Neither the perceived teleology nor the quality were affected by whether the car was an autonomous vehicle or driven by a person. This indicates that people use teleology to evaluate information about not just other people but also autonomous vehicles. Taken together, our findings highlight the importance of explanations that are framed in terms of purpose rather than just, as is standard in XAI, the causal mechanisms involved. We release the 14 scenarios and more than 1,300 elicited explanations publicly as the Human Explanations for Autonomous Driving Decisions (HEADD) dataset.

Read more

5/1/2024