What Guides Our Choices? Modeling Developers' Trust and Behavioral Intentions Towards GenAI
0
Sign in to get full access
Overview
- This paper explores the factors that influence software developers' trust and behavioral intentions towards generative AI (GenAI) systems.
- The researchers used a partial least squares structural equation modeling (PLS-SEM) approach to investigate the relationships between various psychological and behavioral factors.
- The study provides insights into how developers' cognitive styles, perceptions of GenAI capabilities, and other factors shape their trust and intentions to use these technologies.
Plain English Explanation
The paper investigates what influences software developers' trust and willingness to use generative AI (GenAI) systems. The researchers looked at how developers' cognitive styles, their beliefs about what GenAI can do, and other factors shape their trust in these systems and their intentions to actually use them.
The study used a statistical approach called partial least squares structural equation modeling (PLS-SEM) to understand the relationships between all these different factors. This helps explain what is driving developers' thoughts and behaviors when it comes to generative AI.
The findings provide insights into how to design GenAI systems that developers will be more likely to trust and want to use in their work.
Technical Explanation
The researchers used a PLS-SEM approach to model the relationships between several key factors and developers' trust and behavioral intentions towards generative AI systems.
The model included constructs representing developers' cognitive styles (analytical vs. intuitive), their perceptions of GenAI's capabilities, and their trust in the technology. These were used to predict developers' intentions to use GenAI systems.
The results showed that developers' cognitive styles, perceptions of GenAI capabilities, and trust all significantly influenced their behavioral intentions. Analytical cognitive styles and higher perceived capabilities increased trust, which in turn led to greater intentions to use GenAI. The findings provide guidance on how to design GenAI systems that developers will be more likely to embrace.
Critical Analysis
The paper provides a comprehensive model for understanding the psychological and behavioral factors shaping developers' attitudes towards generative AI systems. However, the study is limited to a single cultural context (Germany) and may not generalize to other settings.
Additionally, the research focuses on developers' self-reported intentions rather than their actual usage behavior. Future work could validate the model by tracking developers' real-world use of GenAI over time.
There is also room to explore other potential influences, such as organizational factors, peer effects, and the specific features and capabilities of different GenAI systems. Incorporating these elements could further refine our understanding of what guides developers' choices when it comes to adopting generative AI technologies.
Conclusion
This study provides valuable insights into the psychological and behavioral factors shaping software developers' trust and intentions towards generative AI systems. The findings can help inform the design of GenAI technologies that are more likely to be embraced by the developer community. Further research is needed to validate the model and explore additional factors shaping these important human-AI interactions.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
What Guides Our Choices? Modeling Developers' Trust and Behavioral Intentions Towards GenAI
Rudrajit Choudhuri, Bianca Trinkenreich, Rahul Pandita, Eirini Kalliamvakou, Igor Steinmacher, Marco Gerosa, Christopher Sanchez, Anita Sarma
Generative AI (genAI) tools, such as ChatGPT or Copilot, are advertised to improve developer productivity and are being integrated into software development. However, misaligned trust, skepticism, and usability concerns can impede the adoption of such tools. Research also indicates that AI can be exclusionary, failing to support diverse users adequately. One such aspect of diversity is cognitive diversity -- variations in users' cognitive styles -- that leads to divergence in perspectives and interaction styles. When an individual's cognitive style is unsupported, it creates barriers to technology adoption. Therefore, to understand how to effectively integrate genAI tools into software development, it is first important to model what factors affect developers' trust and intentions to adopt genAI tools in practice? We developed a theoretical model to (1) identify factors that influence developers' trust in genAI tools and (2) examine the relationship between developers' trust, cognitive styles, and their intentions to use these tools. We surveyed software developers (N=238) at two major global tech organizations and employed Partial Least Squares-Structural Equation Modeling (PLS-SEM) to evaluate our model. Our findings reveal that genAI's system/output quality, functional value, and goal maintenance significantly influence developers' trust in these tools. Furthermore, developers' trust and cognitive styles influence their intentions to use these tools. We offer practical suggestions for designing genAI tools for effective use and inclusive user experience.
Read more9/9/2024
🛸
0
Investigating and Designing for Trust in AI-powered Code Generation Tools
Ruotong Wang, Ruijia Cheng, Denae Ford, Thomas Zimmermann
As AI-powered code generation tools such as GitHub Copilot become popular, it is crucial to understand software developers' trust in AI tools -- a key factor for tool adoption and responsible usage. However, we know little about how developers build trust with AI, nor do we understand how to design the interface of generative AI systems to facilitate their appropriate levels of trust. In this paper, we describe findings from a two-stage qualitative investigation. We first interviewed 17 developers to contextualize their notions of trust and understand their challenges in building appropriate trust in AI code generation tools. We surfaced three main challenges -- including building appropriate expectations, configuring AI tools, and validating AI suggestions. To address these challenges, we conducted a design probe study in the second stage to explore design concepts that support developers' trust-building process by 1) communicating AI performance to help users set proper expectations, 2) allowing users to configure AI by setting and adjusting preferences, and 3) offering indicators of model mechanism to support evaluation of AI suggestions. We gathered developers' feedback on how these design concepts can help them build appropriate trust in AI-powered code generation tools, as well as potential risks in design. These findings inform our proposed design recommendations on how to design for trust in AI-powered code generation tools.
Read more5/29/2024
0
A Meta-analysis of College Students' Intention to Use Generative Artificial Intelligence
Yifei Diao, Ziyi Li, Jiateng Zhou, Wei Gao, Xin Gong
It is of critical importance to analyse the factors influencing college students' intention to use generative artificial intelligence (GenAI) to understand and predict learners' learning behaviours and academic outcomes. Nevertheless, a lack of congruity has been shown in extant research results. This study, therefore, conducted a meta-analysis of 27 empirical studies under an integrated theoretical framework, including 87 effect sizes of independent research and 33,833 sample data. The results revealed that the main variables are strongly correlated with students' behavioural intention to use GenAI. Among them, performance expectancy (r = 0.389) and attitudes (r = 0.576) play particularly critical roles, and effort expectancy and habit are moderated by locational factors. Gender, notably, only moderated attitudes on students' behavioural intention to use GenAI. This study provides valuable insights for addressing the debate regarding students' intention to use GenAI in existed research, improving educational technology, as well as offering support for school decision-makers and educators to apply GenAI in school settings.
Read more9/12/2024
🤖
0
Children's Mental Models of Generative Visual and Text Based AI Models
Eliza Kosoy, Soojin Jeong, Anoop Sinha, Alison Gopnik, Tanya Kraljic
In this work we investigate how children ages 5-12 perceive, understand, and use generative AI models such as a text-based LLMs ChatGPT and a visual-based model DALL-E. Generative AI is newly being used widely since chatGPT. Children are also building mental models of generative AI. Those haven't been studied before and it is also the case that the children's models are dynamic as they use the tools, even with just very short usage. Upon surveying and experimentally observing over 40 children ages 5-12, we found that children generally have a very positive outlook towards AI and are excited about the ways AI may benefit and aid them in their everyday lives. In a forced choice, children robustly associated AI with positive adjectives versus negative ones. We also categorize what children are querying AI models for and find that children search for more imaginative things that don't exist when using a visual-based AI and not when using a text-based one. Our follow-up study monitored children's responses and feelings towards AI before and after interacting with GenAI models. We even find that children find AI to be less scary after interacting with it. We hope that these findings will shine a light on children's mental models of AI and provide insight for how to design the best possible tools for children who will inevitably be using AI in their lifetimes. The motivation of this work is to bridge the gap between Human-Computer Interaction (HCI) and Psychology in an effort to study the effects of AI on society. We aim to identify the gaps in humans' mental models of what AI is and how it works. Previous work has investigated how both adults and children perceive various kinds of robots, computers, and other technological concepts. However, there is very little work investigating these concepts for generative AI models and not simply embodied robots or physical technology.
Read more5/24/2024