From AI to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?

Read original: arXiv:2404.16047 - Published 4/26/2024 by Nanna Inie, Stefania Druga, Peter Zukerman, Emily M. Bender
Total Score

0

🤖

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

• This paper investigates how the use of human-like language to describe AI systems (called "anthropomorphization") affects people's trust in those systems.

• The researchers define four categories of anthropomorphization and use a survey to see if participants trust an anthropomorphized AI system more than a de-anthropomorphized one.

• They find that anthropomorphic language alone does not significantly increase trust, but the type of AI system and other factors play a bigger role in how much people trust it.

Plain English Explanation

The paper looks at whether describing AI systems using human-like language, such as giving them "thoughts" or "feelings," makes people more likely to trust those systems. The researchers set up an experiment where they showed participants one of two fictional AI products, with one description using more human-like language and the other using more neutral, technical language.

The results suggest that the type of AI system and other contextual factors, like whether the stakes are high or low, matter more for trust than just the language used to describe the system. For example, people may be more willing to trust an AI assistant for a low-stakes task like scheduling, even if it's described in human-like terms, but be more skeptical of an AI system making important medical decisions, even if it's described in neutral terms.

The researchers also found that age was the only demographic factor that significantly influenced people's preferences, with older participants tending to trust the anthropomorphized descriptions more. This suggests that the effects of anthropomorphization on trust can vary across different groups of people.

Overall, the paper provides a more nuanced understanding of how anthropomorphism in AI affects public trust, rather than a simple conclusion that it either increases or decreases trust. It highlights the importance of considering the specific context and user characteristics when designing AI systems and their descriptions.

Technical Explanation

The paper investigates the influence of anthropomorphized descriptions of AI systems on people's trust in those systems. Building on prior work, the researchers define four categories of anthropomorphization: 1) attributing human-like properties of a "cognizer" to the AI, 2) describing the AI as having agency or intentionality, 3) using biological metaphors, and 4) portraying the AI as a human-like communicator.

Using a survey-based experiment (n=954), the researchers randomly assigned participants to see either an anthropomorphized or a de-anthropomorphized description of one of two (fictitious) AI systems. They then measured the participants' trust in the system.

Contrary to the researchers' expectations, the results showed that participants were no more likely to trust the anthropomorphized descriptions overall. Instead, the type of AI system and its context seemed to have a greater influence on trust than the language used to describe it.

The paper also found that age was the only demographic factor that significantly correlated with people's preferences, with older participants tending to trust the anthropomorphized descriptions more. When explaining their choices, participants cited factors like the "lesser of two evils," the stakes involved, and human favoritism as driving their trust decisions, regardless of whether the description was anthropomorphized or not.

The researchers conclude that anthropomorphism in AI descriptions is a nuanced concept that may impact different groups in different ways. The findings suggest the need to consider the specific AI application, user characteristics, and contextual factors, rather than relying solely on anthropomorphic language, when designing AI systems and their public representations.

Critical Analysis

The paper provides a valuable contribution to the understanding of how anthropomorphism affects public trust in AI systems. By exploring different types of anthropomorphization and testing them across a range of AI applications, the researchers offer a more nuanced perspective than previous studies that have often found a simple relationship between anthropomorphism and trust.

One limitation of the study is that it relies on fictional AI systems, which may not fully capture people's reactions to real-world AI products and services. Additionally, the survey-based approach, while useful for establishing general trends, may not reveal the more subtle or context-dependent factors that influence trust in actual interactions with AI.

Further research could explore how the findings translate to different cultural contexts, as perceptions of anthropomorphism and trust in technology may vary across societies. Investigating the long-term effects of repeated exposure to anthropomorphized AI, and how that shapes trust over time, could also offer valuable insights.

Overall, the paper challenges the simplistic notion that anthropomorphizing AI will automatically lead to greater public trust. Instead, it highlights the need to consider the complex interplay between the AI system, its intended use, user characteristics, and the specific language used to describe it. This nuanced understanding can help guide the responsible development and deployment of AI technologies that foster appropriate levels of trust.

Conclusion

This paper provides a more nuanced understanding of how the use of anthropomorphic language to describe AI systems affects public trust. The researchers found that anthropomorphic language alone does not significantly increase trust, but rather the type of AI system and other contextual factors play a larger role.

The findings suggest that designers of AI systems and their public representations should consider the specific application, user characteristics, and contextual factors, rather than relying solely on anthropomorphic language, to foster appropriate levels of trust. By taking a more holistic approach, the development and deployment of AI technologies can be guided by a deeper understanding of the complex relationship between language, trust, and the diverse perspectives of the public.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤖

Total Score

0

From AI to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?

Nanna Inie, Stefania Druga, Peter Zukerman, Emily M. Bender

This paper investigates the influence of anthropomorphized descriptions of so-called AI (artificial intelligence) systems on people's self-assessment of trust in the system. Building on prior work, we define four categories of anthropomorphization (1. Properties of a cognizer, 2. Agency, 3. Biological metaphors, and 4. Properties of a communicator). We use a survey-based approach (n=954) to investigate whether participants are likely to trust one of two (fictitious) AI systems by randomly assigning people to see either an anthropomorphized or a de-anthropomorphized description of the systems. We find that participants are no more likely to trust anthropomorphized over de-anthropmorphized product descriptions overall. The type of product or system in combination with different anthropomorphic categories appears to exert greater influence on trust than anthropomorphizing language alone, and age is the only demographic factor that significantly correlates with people's preference for anthropomorphized or de-anthropomorphized descriptions. When elaborating on their choices, participants highlight factors such as lesser of two evils, lower or higher stakes contexts, and human favoritism as driving motivations when choosing between product A and B, irrespective of whether they saw an anthropomorphized or a de-anthropomorphized description of the product. Our results suggest that anthropomorphism in AI descriptions is an aggregate concept that may influence different groups differently, and provide nuance to the discussion of whether anthropomorphization leads to higher trust and over-reliance by the general public in systems sold as AI.

Read more

4/26/2024

Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models
Total Score

0

Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models

Michelle Cohn, Mahima Pushkarna, Gbolahan O. Olanubi, Joseph M. Moran, Daniel Padgett, Zion Mengesha, Courtney Heldreth

People now regularly interface with Large Language Models (LLMs) via speech and text (e.g., Bard) interfaces. However, little is known about the relationship between how users anthropomorphize an LLM system (i.e., ascribe human-like characteristics to a system) and how they trust the information the system provides. Participants (n=2,165; ranging in age from 18-90 from the United States) completed an online experiment, where they interacted with a pseudo-LLM that varied in modality (text only, speech + text) and grammatical person (I vs. the system) in its responses. Results showed that the speech + text condition led to higher anthropomorphism of the system overall, as well as higher ratings of accuracy of the information the system provides. Additionally, the first-person pronoun (I) led to higher information accuracy and reduced risk ratings, but only in one context. We discuss these findings for their implications for the design of responsible, human-generative AI experiences.

Read more

5/13/2024

🐍

Total Score

0

Building Better Human-Agent Teams: Balancing Human Resemblance and Contribution in Voice Assistants

Samuel Westby, Richard J. Radke, Christoph Riedl, Brooke Foucault Welles

Voice assistants are increasingly prevalent, from personal devices to team environments. This study explores how voice type and contribution quality influence human-agent team performance and perceptions of anthropomorphism, animacy, intelligence, and trustworthiness. By manipulating both, we reveal mechanisms of perception and clarify ambiguity in previous work. Our results show that the human resemblance of a voice assistant's voice negatively interacts with the helpfulness of an agent's contribution to flip its effect on perceived anthropomorphism and perceived animacy. This means human teammates interpret the agent's contributions differently depending on its voice. Our study found no significant effect of voice on perceived intelligence, trustworthiness, or team performance. We find differences in these measures are caused by manipulating the helpfulness of an agent. These findings suggest that function matters more than form when designing agents for high-performing human-agent teams, but controlling perceptions of anthropomorphism and animacy can be unpredictable even with high human resemblance.

Read more

5/20/2024

🎲

Total Score

0

Trust in AI: Progress, Challenges, and Future Directions

Saleh Afroogh, Ali Akbari, Evan Malone, Mohammadali Kargar, Hananeh Alambeigi

The increasing use of artificial intelligence (AI) systems in our daily life through various applications, services, and products explains the significance of trust/distrust in AI from a user perspective. AI-driven systems (as opposed to other technologies) have ubiquitously diffused in our life not only as some beneficial tools to be used by human agents but also are going to be substitutive agents on our behalf, or manipulative minds that would influence human thought, decision, and agency. Trust/distrust in AI plays the role of a regulator and could significantly control the level of this diffusion, as trust can increase, and distrust may reduce the rate of adoption of AI. Recently, varieties of studies have paid attention to the variant dimension of trust/distrust in AI, and its relevant considerations. In this systematic literature review, after conceptualization of trust in the current AI literature review, we will investigate trust in different types of human-Machine interaction, and its impact on technology acceptance in different domains. In addition to that, we propose a taxonomy of technical (i.e., safety, accuracy, robustness) and non-technical axiological (i.e., ethical, legal, and mixed) trustworthiness metrics, and some trustworthy measurements. Moreover, we examine some major trust-breakers in AI (e.g., autonomy and dignity threat), and trust makers; and propose some future directions and probable solutions for the transition to a trustworthy AI.

Read more

4/5/2024