Building Better Human-Agent Teams: Balancing Human Resemblance and Contribution in Voice Assistants

2308.11786

YC

0

Reddit

0

Published 5/20/2024 by Samuel Westby, Richard J. Radke, Christoph Riedl, Brooke Foucault Welles

šŸ

Abstract

Voice assistants are increasingly prevalent, from personal devices to team environments. This study explores how voice type and contribution quality influence human-agent team performance and perceptions of anthropomorphism, animacy, intelligence, and trustworthiness. By manipulating both, we reveal mechanisms of perception and clarify ambiguity in previous work. Our results show that the human resemblance of a voice assistant's voice negatively interacts with the helpfulness of an agent's contribution to flip its effect on perceived anthropomorphism and perceived animacy. This means human teammates interpret the agent's contributions differently depending on its voice. Our study found no significant effect of voice on perceived intelligence, trustworthiness, or team performance. We find differences in these measures are caused by manipulating the helpfulness of an agent. These findings suggest that function matters more than form when designing agents for high-performing human-agent teams, but controlling perceptions of anthropomorphism and animacy can be unpredictable even with high human resemblance.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This study explores how the voice type and contribution quality of voice assistants influence human perceptions and team performance.
  • The researchers manipulated the voice type (human-like vs. robotic) and helpfulness of an agent's contributions to understand how these factors impact perceived anthropomorphism, animacy, intelligence, and trustworthiness, as well as overall team performance.
  • The key finding is that the human resemblance of a voice assistant's voice negatively interacts with the helpfulness of its contributions, affecting perceptions of anthropomorphism and animacy in unpredictable ways.

Plain English Explanation

The researchers wanted to understand how the way a voice assistant sounds and how helpful it is affect how people perceive and work with it. They created different versions of a voice assistant, some with a more human-like voice and some with a more robotic voice. They also made some versions more helpful and others less helpful.

They found that when the voice assistant had a more human-like voice, people perceived it as less human-like (less anthropomorphic) and less lifelike (less animate) if it was not very helpful. But if the voice assistant was very helpful, people perceived it as more human-like and lifelike, even with the human-like voice.

This means that the function of the voice assistant, how helpful it is, matters more than just its form, how human-like it sounds. People interpret the assistant's contributions differently depending on its voice. However, controlling how human-like and lifelike the assistant seems can be tricky, even when it has a very human-like voice.

The study did not find any significant effects of the voice on how intelligent or trustworthy the assistant was seen as, or on the overall team performance. The differences in these measures were more due to how helpful the assistant was.

Technical Explanation

The researchers conducted an experiment where participants worked on a team task with a voice assistant. They manipulated two key factors: the voice type (human-like vs. robotic) and the quality of the assistant's contributions (helpful vs. unhelpful).

After interacting with the assistant, participants rated their perceptions of the assistant's anthropomorphism, animacy, intelligence, and trustworthiness. They also measured the team's overall performance on the task.

The key finding was a significant interaction between voice type and contribution quality. When the assistant had a more human-like voice but was not very helpful, participants perceived it as less anthropomorphic and less animate. However, when the assistant had a human-like voice and was helpful, participants perceived it as more anthropomorphic and animate.

This suggests that the function of the voice assistant, i.e., how helpful it is, matters more than just its form, i.e., how human-like it sounds. People's interpretations of the assistant's contributions are influenced by the interplay between voice and helpfulness.

Importantly, the study found no significant effects of voice on perceptions of intelligence, trustworthiness, or team performance. These measures were more influenced by the helpfulness of the assistant's contributions.

Critical Analysis

The study provides valuable insights into how the design of voice assistants can impact human perceptions and team dynamics. However, there are some limitations to consider.

First, the experiment used a relatively simple task and a single interaction with the voice assistant. Real-world team dynamics and perceptions may evolve over longer-term collaborations, which could lead to different findings.

Additionally, the study focused on a binary distinction between human-like and robotic voices. In practice, voice assistants can have a wide range of voice characteristics, and the relationship between voice and perceptions may be more nuanced.

Further research could explore a broader range of voice types, as well as investigate how factors like personality, emotion, and context influence the interplay between voice and contribution quality. Examining these aspects could provide a more comprehensive understanding of how to design effective and trustworthy voice assistants for human-agent teams.

Conclusion

This study highlights the importance of considering both form and function when designing voice assistants for human-agent teams. While the human resemblance of a voice assistant's voice can impact perceptions of anthropomorphism and animacy, the helpfulness of the assistant's contributions appears to be a stronger driver of overall team performance and perceptions of intelligence and trustworthiness.

These findings suggest that function matters more than form when creating voice assistants for high-performing teams. However, controlling perceptions of anthropomorphism and animacy can be challenging, even with a highly human-like voice. Designers of voice assistants should carefully consider the interplay between voice characteristics and the assistant's capabilities to create effective and trustworthy collaborations with human teammates.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

šŸ¤–

From AI to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?

Nanna Inie, Stefania Druga, Peter Zukerman, Emily M. Bender

YC

0

Reddit

0

This paper investigates the influence of anthropomorphized descriptions of so-called AI (artificial intelligence) systems on people's self-assessment of trust in the system. Building on prior work, we define four categories of anthropomorphization (1. Properties of a cognizer, 2. Agency, 3. Biological metaphors, and 4. Properties of a communicator). We use a survey-based approach (n=954) to investigate whether participants are likely to trust one of two (fictitious) AI systems by randomly assigning people to see either an anthropomorphized or a de-anthropomorphized description of the systems. We find that participants are no more likely to trust anthropomorphized over de-anthropmorphized product descriptions overall. The type of product or system in combination with different anthropomorphic categories appears to exert greater influence on trust than anthropomorphizing language alone, and age is the only demographic factor that significantly correlates with people's preference for anthropomorphized or de-anthropomorphized descriptions. When elaborating on their choices, participants highlight factors such as lesser of two evils, lower or higher stakes contexts, and human favoritism as driving motivations when choosing between product A and B, irrespective of whether they saw an anthropomorphized or a de-anthropomorphized description of the product. Our results suggest that anthropomorphism in AI descriptions is an aggregate concept that may influence different groups differently, and provide nuance to the discussion of whether anthropomorphization leads to higher trust and over-reliance by the general public in systems sold as AI.

Read more

4/26/2024

šŸ“Š

Warmth and competence in human-agent cooperation

Kevin R. McKee, Xuechunzi Bai, Susan T. Fiske

YC

0

Reddit

0

Interaction and cooperation with humans are overarching aspirations of artificial intelligence (AI) research. Recent studies demonstrate that AI agents trained with deep reinforcement learning are capable of collaborating with humans. These studies primarily evaluate human compatibility through objective metrics such as task performance, obscuring potential variation in the levels of trust and subjective preference that different agents garner. To better understand the factors shaping subjective preferences in human-agent cooperation, we train deep reinforcement learning agents in Coins, a two-player social dilemma. We recruit $N = 501$ participants for a human-agent cooperation study and measure their impressions of the agents they encounter. Participants' perceptions of warmth and competence predict their stated preferences for different agents, above and beyond objective performance metrics. Drawing inspiration from social science and biology research, we subsequently implement a new ``partner choice'' framework to elicit revealed preferences: after playing an episode with an agent, participants are asked whether they would like to play the next episode with the same agent or to play alone. As with stated preferences, social perception better predicts participants' revealed preferences than does objective performance. Given these results, we recommend human-agent interaction researchers routinely incorporate the measurement of social perception and subjective preferences into their studies.

Read more

5/10/2024

Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models

Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models

Michelle Cohn, Mahima Pushkarna, Gbolahan O. Olanubi, Joseph M. Moran, Daniel Padgett, Zion Mengesha, Courtney Heldreth

YC

0

Reddit

0

People now regularly interface with Large Language Models (LLMs) via speech and text (e.g., Bard) interfaces. However, little is known about the relationship between how users anthropomorphize an LLM system (i.e., ascribe human-like characteristics to a system) and how they trust the information the system provides. Participants (n=2,165; ranging in age from 18-90 from the United States) completed an online experiment, where they interacted with a pseudo-LLM that varied in modality (text only, speech + text) and grammatical person (I vs. the system) in its responses. Results showed that the speech + text condition led to higher anthropomorphism of the system overall, as well as higher ratings of accuracy of the information the system provides. Additionally, the first-person pronoun (I) led to higher information accuracy and reduced risk ratings, but only in one context. We discuss these findings for their implications for the design of responsible, human-generative AI experiences.

Read more

5/13/2024

šŸŒæ

Examining Humanness as a Metaphor to Design Voice User Interfaces

Smit Desai, Mateusz Dubiel, Luis A. Leiva

YC

0

Reddit

0

Voice User Interfaces (VUIs) increasingly leverage 'humanness' as a foundational design metaphor, adopting roles like 'assistants,' 'teachers,' and 'secretaries' to foster natural interactions. Yet, this approach can sometimes misalign user trust and reinforce societal stereotypes, leading to socio-technical challenges that might impede long-term engagement. This paper explores an alternative approach to navigate these challenges-incorporating non-human metaphors in VUI design. We report on a study with 240 participants examining the effects of human versus non-human metaphors on user perceptions within health and finance domains. Results indicate a preference for the human metaphor (doctor) over the non-human (health encyclopedia) in health contexts for its perceived enjoyability and likeability. In finance, however, user perceptions do not significantly differ between human (financial advisor) and non-human (calculator) metaphors. Importantly, our research reveals that the explicit awareness of a metaphor's use influences adoption intentions, with a marked preference for non-human metaphors when their metaphorical nature is not disclosed. These findings highlight context-specific conversation design strategies required in integrating non-human metaphors into VUI design, suggesting tradeoffs and design considerations that could enhance user engagement and adoption.

Read more

5/14/2024