Spoken Humanoid Embodied Conversational Agents in Mobile Serious Games: A Usability Assessment

Read original: arXiv:2309.07773 - Published 6/11/2024 by Danai Korre, Judy Robertson
Total Score

0

🖼️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper investigates how human-like Embodied Conversational Agents (ECAs) can improve the usability of mobile serious games.
  • The study compares two versions of an agent: one with high human-likeness and one with low human-likeness (text-only).
  • The goal is to assess whether highly human-like agents can create a stronger "illusion of humanness" and impact the overall user experience.

Plain English Explanation

The researchers wanted to see if using human-like virtual characters, or Embodied Conversational Agents (ECAs), could make mobile games more enjoyable and easier to use. They created two versions of a virtual agent - one that looked and sounded very human-like, and one that was just text.

The researchers then had 90 people try out the two versions and share their preferences. The results showed that most people preferred interacting with the highly human-like agent. They said the agent's human-like qualities made the experience more appealing.

This suggests that designing ECAs to be very realistic and human-like, as described in the ECA design model, could improve how people interact with and enjoy mobile games. This could help make these "serious games" more engaging and effective for learning or training purposes.

Technical Explanation

The experiment investigated two styles of agent presentation: a highly human-like HECA (Humanoid Embodied Conversational Agent) and a low human-likeness text-only agent. The HECA was designed following the ECA design model, which provides guidelines for developing realistic and human-like ECAs.

The researchers conducted an experiment with 90 participants to assess the impact of agent humanlikeness on usability metrics like appeal and perceived humanness. The results showed a statistically significant preference for the HECA version, with a large effect size (d=1.01). Participants justified their preference by citing the human-like characteristics of the HECA as making it more appealing.

This supports the idea that highly human-embodied AI agents can positively impact the user experience in mobile serious games, as described in prior work on building better human-agent teams and social influence of embodied AI.

Critical Analysis

The paper provides valuable insights into the potential benefits of highly human-like ECAs for mobile serious games. However, the research is limited to a single experiment and may not generalize to all game genres or user demographics.

Additionally, the paper does not delve into potential downsides or unintended consequences of highly realistic ECAs, such as the risk of creating false expectations or mistrust. Further research is needed to fully understand the tradeoffs and design considerations for using human-like ECAs in interactive applications.

Conclusion

This research suggests that designing Embodied Conversational Agents to be highly human-like can improve the user experience in mobile serious games. By creating a stronger "illusion of humanness," these agents may make the games more appealing and engaging for players.

While promising, this is an area that requires further exploration to understand the full implications and potential pitfalls. Nonetheless, this study provides valuable insights that can inform the development of future mobile serious games and conversational AI systems aimed at enhancing user experiences.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🖼️

Total Score

0

Spoken Humanoid Embodied Conversational Agents in Mobile Serious Games: A Usability Assessment

Danai Korre, Judy Robertson

This paper presents an empirical investigation of the extent to which spoken Humanoid Embodied Conversational Agents (HECAs) can foster usability in mobile serious game (MSG) applications. The aim of the research is to assess the impact of multiple agents and illusion of humanness on the quality of the interaction. The experiment investigates two styles of agent presentation: an agent of high human-likeness (HECA) and an agent of low human-likeness (text). The purpose of the experiment is to assess whether and how agents of high humanlikeness can evoke the illusion of humanness and affect usability. Agents of high human-likeness were designed by following the ECA design model that is a proposed guide for ECA development. The results of the experiment with 90 participants show that users prefer to interact with the HECAs. The difference between the two versions is statistically significant with a large effect size (d=1.01), with many of the participants justifying their choice by saying that the human-like characteristics of the HECA made the version more appealing. This research provides key information on the potential effect of HECAs on serious games, which can provide insight into the design of future mobile serious games.

Read more

6/11/2024

🚀

Total Score

0

Empathy Through Multimodality in Conversational Interfaces

Mahyar Abbasian, Iman Azimi, Mohammad Feli, Amir M. Rahmani, Ramesh Jain

Agents represent one of the most emerging applications of Large Language Models (LLMs) and Generative AI, with their effectiveness hinging on multimodal capabilities to navigate complex user environments. Conversational Health Agents (CHAs), a prime example of this, are redefining healthcare by offering nuanced support that transcends textual analysis to incorporate emotional intelligence. This paper introduces an LLM-based CHA engineered for rich, multimodal dialogue-especially in the realm of mental health support. It adeptly interprets and responds to users' emotional states by analyzing multimodal cues, thus delivering contextually aware and empathetically resonant verbal responses. Our implementation leverages the versatile openCHA framework, and our comprehensive evaluation involves neutral prompts expressed in diverse emotional tones: sadness, anger, and joy. We evaluate the consistency and repeatability of the planning capability of the proposed CHA. Furthermore, human evaluators critique the CHA's empathic delivery, with findings revealing a striking concordance between the CHA's outputs and evaluators' assessments. These results affirm the indispensable role of vocal (soon multimodal) emotion recognition in strengthening the empathetic connection built by CHAs, cementing their place at the forefront of interactive, compassionate digital health solutions.

Read more

5/9/2024

⛏️

Total Score

0

No Joke: An Embodied Conversational Agent Greeting Older Adults with Humour or a Smile Unrelated to Initial Acceptance

Ge Rikaku Li, Katie Seaborn

Embodied conversation agents (ECAs) are increasingly being developed for older adults as assistants or companions. Older adults may not be familiar with ECAs, influencing uptake and acceptability. First impressions can correlate strongly with subsequent judgments, even of computer agents, and could influence acceptance. Using the circumplex model of affect, we developed three versions of an ECA -- laughing, smiling, and neutral in expression -- to evaluate how positive first impressions affect acceptance. Results from 249 older adults indicated no statistically significant effects except for general attitudes towards technology and intelligent agents. This questions the potential of laughter, jokes, puns, and smiles as a method of initial engagement for older adults.

Read more

5/15/2024

🐍

Total Score

0

Building Better Human-Agent Teams: Balancing Human Resemblance and Contribution in Voice Assistants

Samuel Westby, Richard J. Radke, Christoph Riedl, Brooke Foucault Welles

Voice assistants are increasingly prevalent, from personal devices to team environments. This study explores how voice type and contribution quality influence human-agent team performance and perceptions of anthropomorphism, animacy, intelligence, and trustworthiness. By manipulating both, we reveal mechanisms of perception and clarify ambiguity in previous work. Our results show that the human resemblance of a voice assistant's voice negatively interacts with the helpfulness of an agent's contribution to flip its effect on perceived anthropomorphism and perceived animacy. This means human teammates interpret the agent's contributions differently depending on its voice. Our study found no significant effect of voice on perceived intelligence, trustworthiness, or team performance. We find differences in these measures are caused by manipulating the helpfulness of an agent. These findings suggest that function matters more than form when designing agents for high-performing human-agent teams, but controlling perceptions of anthropomorphism and animacy can be unpredictable even with high human resemblance.

Read more

5/20/2024