Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

Overview

• The growing popularity of conversational AI agents based on large language models (LLMs) raises concerns about ensuring their ethical and appropriate behavior.
• Current approaches focus on the "HHH" criteria: making outputs more helpful, honest, and avoiding harmful (biased, toxic, or inaccurate) statements.
• However, this semantic focus fails to account for pragmatic factors that can impact the perceived tactfulness or considerateness of an AI's interactions in different social situations.
• As AI systems become more agentic and proactive, considering the pragmatics of interaction is essential.

Plain English Explanation

As conversational AI agents powered by large language models (LLMs) become more common, it's important to make sure they behave in an ethical and appropriate way. Current approaches often focus on ensuring the AI's outputs are helpful, honest, and avoid harmful (biased, inaccurate, or toxic) statements. This semantic focus is useful, but it doesn't fully account for how the

of an interaction can impact whether the AI's statements come across as tactful or considerate.

As AI systems become more proactive and start taking actions in the world, understanding the

of social interaction becomes crucial. It's not just about the content of what the AI says, but how it says it and in what situations. The paper proposes an interactional approach to ethics that considers relational and situational factors. The goal is to explore what it means for an AI system, as a social actor, to treat people respectfully during interactions.

This work anticipates some largely unexplored risks at the level of situated social interaction and offers practical suggestions to help ensure agentic LLM technologies treat people well.

Technical Explanation

The paper argues that while the "HHH" (helpful, honest, and harmless) criteria are useful for evaluating the outputs of LLM-based conversational agents, they fail to account for the pragmatic factors that can influence the perceived tactfulness or considerateness of an AI's speech acts in different social situations.

As AI systems become more agentic and proactive in pursuing goals and taking actions in the world, the authors propose an

that focuses on relational and situational factors. They explore what it means for an AI system, as a social actor, to treat individuals respectfully during a (series of) interactions.

The paper anticipates a set of largely unexplored risks at the level of situated social interaction, such as issues that may arise as AI assistants become more proactive and autonomous. The authors offer practical suggestions to help ensure that agentic LLM technologies treat people well, building on work in human-centered proactive conversational agents.

Critical Analysis

The paper raises important points about the limitations of current approaches to ethical AI that focus solely on the semantic content of outputs. It rightly identifies the need to consider pragmatic factors and the AI's role as a social actor in interactions.

However, the paper does not provide detailed examples or case studies to illustrate the specific pragmatic risks it anticipates. While it offers high-level suggestions, more concrete guidance on how to design AI systems that account for situational and relational considerations would be helpful.

Additionally, the paper does not address potential challenges in operationalizing an "interactional approach to ethics," such as how to define and measure respectful treatment in diverse cultural contexts. Further research may be needed to develop practical frameworks for implementing this approach.

Overall, the paper makes a valuable contribution by highlighting the importance of considering the pragmatics of AI-human interaction, but more work is needed to translate these insights into actionable design principles and evaluation methods.

Conclusion

This paper argues that as conversational AI agents become more advanced and agentic, we need to move beyond a narrow focus on the semantic content of their outputs and consider the pragmatic factors that influence the perceived tactfulness and considerateness of their interactions.

The authors propose an "interactional approach to ethics" that examines what it means for an AI system, as a social actor, to treat people respectfully in different situations. This shifts the emphasis from the AI's internal decision-making processes to its situated performance as a relational partner.

While the paper does not provide detailed implementation guidance, it highlights an important direction for future research and development in ethical AI. By anticipating the pragmatic risks of agentic AI systems, this work lays the groundwork for designing conversational agents that can engage in more thoughtful, considerate, and socially appropriate interactions.