From Explainable to Interactive AI: A Literature Review on Current Trends in Human-AI Interaction
2405.15051
0
0
Abstract
AI systems are increasingly being adopted across various domains and application areas. With this surge, there is a growing research focus and societal concern for actively involving humans in developing, operating, and adopting these systems. Despite this concern, most existing literature on AI and Human-Computer Interaction (HCI) primarily focuses on explaining how AI systems operate and, at times, allowing users to contest AI decisions. Existing studies often overlook more impactful forms of user interaction with AI systems, such as giving users agency beyond contestability and enabling them to adapt and even co-design the AI's internal mechanics. In this survey, we aim to bridge this gap by reviewing the state-of-the-art in Human-Centered AI literature, the domain where AI and HCI studies converge, extending past Explainable and Contestable AI, delving into the Interactive AI and beyond. Our analysis contributes to shaping the trajectory of future Interactive AI design and advocates for a more user-centric approach that provides users with greater agency, fostering not only their understanding of AI's workings but also their active engagement in its development and evolution.
Create account to get full access
Overview
ā¢ This paper provides a literature review on the current trends in human-AI interaction, focusing on the transition from explainable AI to interactive AI.
Plain English Explanation
The paper examines how the field of human-AI interaction is evolving, moving beyond just explaining AI decisions to enabling more interactive and collaborative experiences between humans and AI systems. It explores various approaches to making AI more interactive and adaptable, including interactive visualizations and negotiating shared agency between humans and AI. The review also covers interactive question-answering systems and efforts to make AI decisions more transparent and understandable to users. By making AI more interactive and explainable, the goal is to foster better collaboration and trust between humans and AI systems.
Technical Explanation
The paper begins by providing background on the evolution of human-AI interaction, from early focus on explainability to the more recent emphasis on interactivity. It then reviews the current landscape of research in this area, covering topics such as interactive visualization, shared agency between humans and AI, and interactive question-answering systems.
The review examines various approaches to making AI more adaptable and responsive to user needs, including techniques for deconstructing human-AI collaboration and negotiating shared agency. It also explores efforts to make AI decisions more transparent and explainable through interactive visualization and other interactive question-answering systems.
Critical Analysis
The paper provides a comprehensive overview of the current state of research in human-AI interaction, but it acknowledges that there are still many challenges and areas for further exploration. For example, the review notes that while progress has been made in making AI more interactive and explainable, there are still concerns about the trustworthiness and reliability of AI systems, especially in high-stakes applications.
Additionally, the paper suggests that more research is needed to understand the long-term effects of human-AI collaboration and the potential for AI systems to adapt and evolve over time. There are also questions about the ethical implications of increasingly interactive and autonomous AI systems, and how to ensure that they align with human values and priorities.
Conclusion
Overall, this literature review highlights the important shift in human-AI interaction from a focus on explainability to a focus on interactivity and collaboration. By making AI systems more responsive, adaptable, and transparent, researchers hope to foster better trust and cooperation between humans and AI, ultimately leading to more effective and beneficial AI-powered applications. However, the review also underscores the need for continued research and careful consideration of the ethical and societal implications of this evolving field.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Explainable Human-AI Interaction: A Planning Perspective
Sarath Sreedharan, Anagha Kulkarni, Subbarao Kambhampati
0
0
From its inception, AI has had a rather ambivalent relationship with humans -- swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI systems to work synergistically with humans. One critical requirement for such synergistic human-AI interaction is that the AI systems be explainable to the humans in the loop. To do this effectively, AI agents need to go beyond planning with their own models of the world, and take into account the mental model of the human in the loop. Drawing from several years of research in our lab, we will discuss how the AI agent can use these mental models to either conform to human expectations, or change those expectations through explanatory communication. While the main focus of the book is on cooperative scenarios, we will point out how the same mental models can be used for obfuscation and deception. Although the book is primarily driven by our own research in these areas, in every chapter, we will provide ample connections to relevant research from other groups.
5/28/2024
Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation
Steffen Holter, Mennatallah El-Assady
0
0
As full AI-based automation remains out of reach in most real-world applications, the focus has instead shifted to leveraging the strengths of both human and AI agents, creating effective collaborative systems. The rapid advances in this area have yielded increasingly more complex systems and frameworks, while the nuance of their characterization has gotten more vague. Similarly, the existing conceptual models no longer capture the elaborate processes of these systems nor describe the entire scope of their collaboration paradigms. In this paper, we propose a new unified set of dimensions through which to analyze and describe human-AI systems. Our conceptual model is centered around three high-level aspects - agency, interaction, and adaptation - and is developed through a multi-step process. Firstly, an initial design space is proposed by surveying the literature and consolidating existing definitions and conceptual frameworks. Secondly, this model is iteratively refined and validated by conducting semi-structured interviews with nine researchers in this field. Lastly, to illustrate the applicability of our design space, we utilize it to provide a structured description of selected human-AI systems.
4/19/2024
š¤
Harder, Better, Faster, Stronger: Interactive Visualization for Human-Centered AI Tools
Md Naimul Hoque, Sungbok Shin, Niklas Elmqvist
0
0
Human-centered AI (HCAI), rather than replacing the human, puts the human user in the driver's seat of so-called human-centered AI-infused tools (HCAI tools): interactive software tools that amplify, augment, empower, and enhance human performance using AI models; often novel generative or foundation AI ones. In this paper, we discuss how interactive visualization can be a key enabling technology for creating such human-centered AI tools. Visualization has already been shown to be a fundamental component in explainable AI models, and coupling this with data-driven, semantic, and unified interaction feedback loops will enable a human-centered approach to integrating AI models in the loop with human users. We present several examples of our past and current work on such HCAI tools, including for creative writing, temporal prediction, and user experience analysis. We then draw parallels between these tools to suggest common themes on how interactive visualization can support the design of future HCAI tools.
4/3/2024
Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions
Hua Shen, Tiffany Knearem, Reshmi Ghosh, Kenan Alkiek, Kundan Krishna, Yachuan Liu, Ziqiao Ma, Savvas Petridis, Yi-Hao Peng, Li Qiwei, Sushrita Rakshit, Chenglei Si, Yutong Xie, Jeffrey P. Bigham, Frank Bentley, Joyce Chai, Zachary Lipton, Qiaozhu Mei, Rada Mihalcea, Michael Terry, Diyi Yang, Meredith Ringel Morris, Paul Resnick, David Jurgens
0
0
Recent advancements in general-purpose AI have highlighted the importance of guiding AI systems towards the intended goals, ethical principles, and values of individuals and groups, a concept broadly recognized as alignment. However, the lack of clarified definitions and scopes of human-AI alignment poses a significant obstacle, hampering collaborative efforts across research domains to achieve this alignment. In particular, ML- and philosophy-oriented alignment research often views AI alignment as a static, unidirectional process (i.e., aiming to ensure that AI systems' objectives match humans) rather than an ongoing, mutual alignment problem [429]. This perspective largely neglects the long-term interaction and dynamic changes of alignment. To understand these gaps, we introduce a systematic review of over 400 papers published between 2019 and January 2024, spanning multiple domains such as Human-Computer Interaction (HCI), Natural Language Processing (NLP), Machine Learning (ML), and others. We characterize, define and scope human-AI alignment. From this, we present a conceptual framework of Bidirectional Human-AI Alignment to organize the literature from a human-centered perspective. This framework encompasses both 1) conventional studies of aligning AI to humans that ensures AI produces the intended outcomes determined by humans, and 2) a proposed concept of aligning humans to AI, which aims to help individuals and society adjust to AI advancements both cognitively and behaviorally. Additionally, we articulate the key findings derived from literature analysis, including discussions about human values, interaction techniques, and evaluations. To pave the way for future studies, we envision three key challenges for future directions and propose examples of potential future solutions.
6/18/2024