Doing AI: Algorithmic decision support as a human activity
0
🔎
Sign in to get full access
Overview
- Algorithmic decision support (ADS) systems, powered by machine learning AI, are becoming increasingly common in many organizations.
- The goal of using ADS is to improve decision-making by leveraging data and potentially overcoming biases that can affect human decision-making.
- However, the development and deployment of ADS systems involves a series of human decisions that are often unspecified.
Plain English Explanation
ADS systems, which use AI and machine learning, are being adopted by more and more organizations. The idea is that these systems can help improve decision-making by using data in a way that may overcome the biases and limitations that can affect human judgment. Deconstructing Human-AI Collaboration: Agency, Interaction, Adaptation
But when you look closely at how these ADS systems are actually created and used in real organizations, you realize there are a lot of human decisions involved that aren't always clearly defined. It starts with deciding which decisions should use an ADS system, continues through the choices made in developing and deploying the system, and ends with how the output from the ADS is used in the organization's operations. Fair Machine Guidance to Enhance Fair Decision
Understanding these human decisions and the behavioral factors at play is really important for successfully implementing ADS systems in organizations. Towards Optimizing Human-Centric Objectives in AI-Assisted Decision-Making It helps us assess the full process and identify any vulnerabilities or potential issues.
Technical Explanation
The paper provides an overview of the key human decisions involved in the development and use of ADS systems in organizational settings. It highlights that these systems necessarily involve a series of human choices, starting from the initial deliberations on which decisions to automate, continuing through the specific choices made during the ADS development and deployment, and ending with how the ADS output is used in the organization's operations.
The authors point out that these human decisions are often not well-specified or documented, despite their importance in shaping the ultimate impact of the ADS system. The paper examines some relevant behavioral phenomena that can influence these decisions, such as biases and heuristics. Synergising Human-like Responses with Machine Intelligence for Planning and Coordination
Critical Analysis
The paper rightly emphasizes the need for further research to fully understand the behavioral aspects of ADS development and use in organizations. While the high-level overview provided is useful, more detailed investigation is required to uncover the specific human decision points, the factors influencing them, and their downstream consequences.
One limitation of the paper is that it does not delve deeply into potential issues or risks associated with the human decisions involved. For example, it does not explore how organizational politics, power dynamics, or conflicts of interest could shape the choices made about ADS systems. Trust in AI: Progress, Challenges, and Future Directions Addressing these types of concerns would strengthen the analysis and provide a more holistic understanding of the challenges in this area.
Conclusion
This paper highlights an important but often overlooked aspect of ADS systems - the critical role of human decision-making throughout their lifecycle. By deconstructing the various human choices involved, from initial deployment considerations to operational use, the authors underscore the need to carefully study the behavioral factors at play. This understanding is essential for successfully implementing ADS in a way that maximizes the benefits while mitigating potential risks and unintended consequences.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🔎
0
Doing AI: Algorithmic decision support as a human activity
Joachim Meyer
Algorithmic decision support (ADS), using Machine-Learning-based AI, is becoming a major part of many processes. Organizations introduce ADS to improve decision-making and use available data, thereby possibly limiting deviations from the normative homo economicus and the biases that characterize human decision-making. However, a closer look at the development and use of ADS systems in organizational settings reveals that they necessarily involve a series of largely unspecified human decisions. They begin with deliberations for which decisions to use ADS, continue with choices while developing and deploying the ADS, and end with decisions on how to use the ADS output in an organization's operations. The paper presents an overview of these decisions and some relevant behavioral phenomena. It points out directions for further research, which is essential for correctly assessing the processes and their vulnerabilities. Understanding these behavioral aspects is important for successfully implementing ADS in organizations.
Read more4/23/2024
➖
0
New!Questioning AI: Promoting Decision-Making Autonomy Through Reflection
Simon WS Fischer
Decision-making is increasingly supported by machine recommendations. In healthcare, for example, a clinical decision support system is used by the physician to find a treatment option for a patient. In doing so, people can rely too much on these systems, which impairs their own reasoning process. The European AI Act addresses the risk of over-reliance and postulates in Article 14 on human oversight that people should be able to remain aware of the possible tendency of automatically relying or over-relying on the output. Similarly, the EU High-Level Expert Group identifies human agency and oversight as the first of seven key requirements for trustworthy AI. The following position paper proposes a conceptual approach to generate machine questions about the decision at hand, in order to promote decision-making autonomy. This engagement in turn allows for oversight of recommender systems. The systematic and interdisciplinary investigation (e.g., machine learning, user experience design, psychology, philosophy of technology) of human-machine interaction in relation to decision-making provides insights to questions like: how to increase human oversight and calibrate over- and under-reliance on machine recommendations; how to increase decision-making autonomy and remain aware of other possibilities beyond automated suggestions that repeat the status-quo?
Read more9/17/2024
📶
0
Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AI
Silvia Tulli, Stylianos Loukas Vasileiou, Sarath Sreedharan
Human-aware has become a popular keyword used to describe a particular class of AI systems that are designed to work and interact with humans. While there exists a surprising level of consistency among the works that use the label human-aware, the term itself mostly remains poorly understood. In this work, we retroactively try to provide an account of what constitutes a human-aware AI system. We see that human-aware AI is a design oriented paradigm, one that focuses on the need for modeling the humans it may interact with. Additionally, we see that this paradigm offers us intuitive dimensions to understand and categorize the kinds of interactions these systems might have with humans. We show the pedagogical value of these dimensions by using them as a tool to understand and review the current landscape of work related to human-AI systems that purport some form of human modeling. To fit the scope of a workshop paper, we specifically narrowed our review to papers that deal with sequential decision-making and were published in a major AI conference in the last three years. Our analysis helps identify the space of potential research problems that are currently being overlooked. We perform additional analysis on the degree to which these works make explicit reference to results from social science and whether they actually perform user-studies to validate their systems. We also provide an accounting of the various AI methods used by these works.
Read more7/16/2024
0
ADESSE: Advice Explanations in Complex Repeated Decision-Making Environments
Soren Schleibaum, Lu Feng, Sarit Kraus, Jorg P. Muller
In the evolving landscape of human-centered AI, fostering a synergistic relationship between humans and AI agents in decision-making processes stands as a paramount challenge. This work considers a problem setup where an intelligent agent comprising a neural network-based prediction component and a deep reinforcement learning component provides advice to a human decision-maker in complex repeated decision-making environments. Whether the human decision-maker would follow the agent's advice depends on their beliefs and trust in the agent and on their understanding of the advice itself. To this end, we developed an approach named ADESSE to generate explanations about the adviser agent to improve human trust and decision-making. Computational experiments on a range of environments with varying model sizes demonstrate the applicability and scalability of ADESSE. Furthermore, an interactive game-based user study shows that participants were significantly more satisfied, achieved a higher reward in the game, and took less time to select an action when presented with explanations generated by ADESSE. These findings illuminate the critical role of tailored, human-centered explanations in AI-assisted decision-making.
Read more9/11/2024