Use Cases for Prospective Sensemaking of Human-AI-Collaboration

Read original: arXiv:2408.10812 - Published 9/20/2024 by Ishara Sudeeptha, Wieland Mueller, Michael Leyer, Alexander Richter, Ferry Nolte
Total Score

0

🤿

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This study explores the potential of human-AI collaboration (HAIC) through interviews with 14 executives.
  • The researchers identified 63 HAIC use cases and classified them using a matrix combining value chain and group work activities.
  • Most use cases were related to firm infrastructure and technology development, with few pertaining to services, procurement, or logistics.
  • HAIC is predominantly seen as supporting the choice and execution of group tasks, with more emphasis on choosing in supporting activities of the value chain.

Plain English Explanation

The researchers wanted to understand how businesses can work together with AI systems. They interviewed 14 business leaders and identified 63 different ways that humans and AI could collaborate. They grouped these use cases into a matrix based on the type of business activity (like operations or marketing) and the type of collaborative task (like choosing what to do or actually doing it).

Most of the use cases they found were related to the behind-the-scenes parts of a business, like managing technology and infrastructure. Very few were about customer-facing activities like services or logistics. Overall, the business leaders saw AI as being most helpful for choosing what tasks to do and then executing those tasks, rather than for negotiating or figuring out the best approach.

The researchers believe this information could help businesses plan how to effectively use AI to support their operations and strategic decision-making.

Technical Explanation

The researchers conducted semi-structured interviews with 14 executives to explore the potential of human-AI collaboration (HAIC). They identified 63 distinct HAIC use cases and classified them using a novel matrix that combined value chain activities and group work activities.

The majority of use cases were related to firm infrastructure and technology development, with very few pertaining to services, procurement, or logistics. HAIC was predominantly seen as supporting the choice and execution of group tasks, with more emphasis on choosing in supporting activities of the value chain. In contrast, primary activities like operations and marketing focused more on executing group tasks, with fewer use cases involving negotiating tasks.

The researchers propose that this taxonomy of HAIC use cases could serve as a tool for prospective sensemaking and to foster strategic managerial decisions around the deployment of AI in the workplace.

Critical Analysis

The study provides a valuable starting point for understanding how businesses currently envision the role of HAIC, but it has some limitations. The sample size of 14 executives, while appropriate for a qualitative study, may not be representative of all industries and organizational contexts. Additionally, the researchers acknowledge that the use cases identified may be biased towards more mature or widespread applications of HAIC.

Further research is needed to explore how these use cases may evolve over time, as well as to investigate potential barriers or challenges to successful HAIC implementation. It would also be interesting to examine how the perceived value and applications of HAIC may differ across various stakeholder groups, such as frontline workers, middle managers, and C-suite executives.

Conclusion

This study offers a nuanced and practical perspective on the current state of HAIC in the business world. By identifying a range of use cases and classifying them based on value chain and group work activities, the researchers provide a framework for organizations to consider how they might leverage AI to support their strategic and operational objectives. As AI technologies continue to evolve, this research can help guide managers in making informed decisions about where and how to integrate human-AI collaboration into their businesses.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤿

Total Score

0

Use Cases for Prospective Sensemaking of Human-AI-Collaboration

Ishara Sudeeptha, Wieland Mueller, Michael Leyer, Alexander Richter, Ferry Nolte

This study explores the potential of Human-AI Collaboration (HAIC) use cases as a tool for prospective sensemaking. Based on 14 interviews with executives of an automotive company, we identify and categorize HAIC use cases that can help organizations anticipate and strategically respond to the impact of HAIC. Feedback from the case company shows that our systematic mapping of HAIC use cases along the value chain and group tasks enables a structured understanding of the potential role of AI and underscores the importance of strategic foresight when integrating AI into organizational processes.

Read more

9/20/2024

Evaluating Human-AI Collaboration: A Review and Methodological Framework
Total Score

0

Evaluating Human-AI Collaboration: A Review and Methodological Framework

George Fragiadakis, Christos Diou, George Kousiouris, Mara Nikolaidou

The use of artificial intelligence (AI) in working environments with individuals, known as Human-AI Collaboration (HAIC), has become essential in a variety of domains, boosting decision-making, efficiency, and innovation. Despite HAIC's wide potential, evaluating its effectiveness remains challenging due to the complex interaction of components involved. This paper provides a detailed analysis of existing HAIC evaluation approaches and develops a fresh paradigm for more effectively evaluating these systems. Our framework includes a structured decision tree which assists to select relevant metrics based on distinct HAIC modes (AI-Centric, Human-Centric, and Symbiotic). By including both quantitative and qualitative metrics, the framework seeks to represent HAIC's dynamic and reciprocal nature, enabling the assessment of its impact and success. This framework's practicality can be examined by its application in an array of domains, including manufacturing, healthcare, finance, and education, each of which has unique challenges and requirements. Our hope is that this study will facilitate further research on the systematic evaluation of HAIC in real-world applications.

Read more

7/30/2024

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation
Total Score

0

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation

Steffen Holter, Mennatallah El-Assady

As full AI-based automation remains out of reach in most real-world applications, the focus has instead shifted to leveraging the strengths of both human and AI agents, creating effective collaborative systems. The rapid advances in this area have yielded increasingly more complex systems and frameworks, while the nuance of their characterization has gotten more vague. Similarly, the existing conceptual models no longer capture the elaborate processes of these systems nor describe the entire scope of their collaboration paradigms. In this paper, we propose a new unified set of dimensions through which to analyze and describe human-AI systems. Our conceptual model is centered around three high-level aspects - agency, interaction, and adaptation - and is developed through a multi-step process. Firstly, an initial design space is proposed by surveying the literature and consolidating existing definitions and conceptual frameworks. Secondly, this model is iteratively refined and validated by conducting semi-structured interviews with nine researchers in this field. Lastly, to illustrate the applicability of our design space, we utilize it to provide a structured description of selected human-AI systems.

Read more

4/19/2024

Problem Solving Through Human-AI Preference-Based Cooperation
Total Score

0

Problem Solving Through Human-AI Preference-Based Cooperation

Subhabrata Dutta, Timo Kaufmann, Goran Glavav{s}, Ivan Habernal, Kristian Kersting, Frauke Kreuter, Mira Mezini, Iryna Gurevych, Eyke Hullermeier, Hinrich Schuetze

While there is a widespread belief that artificial general intelligence (AGI) -- or even superhuman AI -- is imminent, complex problems in expert domains are far from being solved. We argue that such problems require human-AI cooperation and that the current state of the art in generative AI is unable to play the role of a reliable partner due to a multitude of shortcomings, including inability to keep track of a complex solution artifact (e.g., a software program), limited support for versatile human preference expression and lack of adapting to human preference in an interactive setting. To address these challenges, we propose HAI-Co2, a novel human-AI co-construction framework. We formalize HAI-Co2 and discuss the difficult open research problems that it faces. Finally, we present a case study of HAI-Co2 and demonstrate its efficacy compared to monolithic generative AI models.

Read more

8/16/2024