Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits

Read original: arXiv:2403.14791 - Published 9/11/2024 by Jimin Mun, Liwei Jiang, Jenny Liang, Inyoung Cheong, Nicole DeCario, Yejin Choi, Tadayoshi Kohno, Maarten Sap
Total Score

0

🤖

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • General purpose AI like ChatGPT has made it easier for the public to use and benefit from AI.
  • However, AI development and governance are still largely controlled by a few entities, and the rapid pace of progress raises concerns about comprehensive risk assessment.
  • To address this, the researchers introduce PARTICIP-AI, a framework that allows laypeople to speculate on and assess the impacts of AI use cases.
  • This aims to inform more democratic AI development and governance.

Plain English Explanation

The paper discusses how the rise of general purpose AI systems like ChatGPT has made it easier for the public to access and use AI technology. However, the researchers note that the development and governance of AI still remains largely in the hands of a few organizations, and the rapid pace of AI progress is outpacing a comprehensive assessment of the risks involved.

To address this, the researchers have developed a framework called PARTICIP-AI, which is designed to allow regular people (or "laypeople") to speculate on and assess the potential impacts of different AI use cases. The goal is to gather more diverse public input on AI development, which can then inform more democratic and inclusive approaches to AI governance.

The researchers ran a medium-scale study using the PARTICIP-AI framework, gathering input from 295 participants with diverse backgrounds. Their analysis of the results shows that participants' ideas for AI applications tended to focus on personal life and societal impacts, rather than the business applications that currently dominate AI development. The participants also surfaced a wide range of potential harms from AI, beyond just the concerns identified by AI experts.

Importantly, the researchers found that participants' perceptions of the negative impacts of

not
developing certain AI use cases were a key factor in whether they thought those use cases should be developed at all. This highlights laypeople's concerns about over-reliance on technological solutions ("techno-solutionism").

Overall, the researchers argue that frameworks like PARTICIP-AI can help guide more democratic and inclusive approaches to AI development and governance, by incorporating a broader range of public perspectives and concerns.

Technical Explanation

The paper introduces PARTICIP-AI, a framework designed to enable laypeople to speculate on and assess the impacts of potential AI use cases. The key elements of the framework include:

  1. Collecting Use Cases: Participants are asked to propose AI use cases across different domains (e.g., personal, societal, business).

  2. Risk Assessment: Participants assess the potential benefits and harms of each use case, considering scenarios where the use case is both developed and not developed.

  3. Choice on Development: Based on their risk assessment, participants make a concluding choice on whether the use case should be developed.

The researchers conducted a medium-scale study with 295 demographically diverse participants using the PARTICIP-AI framework. Their analysis of the results revealed several key insights:

  • Application Focus: Participants' proposed AI use cases tended to focus on personal life and societal applications, rather than the business-oriented applications that currently dominate AI development.

  • Diverse Harms: Participants surfaced a wide range of potential harms from AI, including distrust in AI systems and institutions, which complemented the concerns identified by AI experts.

  • Impact of Non-Development: Participants' perceptions of the negative impacts of

    not
    developing certain AI use cases were a significant predictor of their judgments on whether those use cases should be developed, highlighting concerns about "techno-solutionism."

Critical Analysis

The researchers acknowledge that their study was limited in scale and scope, and they call for further research to validate and expand upon their findings. Additionally, they note that the PARTICIP-AI framework itself may have inherent biases or limitations that could influence the perspectives gathered.

One potential concern is the reliance on participant-generated use cases, which may not fully capture the breadth of AI applications being developed or considered. There may be value in also incorporating researcher-generated use cases to ensure a more comprehensive assessment.

Furthermore, the study's focus on laypeople's perspectives raises questions about how to balance public input with the expertise of AI developers and researchers. Integrating these different perspectives in a constructive way will be a key challenge in moving towards more democratic AI governance.

Conclusion

The paper presents PARTICIP-AI as a promising approach for incorporating broader public input into the development and governance of general purpose AI systems. The researchers' findings suggest that laypeople have distinct perspectives and concerns about AI that may not be adequately addressed by current AI development practices.

By enabling more participatory and democratic processes around AI, frameworks like PARTICIP-AI have the potential to shape AI development in ways that better align with public values and priorities. This could lead to AI systems that are more responsive to the needs and concerns of diverse communities, ultimately resulting in more ethical and beneficial AI for society as a whole.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤖

Total Score

0

Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits

Jimin Mun, Liwei Jiang, Jenny Liang, Inyoung Cheong, Nicole DeCario, Yejin Choi, Tadayoshi Kohno, Maarten Sap

General purpose AI, such as ChatGPT, seems to have lowered the barriers for the public to use AI and harness its power. However, the governance and development of AI still remain in the hands of a few, and the pace of development is accelerating without a comprehensive assessment of risks. As a first step towards democratic risk assessment and design of general purpose AI, we introduce PARTICIP-AI, a carefully designed framework for laypeople to speculate and assess AI use cases and their impacts. Our framework allows us to study more nuanced and detailed public opinions on AI through collecting use cases, surfacing diverse harms through risk assessment under alternate scenarios (i.e., developing and not developing a use case), and illuminating tensions over AI development through making a concluding choice on its development. To showcase the promise of our framework towards informing democratic AI development, we run a medium-scale study with inputs from 295 demographically diverse participants. Our analyses show that participants' responses emphasize applications for personal life and society, contrasting with most current AI development's business focus. We also surface diverse set of envisioned harms such as distrust in AI and institutions, complementary to those defined by experts. Furthermore, we found that perceived impact of not developing use cases significantly predicted participants' judgements of whether AI use cases should be developed, and highlighted lay users' concerns of techno-solutionism. We conclude with a discussion on how frameworks like PARTICIP-AI can further guide democratic AI development and governance.

Read more

9/11/2024

🤖

Total Score

0

Participatory Approaches in AI Development and Governance: Case Studies

Ambreesh Parthasarathy, Aditya Phalnikar, Gokul S Krishnan, Ameen Jauhar, Balaraman Ravindran

This paper forms the second of a two-part series on the value of a participatory approach to AI development and deployment. The first paper had crafted a principled, as well as pragmatic, justification for deploying participatory methods in these two exercises (that is, development and deployment of AI). The pragmatic justification is that it improves the quality of the overall algorithm by providing more granular and minute information. The more principled justification is that it offers a voice to those who are going to be affected by the deployment of the algorithm, and through engagement attempts to build trust and buy-in for an AI system. By a participatory approach, we mean including various stakeholders (defined a certain way) in the actual decision making process through the life cycle of an AI system. Despite the justifications offered above, actual implementation depends crucially on how stakeholders in the entire process are identified, what information is elicited from them, and how it is incorporated. This paper will test these preliminary conclusions in two sectors, the use of facial recognition technology in the upkeep of law and order and the use of large language models in the healthcare sector. These sectors have been chosen for two primary reasons. Since Facial Recognition Technologies are a branch of AI solutions that are well-researched and the impact of which is well documented, it provides an established space to illustrate the various aspects of adapting PAI to an existing domain, especially one that has been quite contentious in the recent past. LLMs in healthcare provide a canvas for a relatively less explored space, and helps us illustrate how one could possibly envision enshrining the principles of PAI for a relatively new technology, in a space where innovation must always align with patient welfare.

Read more

7/19/2024

🤖

Total Score

0

Participatory Approaches in AI Development and Governance: A Principled Approach

Ambreesh Parthasarathy, Aditya Phalnikar, Ameen Jauhar, Dhruv Somayajula, Gokul S Krishnan, Balaraman Ravindran

The widespread adoption of Artificial Intelligence (AI) technologies in the public and private sectors has resulted in them significantly impacting the lives of people in new and unexpected ways. In this context, it becomes important to inquire how their design, development and deployment takes place. Upon this inquiry, it is seen that persons who will be impacted by the deployment of these systems have little to no say in how they are developed. Seeing this as a lacuna, this research study advances the premise that a participatory approach is beneficial (both practically and normatively) to building and using more responsible, safe, and human-centric AI systems. Normatively, it enhances the fairness of the process and empowers citizens in voicing concerns to systems that may heavily impact their lives. Practically, it provides developers with new avenues of information which will be beneficial to them in improving the quality of the AI algorithm. The paper advances this argument first, by describing the life cycle of an AI system; second, by identifying criteria which may be used to identify relevant stakeholders for a participatory exercise; and third, by mapping relevant stakeholders to different stages of AI lifecycle. This paper forms the first part of a two-part series on participatory governance in AI. The second paper will expand upon and concretise the principles developed in this paper and apply the same to actual use cases of AI systems.

Read more

7/19/2024

🤖

Total Score

0

Bringing AI Participation Down to Scale: A Comment on Open AIs Democratic Inputs to AI Project

David Moats, Chandrima Ganguly

This commentary piece reviews the recent Open AI Democratic Inputs programme, which funded 10 teams to design procedures for public participation in generative AI. While applauding the technical innovations in these projects, we identify several shared assumptions including the generality of LLMs, extracting abstract values, soliciting solutions not problems and equating participation with democracy. We call instead for AI participation which involves specific communities and use cases and solicits concrete problems to be remedied. We also find it important that these communities have a stake in the outcome, including ownership of data or models.

Read more

7/17/2024