Participatory Approaches in AI Development and Governance: Case Studies

Overview

• This paper is the second in a two-part series on the value of a participatory approach to AI development and deployment.
• The first paper justified the use of participatory methods, both pragmatically (it improves algorithm quality) and on principle (it gives a voice to those affected).
• This paper tests these conclusions in two sectors: facial recognition technology for law enforcement and large language models in healthcare.

Plain English Explanation

This paper builds on previous work that argued for involving various stakeholders in the development and deployment of AI systems. The idea is that this "participatory approach" can improve the quality of the AI algorithms and also help build trust and buy-in among those who will be affected by the technology.

In this paper, the researchers wanted to see how well this participatory approach would work in practice. They chose two very different domains to test it out: facial recognition technology used by law enforcement, and large language models used in healthcare.

Facial recognition is a well-established AI technology, so it provides a good example of how participatory methods could be applied to an existing system. Healthcare, on the other hand, is a newer area for large language models, so the researchers wanted to explore how participatory principles could be built in from the start.

The key questions are: How do you identify the right stakeholders to involve? What information do you gather from them? And how do you actually incorporate their input into the development and deployment of the AI system? This paper tries to address those practical challenges.

Technical Explanation

The paper tests the principles of participatory AI (PAI) in two specific domains: facial recognition technology for law enforcement, and large language models (LLMs) in healthcare.

For facial recognition, this provides an opportunity to illustrate how PAI could be applied to an existing, well-researched AI system that has been the subject of much public debate. LLMs in healthcare, on the other hand, represent a relatively new and less explored application, allowing the researchers to consider how PAI principles could be built in from the ground up.

Key questions addressed include: How do you identify the relevant stakeholders? What information should be elicited from them? And how can that input be effectively incorporated into the AI system's life cycle, from development to deployment?

The paper draws on concepts from related work such as bringing AI participation down to scale, public constitutional AI, and incorporating practitioner perspectives to address these practical challenges.

Critical Analysis

The paper acknowledges that actually implementing a participatory approach depends heavily on how stakeholders are identified and how their input is gathered and integrated. It provides a useful framework for thinking through these implementation details, but more research is needed to fully address the practical challenges.

Some additional concerns that could be raised:

• How do you ensure a truly representative set of stakeholders is included?
• What mechanisms are needed to give stakeholders a meaningful voice in decision-making?
• How do you balance stakeholder input with other technical or business considerations?
• What are the risks of participatory approaches, such as slower development timelines or increased complexity?

Overall, the paper makes a compelling case for participatory AI, but recognizes that putting it into practice requires careful navigation of complex sociotechnical dynamics.

Conclusion

This paper builds on previous work arguing for a participatory approach to AI development and deployment. It tests these principles in two very different domains - facial recognition technology for law enforcement and large language models in healthcare.

The key takeaway is that while a participatory approach has significant potential benefits, the actual implementation is challenging. Identifying the right stakeholders, eliciting meaningful input, and effectively incorporating that input into the AI system life cycle requires careful consideration.

Further research is needed to develop more robust frameworks and best practices for putting participatory AI into action. But this paper makes an important contribution by highlighting both the value and the practical difficulties of this approach. As AI systems become more pervasive, finding ways to give a voice to affected communities will be crucial for building trust and ensuring these technologies are developed and deployed responsibly.