Automatic Authorities: Power and AI
2404.05990
0
0
🤖
Abstract
As rapid advances in Artificial Intelligence and the rise of some of history's most potent corporations meet the diminished neoliberal state, people are increasingly subject to power exercised by means of automated systems. Machine learning and related computational technologies now underpin vital government services. They connect consumers and producers in new algorithmic markets. They determine how we find out about everything from how to vote to where to get vaccinated, and whose speech is amplified, reduced, or restricted. And a new wave of products based on Large Language Models (LLMs) will further transform our economic and political lives. Automatic Authorities are automated computational systems used to exercise power over us by determining what we may know, what we may have, and what our options will be. In response to their rise, scholars working on the societal impacts of AI and related technologies have advocated shifting attention from how to make AI systems beneficial or fair towards a critical analysis of these new power relations. But power is everywhere, and is not necessarily bad. On what basis should we object to new or intensified power relations, and what can be done to justify them? This paper introduces the philosophical materials with which to formulate these questions, and offers preliminary answers. It starts by pinning down the concept of power, focusing on the ability that some agents have to shape others' lives. It then explores how AI enables and intensifies the exercise of power so understood, and sketches three problems with power and three ways to solve those problems. It emphasises, in particular, that justifying power requires more than satisfying substantive justificatory criteria; standards of proper authority and procedural legitimacy must also be met. We need to know not only what power may be used for, but how it may be used, and by whom.
Get summaries of the top AI research delivered straight to your inbox:
Overview
- As AI and powerful corporations grow, people are increasingly subject to power exercised through automated systems
- Machine learning and related technologies now underpin vital government services, consumer markets, and information access
- A new wave of large language models (LLMs) will further transform our economic and political lives
- Scholars advocate shifting focus from making AI "beneficial" to critically analyzing these new power relations
Plain English Explanation
As artificial intelligence (AI) models and technologies become more advanced and powerful corporations gain more influence, people are finding themselves increasingly subject to power that is exercised through automated computer systems. These machine learning and related technologies now form the backbone of important government services, the way consumers interact with businesses, and how people find information on everything from voting to health care. And a new generation of large language models (LLMs) is set to transform our economic and political landscapes even further.
In response, scholars studying the societal impacts of AI and related tech are suggesting we should shift our focus away from simply trying to make these systems "beneficial" or "fair." Instead, they argue we need to take a critical look at the new power dynamics and relationships that are emerging as a result of these technologies. After all, power is not inherently good or bad - the key is understanding how it is being used and by whom.
Technical Explanation
The paper introduces the philosophical foundations for analyzing the power dynamics enabled by the rise of AI and related computational technologies. It starts by defining power as the ability of some agents (e.g. governments, corporations) to shape the lives of others.
The paper then explores how AI, machine learning, and technologies like large language models are enabling and intensifying the exercise of this kind of power. It outlines three key problems with unchecked power:
- Power can be used to restrict what people know, what they have access to, and their range of options
- Power can be wielded without proper authority or procedural legitimacy
- Power relationships can become entrenched and difficult to challenge or change
To address these issues, the paper sketches three potential solutions:
- Ensuring power is used in ways that are substantively justified (i.e. for legitimate purposes)
- Establishing proper standards of authority and procedural legitimacy for how power is exercised
- Maintaining mechanisms to hold power-wielding agents accountable and enable power dynamics to evolve over time
Critical Analysis
The paper provides a thoughtful framework for critically examining the societal impacts of AI and related technologies, moving beyond simplistic notions of making them "beneficial." By framing the issues in terms of power dynamics, the authors encourage readers to think deeply about who holds power, how it is being used, and whether it is being wielded appropriately and with proper justification.
That said, the analysis could potentially be broadened to consider other dimensions of power, such as how it intersects with issues of inequality, discrimination, and marginalization. Additionally, the solutions proposed, while conceptually sound, may face significant practical challenges in terms of implementation and enforcement, which the paper does not fully explore.
Ultimately, this work serves as an important starting point for a more nuanced, critical dialogue around the societal role of AI and its allied technologies. By pushing us to think beyond simplistic notions of "beneficial AI," it encourages readers to grapple with the difficult questions of power, authority, and legitimacy that will be central to navigating the [AI-powered] future.
Conclusion
This paper lays the groundwork for a more critical examination of the power dynamics emerging as AI and related computational technologies become increasingly embedded in our social, economic, and political systems. By defining power as the ability to shape others' lives, and outlining key problems and potential solutions, the authors invite readers to think deeply about who holds power, how it is being used, and whether it is being exercised with proper justification and legitimacy. This type of nuanced, philosophical analysis is crucial as we navigate the transformative impacts of AI and large language models on our lives.
Related Papers
💬
Distributed agency in second language learning and teaching through generative AI
Robert Godwin-Jones
0
0
Generative AI offers significant opportunities for language learning. Tools like ChatGPT can provide informal second language practice through chats in written or voice forms, with the learner specifying through prompts conversational parameters such as proficiency level, language register, and discussion topics. AI can be instructed to give corrective feedback, create practice exercises, or develop an extended study plan. Instructors can use AI to build learning and assessment materials in a variety of media. AI is likely to make immersive technologies more powerful and versatile, moving away from scripted interactions. For both learners and teachers, it is important to understand the limitations of AI systems that arise from their purely statistical model of human language, which limits their ability to deal with nuanced social and cultural aspects of language use. Additionally, there are ethical concerns over how AI systems are created as well as practical constraints in their use, especially for less privileged populations. The power and versatility of AI tools are likely to turn them into valuable and constant companions in many peoples lives (akin to smartphones), creating a close connection that goes beyond simple tool use. Ecological theories such as sociomaterialism are helpful in examining the shared agency that develops through close user-AI interactions, as are the perspectives on human-object relations from Indigenous cultures.
4/1/2024
🎲
Trust in AI: Progress, Challenges, and Future Directions
Saleh Afroogh, Ali Akbari, Evan Malone, Mohammadali Kargar, Hananeh Alambeigi
0
0
The increasing use of artificial intelligence (AI) systems in our daily life through various applications, services, and products explains the significance of trust/distrust in AI from a user perspective. AI-driven systems (as opposed to other technologies) have ubiquitously diffused in our life not only as some beneficial tools to be used by human agents but also are going to be substitutive agents on our behalf, or manipulative minds that would influence human thought, decision, and agency. Trust/distrust in AI plays the role of a regulator and could significantly control the level of this diffusion, as trust can increase, and distrust may reduce the rate of adoption of AI. Recently, varieties of studies have paid attention to the variant dimension of trust/distrust in AI, and its relevant considerations. In this systematic literature review, after conceptualization of trust in the current AI literature review, we will investigate trust in different types of human-Machine interaction, and its impact on technology acceptance in different domains. In addition to that, we propose a taxonomy of technical (i.e., safety, accuracy, robustness) and non-technical axiological (i.e., ethical, legal, and mixed) trustworthiness metrics, and some trustworthy measurements. Moreover, we examine some major trust-breakers in AI (e.g., autonomy and dignity threat), and trust makers; and propose some future directions and probable solutions for the transition to a trustworthy AI.
4/5/2024
💬
Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control
Yaqub Chaudhary, Jonnie Penn
0
0
Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. This capacity, now available at low cost, makes them powerful tools for manipulation and control. In this paper, we consider a set of underestimated societal harms made possible by the rapid and largely unregulated adoption of LLMs. Rather than consider LLMs as isolated digital artefacts used to displace this or that area of work, we focus on the large-scale computational infrastructure upon which they are instrumentalised across domains. We begin with discussion on how LLMs may be used to both pollute and uniformize information environments and how these modalities may be leveraged as mechanisms of control. We then draw attention to several areas of emerging research, each of which compounds the capabilities of LLMs as instruments of power. These include (i) persuasion through the real-time design of choice architectures in conversational interfaces (e.g., via AI personas), (ii) the use of LLM-agents as computational models of human agents (e.g., silicon subjects), (iii) the use of LLM-agents as computational models of human agent populations (e.g., silicon societies) and finally, (iv) the combination of LLMs with reinforcement learning to produce controllable and steerable strategic dialogue models. We draw these strands together to discuss how these areas may be combined to build LLM-based systems that serve as powerful instruments of individual, social and political control via the simulation and disingenuous prediction of human behaviour, intent, and action.
5/8/2024
🤖
Frontier AI Ethics: Anticipating and Evaluating the Societal Impacts of Generative Agents
Seth Lazar
0
0
Some have criticised Generative AI Systems for replicating the familiar pathologies of already widely-deployed AI systems. Other critics highlight how they foreshadow vastly more powerful future systems, which might threaten humanity's survival. The first group says there is nothing new here; the other looks through the present to a perhaps distant horizon. In this paper, I instead pay attention to what makes these particular systems distinctive: both their remarkable scientific achievement, and the most likely and consequential ways in which they will change society over the next five to ten years. In particular, I explore the potential societal impacts and normative questions raised by the looming prospect of 'Generative Agents', in which multimodal large language models (LLMs) form the executive centre of complex, tool-using AI systems that can take unsupervised sequences of actions towards some goal.
4/11/2024