Finding the white male: The prevalence and consequences of algorithmic gender and race bias in political Google searches

Read original: arXiv:2405.00335 - Published 5/2/2024 by Tobias Rohrbach, Mykola Makhortykh, Maryna Sydorova
Total Score

0

🗣️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This research examines how search engines like Google, which use artificial intelligence (AI) to determine political information that voters see, can reflect and perpetuate biases against women and non-white politicians.
  • The study conducts algorithm audits of political image searches and online experiments to understand how these algorithmic biases impact people's perceptions of politics.
  • The findings have important implications for understanding how AI technology can amplify biases in political decision-making and contribute to ongoing debates around algorithmic fairness and injustice.

Plain English Explanation

Search engines like Google have become a dominant source of political information for many people. These search engines use advanced AI algorithms to determine what content users see when searching for information. However, this research shows that these algorithms can perpetuate biases against women and non-white politicians.

The first part of the study looked at how political image searches on Google reflect these structural inequalities. The researchers found that women and non-white politicians were significantly underrepresented or misrepresented in the search results. This suggests the algorithms are failing to provide a representative view of the political landscape.

The second part of the study then examined how these biases in algorithmic representation impact people's perceptions of politics. In online experiments, the researchers found that the skewed search results led participants to develop a more narrow, white and masculine view of who participates in politics. This indicates the algorithms are not just reflecting biases, but actively reinforcing them.

Overall, this research highlights how the powerful AI systems underlying search engines can have significant consequences for how people understand and engage with the political process. By amplifying certain voices and perspectives over others, these algorithms have the potential to distort people's perceptions of political reality in ways that could undermine democratic ideals of equal representation.

Technical Explanation

The researchers conducted a series of four studies to investigate the relationship between search engine algorithms and the representation of minoritized groups in political information.

The first two studies were algorithm audits of political image searches on Google. The researchers systematically analyzed the demographic characteristics of politicians shown in the top search results for queries related to US elections. They found that women and non-white politicians were significantly underrepresented or misrepresented compared to their actual presence in US politics.

Building on these findings, the researchers then conducted two online experiments to examine the impact of these algorithmic biases on people's perceptions of political reality. Participants were shown either search results that reflected the actual diversity of US politicians, or skewed results that mirrored the biases identified in the first studies. The results showed that exposure to the biased search results led participants to develop a more narrow, white and masculine view of who participates in politics.

Taken together, these findings suggest that the AI algorithms powering search engines like Google can amplify structural inequalities by selectively surfacing certain political actors over others. This in turn shapes people's political perceptions and decision-making in ways that reinforce a white and masculinized understanding of the political sphere.

Critical Analysis

The researchers acknowledge several limitations to their studies. First, the algorithm audits were limited to a single search engine (Google) and a narrow set of political queries. More research is needed to understand how these biases manifest across different search platforms and a wider range of political topics.

Additionally, while the experimental studies demonstrated the impact of biased search results on political perceptions, they did not investigate the longer-term or real-world implications of these effects. More longitudinal research is needed to understand how sustained exposure to skewed political information via search engines could shape voting behavior and other forms of political engagement over time.

The paper also does not delve into the specific technical mechanisms underlying the algorithmic biases observed. A more [granular analysis of the AI systems and data biases involved could provide valuable insights for addressing these issues.

Overall, this research makes an important contribution to our understanding of how the political economy of search can shape political discourse and decision-making in the digital age. However, further investigation is needed to fully elucidate the scope and implications of these algorithmic biases.

Conclusion

This research provides compelling evidence that the AI algorithms powering prominent search engines like Google can amplify structural inequalities in the political sphere by selectively surfacing certain voices and perspectives over others. The findings suggest these algorithmic biases not only reflect but actively reinforce a white and masculinized view of political participation and leadership.

These insights have significant implications for our scientific understanding of how emerging technologies can impact the democratic process. As search engines become an increasingly dominant gateway to political information, it is crucial that we develop a deeper understanding of the ways in which their underlying AI systems may be distorting people's perceptions of political reality. Addressing these issues of algorithmic fairness and justice will be essential for safeguarding the integrity of democratic institutions in the digital age.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🗣️

Total Score

0

Finding the white male: The prevalence and consequences of algorithmic gender and race bias in political Google searches

Tobias Rohrbach, Mykola Makhortykh, Maryna Sydorova

Search engines like Google have become major information gatekeepers that use artificial intelligence (AI) to determine who and what voters find when searching for political information. This article proposes and tests a framework of algorithmic representation of minoritized groups in a series of four studies. First, two algorithm audits of political image searches delineate how search engines reflect and uphold structural inequalities by under- and misrepresenting women and non-white politicians. Second, two online experiments show that these biases in algorithmic representation in turn distort perceptions of the political reality and actively reinforce a white and masculinized view of politics. Together, the results have substantive implications for the scientific understanding of how AI technology amplifies biases in political perceptions and decision-making. The article contributes to ongoing public debates and cross-disciplinary research on algorithmic fairness and injustice.

Read more

5/2/2024

Algorithmic Misjudgement in Google Search Results: Evidence from Auditing the US Online Electoral Information Environment
Total Score

0

Algorithmic Misjudgement in Google Search Results: Evidence from Auditing the US Online Electoral Information Environment

Brooke Perreault, Johanna Lee, Ropafadzo Shava, Eni Mustafaraj

Google Search is an important way that people seek information about politics, and Google states that it is ``committed to providing timely and authoritative information on Google Search to help voters understand, navigate, and participate in democratic processes.'' This paper studies the extent to which government-maintained web domains are represented in the online electoral information environment, as captured through 3.45 Google Search result pages collected during the 2022 US midterm elections for 786 locations across the United States. Focusing on state, county, and local government domains that provide locality-specific information, we study not only the extent to which these sources appear in organic search results, but also the extent to which these sources are correctly targeted to their respective constituents. We label misalignment between the geographic area that non-federal domains serve and the locations for which they appear in search results as algorithmic mistargeting, a subtype of algorithmic misjudgement in which the search algorithm targets locality-specific information to users in different (incorrect) locations. In the context of the 2022 US midterm elections, we find that 71% of all occurrences of state, county, and local government sources were mistargeted, with some domains appearing disproportionately often among organic results despite providing locality-specific information that may not be relevant to all voters. However, we also find that mistargeting often occurs in low ranks. We conclude by considering the potential consequences of extensive mistargeting of non-federal government sources and argue that ensuring the correct targeting of these sources to their respective constituents is a critical part of Google's role in facilitating access to authoritative and locally-relevant electoral information.

Read more

6/18/2024

🧪

Total Score

0

Evidence of What, for Whom? The Socially Contested Role of Algorithmic Bias in a Predictive Policing Tool

Marta Ziosi, Dasha Pruss

This paper presents a critical, qualitative study of the social role of algorithmic bias in the context of the Chicago crime prediction algorithm, a predictive policing tool that forecasts when and where in the city crime is most likely to occur. Through interviews with 18 Chicago-area community organizations, academic researchers, and public sector actors, we show that stakeholders from different groups articulate diverse problem diagnoses of the tool's algorithmic bias, strategically using it as evidence to advance criminal justice interventions that align with stakeholders' positionality and political ends. Drawing inspiration from Catherine D'Ignazio's taxonomy of refusing and using data, we find that stakeholders use evidence of algorithmic bias to reform the policies around police patrol allocation; reject algorithm-based policing interventions; reframe crime as a structural rather than interpersonal problem; reveal data on authority figures in an effort to subvert their power; repair and heal families and communities; and, in the case of more powerful actors, to reaffirm their own authority or existing power structures. We identify the implicit assumptions and scope of these varied uses of algorithmic bias as evidence, showing that they require different (and sometimes conflicting) values about policing and AI. This divergence reflects long-standing tensions in the criminal justice reform landscape between the values of liberation and healing often centered by system-impacted communities and the values of surveillance and deterrence often instantiated in data-driven reform measures. We advocate for centering the interests and experiential knowledge of communities impacted by incarceration to ensure that evidence of algorithmic bias can serve as a device to challenge the status quo.

Read more

5/14/2024

🤖

Total Score

0

Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent

Jennifer Mickel

Racial diversity has become increasingly discussed within the AI and algorithmic fairness literature, yet little attention is focused on justifying the choices of racial categories and understanding how people are racialized into these chosen racial categories. Even less attention is given to how racial categories shift and how the racialization process changes depending on the context of a dataset or model. An unclear understanding of textit{who} comprises the racial categories chosen and textit{how} people are racialized into these categories can lead to varying interpretations of these categories. These varying interpretations can lead to harm when the understanding of racial categories and the racialization process is misaligned from the actual racialization process and racial categories used. Harm can also arise if the racialization process and racial categories used are irrelevant or do not exist in the context they are applied. In this paper, we make two contributions. First, we demonstrate how racial categories with unclear assumptions and little justification can lead to varying datasets that poorly represent groups obfuscated or unrepresented by the given racial categories and models that perform poorly on these groups. Second, we develop a framework, CIRCSheets, for documenting the choices and assumptions in choosing racial categories and the process of racialization into these categories to facilitate transparency in understanding the processes and assumptions made by dataset or model developers when selecting or using these racial categories.

Read more

4/11/2024