A multidisciplinary framework for deconstructing bots' pluripotency in dualistic antagonism

2402.15119

YC

0

Reddit

0

Published 5/14/2024 by Wentao Xu, Kazutoshi Sasahara, Jianxun Chu, Bin Wang, Wenlu Fan, Zhiwen Hu

📉

Abstract

Anthropomorphic social bots are engineered to emulate human verbal communication and generate toxic or inflammatory content across social networking services (SNSs). Bot-disseminated misinformation could subtly yet profoundly reshape societal processes by complexly interweaving factors like repeated disinformation exposure, amplified political polarization, compromised indicators of democratic health, shifted perceptions of national identity, propagation of false social norms, and manipulation of collective memory over time. However, extrapolating bots' pluripotency across hybridized, multilingual, and heterogeneous media ecologies from isolated SNS analyses remains largely unknown, underscoring the need for a comprehensive framework to characterise bots' emergent risks to civic discourse. Here we propose an interdisciplinary framework to characterise bots' pluripotency, incorporating quantification of influence, network dynamics monitoring, and interlingual feature analysis. When applied to the geopolitical discourse around the Russo-Ukrainian conflict, results from interlanguage toxicity profiling and network analysis elucidated spatiotemporal trajectories of pro-Russian and pro-Ukrainian human and bots across hybrid SNSs. Weaponized bots predominantly inhabited X, while human primarily populated Reddit in the social media warfare. This rigorous framework promises to elucidate interlingual homogeneity and heterogeneity in bots' pluripotent behaviours, revealing synergistic human-bot mechanisms underlying regimes of information manipulation, echo chamber formation, and collective memory manifestation in algorithmically structured societies.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores the risks posed by anthropomorphic social bots - computer programs engineered to mimic human communication on social media platforms.
  • The authors propose an interdisciplinary framework to characterize the "pluripotency" of these bots, meaning their ability to adapt and have a widespread impact across different languages, cultures, and social media networks.
  • The framework involves quantifying bot influence, monitoring network dynamics, and analyzing linguistic features to understand how bots can contribute to the spread of misinformation, political polarization, and the manipulation of collective memory.

Plain English Explanation

Social media bots are computer programs designed to behave like real people on platforms like Twitter and Facebook. These bots can be programmed to generate content that is meant to be inflammatory or misleading. Over time, the repeated exposure to this kind of bot-generated misinformation could have a profound impact on society, affecting things like political polarization, perceptions of national identity, and even our collective memory of events.

The researchers behind this paper wanted to develop a comprehensive way to understand the full scope of the risks posed by these social media bots. Their framework looks at factors like how influential the bots are, how they interact with human users in online networks, and the linguistic patterns they use across different languages and platforms.

When they applied this framework to study the online discourse around the Russo-Ukrainian conflict, the researchers found that pro-Russian bots were more prevalent on one social network, while human users tended to congregate on another. This kind of insight into how bots and humans interact in these hybrid media environments can help us better understand the mechanisms behind the spread of misinformation and the manipulation of public opinion.

Technical Explanation

The paper proposes an interdisciplinary framework to characterize the "pluripotency" of anthropomorphic social bots - their ability to adapt and exert influence across diverse languages, cultures, and social media platforms. The framework involves three key components:

  1. Quantification of Influence: Measuring the reach and impact of bot-generated content, including its ability to shape public discourse and perceptions.

  2. Network Dynamics Monitoring: Tracking how bots interact with human users within and across online social networks, and how these interactions contribute to the formation of echo chambers and the spread of misinformation.

  3. Interlingual Feature Analysis: Examining the linguistic patterns and characteristics of bot-generated content in different languages, to identify similarities and differences in how bots operate in multilingual media ecosystems.

When applied to the case study of the Russo-Ukrainian conflict, the researchers' framework revealed that pro-Russian bots were more prevalent on platform X, while human users tended to congregate on Reddit. This suggests that bots and humans may inhabit distinct parts of the online information landscape, with bots playing a more prominent role in certain platforms or discussions.

Critical Analysis

The paper presents a comprehensive and rigorous framework for understanding the risks posed by anthropomorphic social bots. However, the authors acknowledge that extrapolating the findings from isolated social media platforms to the broader, hybridized, and multilingual media ecosystem remains a significant challenge.

Additionally, the paper does not delve deeply into the specific mechanisms by which bots can manipulate collective memory or reshape perceptions of national identity. Further research is needed to fully elucidate these complex societal impacts.

While the case study on the Russo-Ukrainian conflict provides valuable insights, it would be informative to apply the researchers' framework to other geopolitical contexts or social issues to assess the generalizability of their findings.

Conclusion

This paper proposes a novel, interdisciplinary framework for characterizing the "pluripotency" of anthropomorphic social bots - their ability to adapt and exert influence across diverse languages, cultures, and social media platforms. By quantifying bot influence, monitoring network dynamics, and analyzing linguistic features, the framework promises to shed light on the synergistic human-bot mechanisms underlying the spread of misinformation, the formation of echo chambers, and the manipulation of collective memory in algorithmically structured societies.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

Blended Bots: Infiltration through Identity Deception on Social Media

Blended Bots: Infiltration through Identity Deception on Social Media

Samantha C. Phillips, Lynnette Hui Xian Ng, Kathleen M. Carley

YC

0

Reddit

0

Bots are automated social media users that can be used to amplify (mis)information and sow harmful discourse. In order to effectively influence users, bots can be generated to reproduce human user behavior. Indeed, people tend to trust information coming from users with profiles that fit roles they expect to exist, such as users with gender role stereotypes. In this work, we examine differences in the types of identities in profiles of human and bot accounts with a focus on combinations of identities that represent gender role stereotypes. We find that some types of identities differentiate between human and bot profiles, confirming this approach can be a useful in distinguishing between human and bot accounts on social media. However, contrary to our expectations, we reveal that gender bias is expressed more in human accounts than bots overall. Despite having less gender bias overall, we provide examples of identities with strong associations with gender identities in bot profiles, such as those related to technology, finance, sports, and horoscopes. Finally, we discuss implications for designing constructive social media bot detection training materials.

Read more

6/11/2024

🏷️

A Dynamical Systems Approach to Bots and Online Political Communication

Beril Bulat, Martin Hilbert

YC

0

Reddit

0

Bots have become increasingly prevalent in the digital sphere and have taken up a proactive role in shaping democratic processes. While previous studies have focused on their influence at the individual level, their potential macro-level impact on communication dynamics is still little understood. This study adopts an information theoretic approach from dynamical systems theory to examine the role of political bots shaping the dynamics of an online political discussion on Twitter. We quantify the components of this dynamic process in terms of its complexity, predictability, and the remaining uncertainty. Our findings suggest that bot activity is associated with increased complexity and uncertainty in the structural dynamics of online political communication. This work serves as a showcase for the use of information-theoretic measures from dynamical systems theory in modeling human-bot dynamics as a computational process that unfolds over time.

Read more

5/30/2024

🔎

Adversarial Botometer: Adversarial Analysis for Social Bot Detection

Shaghayegh Najari, Davood Rafiee, Mostafa Salehi, Reza Farahbakhsh

YC

0

Reddit

0

Social bots play a significant role in many online social networks (OSN) as they imitate human behavior. This fact raises difficult questions about their capabilities and potential risks. Given the recent advances in Generative AI (GenAI), social bots are capable of producing highly realistic and complex content that mimics human creativity. As the malicious social bots emerge to deceive people with their unrealistic content, identifying them and distinguishing the content they produce has become an actual challenge for numerous social platforms. Several approaches to this problem have already been proposed in the literature, but the proposed solutions have not been widely evaluated. To address this issue, we evaluate the behavior of a text-based bot detector in a competitive environment where some scenarios are proposed: textit{First}, the tug-of-war between a bot and a bot detector is examined. It is interesting to analyze which party is more likely to prevail and which circumstances influence these expectations. In this regard, we model the problem as a synthetic adversarial game in which a conversational bot and a bot detector are engaged in strategic online interactions. textit{Second}, the bot detection model is evaluated under attack examples generated by a social bot; to this end, we poison the dataset with attack examples and evaluate the model performance under this condition. textit{Finally}, to investigate the impact of the dataset, a cross-domain analysis is performed. Through our comprehensive evaluation of different categories of social bots using two benchmark datasets, we were able to demonstrate some achivement that could be utilized in future works.

Read more

5/6/2024

Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulation

Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulation

Shiyang Lai, Yujin Potter, Junsol Kim, Richard Zhuang, Dawn Song, James Evans

YC

0

Reddit

0

Large language model behavior is shaped by the language of those with whom they interact. This capacity and their increasing prevalence online portend that they will intentionally or unintentionally program one another and form emergent AI subjectivities, relationships, and collectives. Here, we call upon the research community to investigate these societies of interacting artificial intelligences to increase their rewards and reduce their risks for human society and the health of online environments. We use a small community of models and their evolving outputs to illustrate how such emergent, decentralized AI collectives can spontaneously expand the bounds of human diversity and reduce the risk of toxic, anti-social behavior online. Finally, we discuss opportunities for AI cross-moderation and address ethical issues and design challenges associated with creating and maintaining free-formed AI collectives.

Read more

6/21/2024