The Peripatetic Hater: Predicting Movement Among Hate Subreddits
0
Sign in to get full access
Overview
- This research paper explores the movement of users between different hate-based subreddits on the social media platform Reddit.
- The study examines the dynamics and patterns of how individuals transition between these toxic online communities.
- The researchers aim to develop predictive models to anticipate user migration between hate-based subreddits, with the potential to inform content moderation and intervention strategies.
Plain English Explanation
The study focuses on understanding the behavior of people who participate in online communities that promote hateful, discriminatory, or extremist ideologies. These communities, often found on subreddits (topic-specific forums) on the popular social media platform Reddit, can be breeding grounds for the spread of harmful ideas and behaviors.
The researchers wanted to investigate how users move between these different hate-based subreddits over time. By tracking these user movements, they hoped to develop predictive models that could anticipate when and where users might migrate to new hate-based communities. This information could potentially be used by platform moderators to proactively identify and address the spread of hate speech and extremism online.
To do this, the researchers analyzed data from various hate-based subreddits, looking at factors such as the content of posts, user interactions, and user migration patterns. By understanding the dynamics of these toxic online communities, the researchers aimed to provide insights that could inform more effective content moderation and intervention strategies to counter the proliferation of hate speech and extremism on social media platforms.
Technical Explanation
The researchers collected data from multiple hate-based subreddits on Reddit, including user activities, post contents, and user migration patterns between these communities. They then developed predictive models to forecast when users might transition from one hate-based subreddit to another.
The study employed a combination of natural language processing techniques and network analysis to analyze the textual content of posts and the interactions between users across different hate-based subreddits. This allowed the researchers to identify patterns and trends in how users engage with and move between these toxic online communities.
By understanding the factors that influence user migration, such as the similarity of content or the connections between different hate-based subreddits, the researchers aimed to create models that could anticipate and potentially intervene in the spread of hate speech and extremism on social media platforms. The findings from this research could inform the development of more effective content moderation strategies and interventions to address the proliferation of online hate.
Critical Analysis
The researchers acknowledge several limitations and areas for further research in their paper. One key limitation is the reliance on data from a single platform, Reddit, which may not be representative of the broader landscape of online hate communities. Additionally, the study focuses primarily on quantitative analysis and predictive modeling, while qualitative investigations into the motivations and psychology of users engaged in these toxic online spaces could provide valuable complementary insights.
Furthermore, the researchers note that the development of effective interventions to counter the spread of online hate remains a significant challenge, as any such efforts must balance concerns around free speech and individual privacy. The potential for unintended consequences, such as the further marginalization of vulnerable communities or the exacerbation of existing societal divides, must also be carefully considered.
Overall, this research represents an important step in understanding the dynamics of hate-based online communities and the potential to develop predictive models to inform content moderation strategies. However, the complexity of the problem and the inherent ethical considerations highlight the need for ongoing multidisciplinary collaboration and a nuanced, evidence-based approach to addressing the pervasive issue of online hate.
Conclusion
This study provides valuable insights into the movement of users between different hate-based subreddits on the social media platform Reddit. By developing predictive models to anticipate user migration patterns, the researchers aim to inform more effective content moderation and intervention strategies to counter the proliferation of online hate and extremism.
While the findings offer important contributions to the understanding of these toxic online communities, the researchers acknowledge the limitations of their approach and the need for further research to address the complex and multifaceted nature of the problem. Addressing online hate will require a multidisciplinary effort, balancing concerns around free speech, individual privacy, and the potential for unintended consequences.
Ultimately, this research highlights the importance of continued efforts to understand and mitigate the spread of hateful ideologies and behaviors in the digital sphere, with the goal of promoting more inclusive, tolerant, and constructive online discourse.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
The Peripatetic Hater: Predicting Movement Among Hate Subreddits
Daniel Hickey, Daniel M. T. Fessler, Kristina Lerman, Keith Burghardt
Many online hate groups exist to disparage others based on race, gender identity, sex, or other characteristics. The accessibility of these communities allows users to join multiple types of hate groups (e.g., a racist community and misogynistic community), which calls into question whether these peripatetic users could be further radicalized compared to users that stay in one type of hate group. However, little is known about the dynamics of joining multiple types of hate groups, nor the effect of these groups on peripatetic users. In this paper, we develop a new method to classify hate subreddits, and the identities they disparage, which we use to better understand how users become peripatetic (join different types of hate subreddits). The hate classification technique utilizes human-validated LLMs to extract the protected identities attacked, if any, across 168 subreddits. We then cluster identity-attacking subreddits to discover three broad categories of hate: racist, anti-LGBTQ, and misogynistic. We show that becoming active in a user's first hate subreddit can cause them to become active in additional hate subreddits of a different category. We also find that users who join additional hate subreddits, especially of a different category, become more active in hate subreddits as a whole and develop a wider hate group lexicon. We are therefore motivated to train an AI model that we find usefully predicts the hate categories users will become active in based on post text read and written. The accuracy of this model may be partly driven by peripatetic users often using the language of hate subreddits they eventually join. Overall, these results highlight the unique risks associated with hate communities on a social media platform, as discussion of alternative targets of hate may lead users to target more protected identities.
Read more5/28/2024
🗣️
0
Analyzing User Characteristics of Hate Speech Spreaders on Social Media
Dominique Geissler, Abdurahman Maarouf, Stefan Feuerriegel
Hate speech on social media threatens the mental and physical well-being of individuals and contributes to real-world violence. Resharing is an important driver behind the spread of hate speech on social media. Yet, little is known about who reshares hate speech and what their characteristics are. In this paper, we analyze the role of user characteristics in hate speech resharing across different types of hate speech (e.g., political hate). For this, we proceed as follows: First, we cluster hate speech posts using large language models to identify different types of hate speech. Then we model the effects of user attributes on users' probability to reshare hate speech using an explainable machine learning model. To do so, we apply debiasing to control for selection bias in our observational social media data and further control for the latent vulnerability of users to hate speech. We find that, all else equal, users with fewer followers, fewer friends, fewer posts, and older accounts share more hate speech. This shows that users with little social influence tend to share more hate speech. Further, we find substantial heterogeneity across different types of hate speech. For example, racist and misogynistic hate is spread mostly by users with little social influence. In contrast, political anti-Trump and anti-right-wing hate is reshared by users with larger social influence. Overall, understanding the factors that drive users to share hate speech is crucial for detecting individuals at risk of engaging in harmful behavior and for designing effective mitigation strategies.
Read more7/30/2024
0
Hostile Counterspeech Drives Users From Hate Subreddits
Daniel Hickey, Matheus Schmitz, Daniel M. T. Fessler, Paul E. Smaldino, Kristina Lerman, Goran Muri'c, Keith Burghardt
Counterspeech -- speech that opposes hate speech -- has gained significant attention recently as a strategy to reduce hate on social media. While previous studies suggest that counterspeech can somewhat reduce hate speech, little is known about its effects on participation in online hate communities, nor which counterspeech tactics reduce harmful behavior. We begin to address these gaps by identifying 25 large hate communities (subreddits) within Reddit and analyzing the effect of counterspeech on newcomers within these communities. We first construct a new public dataset of carefully annotated counterspeech and non-counterspeech comments within these subreddits. We use this dataset to train a state-of-the-art counterspeech detection model. Next, we use matching to evaluate the causal effects of hostile and non-hostile counterspeech on the engagement of newcomers in hate subreddits. We find that, while non-hostile counterspeech is ineffective at keeping users from fully disengaging from these hate subreddits, a single hostile counterspeech comment substantially reduces both future likelihood of engagement. While offering nuance to the understanding of counterspeech efficacy, these results a) leave unanswered the question of whether hostile counterspeech dissuades newcomers from participation in online hate writ large, or merely drives them into less-moderated and more extreme hate communities, and b) raises ethical considerations about hostile counterspeech, which is both comparatively common and might exacerbate rather than mitigate the net level of antagonism in society. These findings underscore the importance of future work to improve counterspeech tactics and minimize unintended harm.
Read more5/29/2024
1
Dynamics of Ideological Biases of Social Media Users
Mohammed Shahid Modi, James Flamino, Boleslaw K. Szymanski
Humanity for centuries has perfected skills of interpersonal interactions and evolved patterns that enable people to detect lies and deceiving behavior of others in face-to-face settings. Unprecedented growth of people's access to mobile phones and social media raises an important question: How does this new technology influence people's interactions and support the use of traditional patterns? In this article, we answer this question for homophily-driven patterns in social media. In our previous studies, we found that, on a university campus, changes in student opinions were driven by the desire to hold popular opinions. Here, we demonstrate that the evolution of online platform-wide opinion groups is driven by the same desire. We focus on two social media: Twitter and Parler, on which we tracked the political biases of their users. On Parler, an initially stable group of Right-biased users evolved into a permanent Right-leaning echo chamber dominating weaker, transient groups of members with opposing political biases. In contrast, on Twitter, the initial presence of two large opposing bias groups led to the evolution of a bimodal bias distribution, with a high degree of polarization. We capture the movement of users from the initial to final bias groups during the tracking period. We also show that user choices are influenced by side-effects of homophily. Users entering the platform attempt to find a sufficiently large group whose members hold political biases within the range sufficiently close to their own. If successful, they stabilize their biases and become permanent members of the group. Otherwise, they leave the platform. We believe that the dynamics of users' behavior uncovered in this article create a foundation for technical solutions supporting social groups on social media and socially aware networks.
Read more7/23/2024