Hostile Counterspeech Drives Users From Hate Subreddits

Read original: arXiv:2405.18374 - Published 5/29/2024 by Daniel Hickey, Matheus Schmitz, Daniel M. T. Fessler, Paul E. Smaldino, Kristina Lerman, Goran Muri'c, Keith Burghardt
Total Score

0

Hostile Counterspeech Drives Users From Hate Subreddits

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper examines the impact of hostile counterspeech on users of hate subreddits on the social media platform Reddit.
  • The researchers analyzed how different types of responses from newcomers, including hostile counterspeech, affected the behavior of hate subreddit users over time.
  • They found that hostile counterspeech, where newcomers directly challenge or condemn the hateful views expressed in these subreddits, can actually drive users away from these communities.

Plain English Explanation

The researchers in this study looked at what happens when people who don't usually participate in hate-filled online communities (known as "newcomers") start engaging with the users of those communities. Specifically, they were interested in how different types of responses from newcomers, like directly challenging the hateful views expressed in these communities, might affect the behavior of the regular users over time.

What they found is that when newcomers respond with hostile counterspeech - meaning they strongly condemn or push back against the hateful views being shared - this can actually cause the regular users of those hate-filled communities to leave and stop participating. This is an interesting result because it suggests that confronting hateful speech head-on, rather than ignoring it, may be an effective way to discourage people from engaging in and spreading that type of content online.

Technical Explanation

The researchers used data from Reddit, a popular social media platform, to analyze the impact of different types of newcomer interactions on users of hate-focused subreddits (online communities). They looked at how factors like hostile counterspeech, toxicity, and user movement between hate subreddits (peripatetic haters) affected user engagement and retention over time.

Their key finding was that hostile counterspeech, where newcomers directly challenged or condemned the hateful views being expressed, was particularly effective at driving users away from these hate-focused communities. This contrasts with prior research suggesting that ignoring hateful speech may be the best approach.

The researchers conducted various robustness checks to validate their results, examining factors like different definitions of hostility and accounting for potential confounding variables. Overall, their work provides important insights into how the online moderation of hateful content could be improved by leveraging the behavior-changing effects of hostile counterspeech.

Critical Analysis

The researchers acknowledge several limitations to their study, including the difficulty of definitively establishing causality and the focus on a single platform (Reddit). Additionally, they note that the long-term impacts of hostile counterspeech on user radicalization or migration to other hate-filled spaces were not examined.

One potential issue is that the study does not delve deeply into the specific mechanisms by which hostile counterspeech drives users away. Further research could explore whether this effect is due to users feeling challenged and uncomfortable, a desire to avoid confrontation, or some other psychological factors.

Additionally, the study does not address potential unintended consequences, such as whether hostile counterspeech could inadvertently reinforce the victimhood narratives often used by hate groups to recruit new members. A more nuanced understanding of the tradeoffs and contextual factors involved would be valuable.

Overall, this research provides a valuable contribution to the ongoing discussion around effective strategies for countering online hate speech. However, further work is needed to fully understand the complexities and potential pitfalls of different moderation approaches.

Conclusion

This study offers important insights into how the online moderation of hateful content could be improved by leveraging the behavior-changing effects of hostile counterspeech. The key finding - that directly challenging and condemning hateful views can drive users away from hate-focused communities - suggests that a more active, confrontational approach may be more effective than ignoring or downplaying such content.

While the study has some limitations, it contributes to the growing body of research on countering online hate and highlights the need for a nuanced, context-sensitive understanding of the tradeoffs involved. As platforms and policymakers continue to grapple with this complex issue, this work provides a valuable perspective to consider.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Hostile Counterspeech Drives Users From Hate Subreddits
Total Score

0

Hostile Counterspeech Drives Users From Hate Subreddits

Daniel Hickey, Matheus Schmitz, Daniel M. T. Fessler, Paul E. Smaldino, Kristina Lerman, Goran Muri'c, Keith Burghardt

Counterspeech -- speech that opposes hate speech -- has gained significant attention recently as a strategy to reduce hate on social media. While previous studies suggest that counterspeech can somewhat reduce hate speech, little is known about its effects on participation in online hate communities, nor which counterspeech tactics reduce harmful behavior. We begin to address these gaps by identifying 25 large hate communities (subreddits) within Reddit and analyzing the effect of counterspeech on newcomers within these communities. We first construct a new public dataset of carefully annotated counterspeech and non-counterspeech comments within these subreddits. We use this dataset to train a state-of-the-art counterspeech detection model. Next, we use matching to evaluate the causal effects of hostile and non-hostile counterspeech on the engagement of newcomers in hate subreddits. We find that, while non-hostile counterspeech is ineffective at keeping users from fully disengaging from these hate subreddits, a single hostile counterspeech comment substantially reduces both future likelihood of engagement. While offering nuance to the understanding of counterspeech efficacy, these results a) leave unanswered the question of whether hostile counterspeech dissuades newcomers from participation in online hate writ large, or merely drives them into less-moderated and more extreme hate communities, and b) raises ethical considerations about hostile counterspeech, which is both comparatively common and might exacerbate rather than mitigate the net level of antagonism in society. These findings underscore the importance of future work to improve counterspeech tactics and minimize unintended harm.

Read more

5/29/2024

📈

Total Score

0

NLP for Counterspeech against Hate: A Survey and How-To Guide

Helena Bonaldi, Yi-Ling Chung, Gavin Abercrombie, Marco Guerini

In recent years, counterspeech has emerged as one of the most promising strategies to fight online hate. These non-escalatory responses tackle online abuse while preserving the freedom of speech of the users, and can have a tangible impact in reducing online and offline violence. Recently, there has been growing interest from the Natural Language Processing (NLP) community in addressing the challenges of analysing, collecting, classifying, and automatically generating counterspeech, to reduce the huge burden of manually producing it. In particular, researchers have taken different directions in addressing these challenges, thus providing a variety of related tasks and resources. In this paper, we provide a guide for doing research on counterspeech, by describing - with detailed examples - the steps to undertake, and providing best practices that can be learnt from the NLP studies on this topic. Finally, we discuss open challenges and future directions of counterspeech research in NLP.

Read more

4/1/2024

Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speech
Total Score

0

Hatred Stems from Ignorance! Distillation of the Persuasion Modes in Countering Conversational Hate Speech

Ghadi Alyahya, Abeer Aldayel

Examining the factors that the counterspeech uses are at the core of understanding the optimal methods for confronting hate speech online. Various studies have assessed the emotional base factors used in counter speech, such as emotional empathy, offensiveness, and hostility. To better understand the counterspeech used in conversations, this study distills persuasion modes into reason, emotion, and credibility and evaluates their use in two types of conversation interactions: closed (multi-turn) and open (single-turn) concerning racism, sexism, and religious bigotry. The evaluation covers the distinct behaviors seen with human-sourced as opposed to machine-generated counterspeech. It also assesses the interplay between the stance taken and the mode of persuasion seen in the counterspeech. Notably, we observe nuanced differences in the counterspeech persuasion modes used in open and closed interactions, especially in terms of the topic, with a general tendency to use reason as a persuasion mode to express the counterpoint to hate comments. The machine-generated counterspeech tends to exhibit an emotional persuasion mode, while human counters lean toward reason. Furthermore, our study shows that reason tends to obtain more supportive replies than other persuasion modes. The findings highlight the potential for incorporating persuasion modes into studies about countering hate speech, as they can serve as an optimal means of explainability and pave the way for the further adoption of the reply's stance and the role it plays in assessing what comprises the optimal counterspeech.

Read more

7/17/2024

🏷️

Total Score

0

Discursive objection strategies in online comments: Developing a classification schema and validating its training

Ashley L. Shea, Aspen K. B. Omapang, Ji Yong Cho, Miryam Y. Ginsparg, Natalie Bazarova, Winice Hui, Ren'e F. Kizilcec, Chau Tong, Drew Margolin

Most Americans agree that misinformation, hate speech and harassment are harmful and inadequately curbed on social media through current moderation practices. In this paper, we aim to understand the discursive strategies employed by people in response to harmful speech in news comments. We conducted a content analysis of more than 6500 comment replies to trending news videos on YouTube and Twitter and identified seven distinct discursive objection strategies (Study 1). We examined the frequency of each strategy's occurrence from the 6500 comment replies, as well as from a second sample of 2004 replies (Study 2). Together, these studies show that people deploy a diversity of discursive strategies when objecting to speech, and reputational attacks are the most common. The resulting classification scheme accounts for different theoretical approaches for expressing objections and offers a comprehensive perspective on grassroots efforts aimed at stopping offensive or problematic speech on campus.

Read more

5/15/2024