Toxic Synergy Between Hate Speech and Fake News Exposure
2404.08110
0
0
đŁď¸
Abstract
Hate speech on social media is a pressing concern. Understanding the factors associated with hate speech may help mitigate it. Here we explore the association between hate speech and exposure to fake news by studying the correlation between exposure to news from low-credibility sources through following connections and the use of hate speech on Twitter. Using news source credibility labels and a dataset of posts with hate speech targeting various populations, we find that hate speakers are exposed to lower percentages of posts linking to credible news sources. When taking the target population into account, we find that this association is mainly driven by anti-semitic and anti-Muslim content. We also observe that hate speakers are more likely to be exposed to low-credibility news with low popularity. Finally, while hate speech is associated with low-credibility news from partisan sources, we find that those sources tend to skew to the political left for antisemitic content and to the political right for hate speech targeting Muslim and Latino populations. Our results suggest that mitigating fake news and hate speech may have synergistic effects.
Create account to get full access
Overview
- Hate speech on social media is a significant concern
- Understanding the factors associated with hate speech could help mitigate it
- This study explores the relationship between hate speech and exposure to fake news on Twitter
Plain English Explanation
Hate speech, or the use of offensive or derogatory language targeting specific groups, is a major problem on social media platforms. Researchers wanted to understand what factors might contribute to the spread of hate speech online.
One potential factor they investigated is the role of fake news - news stories that are false or misleading. The researchers looked at whether people who engage in hate speech on Twitter are more likely to be exposed to fake news from low-credibility sources.
They found that people who use hate speech on Twitter tend to see a lower percentage of posts linking to credible news sources, compared to people who don't use hate speech. This connection was particularly strong for hate speech targeting Jewish and Muslim people.
The researchers also observed that hate speech was more often associated with low-popularity fake news, rather than high-profile fake stories. Interestingly, the political leaning of the fake news sources varied - antisemitic hate speech was linked more to left-leaning sources, while anti-Muslim and anti-Latino hate speech was linked more to right-leaning sources.
These findings suggest that addressing the spread of fake news online could have a positive impact on reducing hate speech as well. Tackling these two interrelated problems may have complementary benefits.
Technical Explanation
The researchers used a dataset of tweets containing hate speech targeting various populations, including Jews, Muslims, Latinos, and others. They paired this with information about the credibility of the news sources that were shared in those tweets, using established credibility ratings.
By analyzing the characteristics of the news sources that hate speech authors were exposed to, the researchers found several key insights:
- Hate speech authors saw a lower percentage of posts linking to credible news sources, compared to non-hate speech authors.
- This association was strongest for hate speech targeting Jewish and Muslim populations.
- Hate speech was more often linked to low-popularity fake news stories, rather than high-profile hoaxes.
- The political leaning of the fake news sources varied - left-leaning for antisemitic content, right-leaning for anti-Muslim and anti-Latino content.
The researchers suggest these findings indicate that mitigating the spread of fake news, particularly from partisan or low-credibility sources, could have synergistic benefits in reducing hate speech online as well. Addressing these two interrelated problems may be more effective than tackling them in isolation.
Critical Analysis
The researchers acknowledge several important limitations to their study. First, the dataset of hate speech was focused on English-language tweets, so the findings may not generalize to other cultural contexts where hate speech patterns could differ.
Additionally, the study only looked at correlations between hate speech and exposure to fake news, not causation. It's possible that other factors, like political ideology or social media echo chambers, could be driving both the consumption of fake news and the production of hate speech.
Further research would be needed to establish a clearer causal link, potentially through controlled experiments or longitudinal studies. It would also be valuable to explore whether interventions to limit the spread of fake news have a measurable impact on reducing hate speech in online communities.
Conclusion
This study provides compelling evidence of a correlation between exposure to fake news from low-credibility sources and the use of hate speech on social media. The findings suggest that efforts to combat the spread of misinformation online may have positive spillover effects in reducing hate speech as well.
While more research is needed to fully understand the relationship, this work highlights the importance of holistic approaches to addressing these interrelated challenges. Policymakers, technology companies, and civil society groups should consider strategies that target both fake news and online hate, in order to create safer and more inclusive digital spaces.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Trust and Terror: Hazards in Text Reveal Negatively Biased Credulity and Partisan Negativity Bias
Keith Burghardt, Daniel M. T. Fessler, Chyna Tang, Anne Pisor, Kristina Lerman
0
0
Socio-linguistic indicators of text, such as emotion or sentiment, are often extracted using neural networks in order to better understand features of social media. One indicator that is often overlooked, however, is the presence of hazards within text. Recent psychological research suggests that statements about hazards are more believable than statements about benefits (a property known as negatively biased credulity), and that political liberals and conservatives differ in how often they share hazards. Here, we develop a new model to detect information concerning hazards, trained on a new collection of annotated X posts, as well as urban legends annotated in previous work. We show that not only does this model perform well (outperforming, e.g., zero-shot human annotator proxies, such as GPT-4) but that the hazard information it extracts is not strongly correlated with other indicators, namely moral outrage, sentiment, emotions, and threat words. (That said, consonant with expectations, hazard information does correlate positively with such emotions as fear, and negatively with emotions like joy.) We then apply this model to three datasets: X posts about COVID-19, X posts about the 2023 Hamas-Israel war, and a new expanded collection of urban legends. From these data, we uncover words associated with hazards unique to each dataset as well as differences in this language between groups of users, such as conservatives and liberals, which informs what these groups perceive as hazards. We further show that information about hazards peaks in frequency after major hazard events, and therefore acts as an automated indicator of such events. Finally, we find that information about hazards is especially prevalent in urban legends, which is consistent with previous work that finds that reports of hazards are more likely to be both believed and transmitted.
5/29/2024
Exploring Boundaries and Intensities in Offensive and Hate Speech: Unveiling the Complex Spectrum of Social Media Discourse
Abinew Ali Ayele, Esubalew Alemneh Jalew, Adem Chanie Ali, Seid Muhie Yimam, Chris Biemann
0
0
The prevalence of digital media and evolving sociopolitical dynamics have significantly amplified the dissemination of hateful content. Existing studies mainly focus on classifying texts into binary categories, often overlooking the continuous spectrum of offensiveness and hatefulness inherent in the text. In this research, we present an extensive benchmark dataset for Amharic, comprising 8,258 tweets annotated for three distinct tasks: category classification, identification of hate targets, and rating offensiveness and hatefulness intensities. Our study highlights that a considerable majority of tweets belong to the less offensive and less hate intensity levels, underscoring the need for early interventions by stakeholders. The prevalence of ethnic and political hatred targets, with significant overlaps in our dataset, emphasizes the complex relationships within Ethiopia's sociopolitical landscape. We build classification and regression models and investigate the efficacy of models in handling these tasks. Our results reveal that hate and offensive speech can not be addressed by a simplistic binary classification, instead manifesting as variables across a continuous range of values. The Afro-XLMR-large model exhibits the best performances achieving F1-scores of 75.30%, 70.59%, and 29.42% for the category, target, and regression tasks, respectively. The 80.22% correlation coefficient of the Afro-XLMR-large model indicates strong alignments.
4/19/2024
U.S. Election Hardens Hate Universe
Akshay Verma, Richard Sear, Neil F. Johnson
0
0
Local or national politics can trigger potentially dangerous hate in someone. But with a third of the world's population eligible to vote in elections in 2024 alone, we lack understanding of how individual-level hate multiplies up to hate behavior at the collective global scale. Here we show, based on the most recent U.S. election, that offline events are associated with a rapid adaptation of the global online hate universe that hardens (strengthens) both its network-of-networks structure and the 'flavors' of hate content that it collectively produces. Approximately 50 million potential voters in hate communities are drawn closer to each other and to the broad mainstream of approximately 2 billion others. It triggers new hate content at scale around immigration, ethnicity, and antisemitism that aligns with conspiracy theories about Jewish-led replacement before blending in hate around gender identity/sexual orientation, and religion. Telegram acts as a key hardening agent - yet is overlooked by U.S. Congressional hearings and new E.U. legislation. Because the hate universe has remained robust since 2020, anti-hate messaging surrounding not only upcoming elections but also other events like the war in Gaza, should pivot to blending multiple hate 'flavors' while targeting previously untouched social media structures.
5/2/2024
Tox-BART: Leveraging Toxicity Attributes for Explanation Generation of Implicit Hate Speech
Neemesh Yadav, Sarah Masud, Vikram Goyal, Vikram Goyal, Md Shad Akhtar, Tanmoy Chakraborty
0
0
Employing language models to generate explanations for an incoming implicit hate post is an active area of research. The explanation is intended to make explicit the underlying stereotype and aid content moderators. The training often combines top-k relevant knowledge graph (KG) tuples to provide world knowledge and improve performance on standard metrics. Interestingly, our study presents conflicting evidence for the role of the quality of KG tuples in generating implicit explanations. Consequently, simpler models incorporating external toxicity signals outperform KG-infused models. Compared to the KG-based setup, we observe a comparable performance for SBIC (LatentHatred) datasets with a performance variation of +0.44 (+0.49), +1.83 (-1.56), and -4.59 (+0.77) in BLEU, ROUGE-L, and BERTScore. Further human evaluation and error analysis reveal that our proposed setup produces more precise explanations than zero-shot GPT-3.5, highlighting the intricate nature of the task.
6/7/2024