Tracking Patterns in Toxicity and Antisocial Behavior Over User Lifetimes on Large Social Media Platforms

Read original: arXiv:2407.09365 - Published 7/15/2024 by Katy Blumer, Jon Kleinberg
Total Score

0

Tracking Patterns in Toxicity and Antisocial Behavior Over User Lifetimes on Large Social Media Platforms

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper examines patterns of toxicity and antisocial behavior on large social media platforms over the lifetime of individual users.
  • The researchers developed a "toxicity score" and "downvote score" to measure different aspects of negative behavior on the platform.
  • They analyzed data from a large social media platform to understand how these scores change over time for individual users.

Plain English Explanation

The researchers in this study wanted to understand how people's behavior on social media changes over time. Specifically, they looked at two key measures: toxicity score and downvote score.

The toxicity score was a way to measure how "toxic" or hostile a user's comments were. The downvote score looked at how often a user's posts were downvoted or disliked by others on the platform.

By tracking these scores over the lifetime of individual users, the researchers hoped to identify patterns in how people's online behavior evolves. For example, do users start out well-behaved but become more toxic over time? Or do they start toxic and then improve? Understanding these patterns could help social media platforms find ways to encourage more positive interactions.

The researchers analyzed data from a large social media platform to look for these kinds of longitudinal trends. Their goal was to provide insights that could inform moderation strategies and promote healthier online communities.

Technical Explanation

The researchers developed two key metrics to track user behavior over time:

  1. Toxicity score: This measured the level of "toxicity" in a user's comments, based on an automated model that detects hostile, insulting, or otherwise harmful language.

  2. Downvote score: This looked at how often a user's posts were downvoted or disliked by others on the platform, indicating potentially antisocial or undesirable behavior.

By analyzing how these scores changed for individual users over the course of their time on the platform, the researchers hoped to identify common patterns and trajectories in online behavior. This could provide valuable insights to help social media companies develop more effective moderation strategies and foster healthier online communities.

The study analyzed data from a large, unnamed social media platform, tracking toxicity and downvote scores for millions of users over time. The researchers used statistical modeling techniques to uncover trends and clusters in how these behavioral metrics evolved for individual users.

Critical Analysis

The researchers acknowledge several limitations in their study. First, the toxicity and downvote scores, while useful proxies, may not fully capture the nuanced nature of online behavior and interpersonal dynamics. There could be important contextual factors that these automated measures miss.

Additionally, the data was limited to a single, unnamed social media platform. Patterns of toxicity and antisocial behavior may differ significantly across platforms with varying communities, moderation policies, and user demographics. Further research would be needed to determine how generalizable these findings are.

The paper also does not delve deeply into the underlying drivers or causes of the observed behavioral trends. Understanding the personal, social, and platform-level factors that shape user trajectories could lead to more impactful interventions.

Despite these limitations, this study represents an important step in using longitudinal data to understand the evolution of online behavior over time. The insights could inform the development of more targeted and effective moderation strategies to promote healthier online communities.

Conclusion

This research aimed to shed light on how patterns of toxicity and antisocial behavior change over the lifetime of individual users on large social media platforms. By developing metrics like toxicity score and downvote score, the researchers were able to identify common trajectories in user behavior.

The findings could help social media companies design more effective moderation policies and interventions to promote healthier online communities. However, the researchers acknowledge limitations in their approach and call for further research, including the use of comprehensive datasets and a deeper understanding of the underlying drivers of evolving language patterns on social media.

Overall, this study represents an important step towards leveraging longitudinal data to gain insights into the dynamics of online behavior and identify ways to foster more constructive digital interactions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Tracking Patterns in Toxicity and Antisocial Behavior Over User Lifetimes on Large Social Media Platforms
Total Score

0

Tracking Patterns in Toxicity and Antisocial Behavior Over User Lifetimes on Large Social Media Platforms

Katy Blumer, Jon Kleinberg

An increasing amount of attention has been devoted to the problem of toxic or antisocial behavior on social media. In this paper we analyze such behavior at very large scales: we analyze toxicity over a 14-year time span on nearly 500 million comments from Reddit and Wikipedia, grounded in two different proxies for toxicity. At the individual level, we analyze users' toxicity levels over the course of their time on the site, and find a striking reversal in trends: both Reddit and Wikipedia users tended to become less toxic over their life cycles on the site in the early (pre-2013) history of the site, but more toxic over their life cycles in the later (post-2013) history of the site. We also find that toxicity on Reddit and Wikipedia differ in a key way, with the most toxic behavior on Reddit exhibited in aggregate by the most active users, and the most toxic behavior on Wikipedia exhibited in aggregate by the least active users. Finally, we consider the toxicity of discussion around widely-shared pieces of content, and find that the trends for toxicity in discussion about content bear interesting similarities with the trends for toxicity in discussion by users.

Read more

7/15/2024

Analyzing Toxicity in Deep Conversations: A Reddit Case Study
Total Score

0

Analyzing Toxicity in Deep Conversations: A Reddit Case Study

Vigneshwaran Shankaran, Rajesh Sharma

Online social media has become increasingly popular in recent years due to its ease of access and ability to connect with others. One of social media's main draws is its anonymity, allowing users to share their thoughts and opinions without fear of judgment or retribution. This anonymity has also made social media prone to harmful content, which requires moderation to ensure responsible and productive use. Several methods using artificial intelligence have been employed to detect harmful content. However, conversation and contextual analysis of hate speech are still understudied. Most promising works only analyze a single text at a time rather than the conversation supporting it. In this work, we employ a tree-based approach to understand how users behave concerning toxicity in public conversation settings. To this end, we collect both the posts and the comment sections of the top 100 posts from 8 Reddit communities that allow profanity, totaling over 1 million responses. We find that toxic comments increase the likelihood of subsequent toxic comments being produced in online conversations. Our analysis also shows that immediate context plays a vital role in shaping a response rather than the original post. We also study the effect of consensual profanity and observe overlapping similarities with non-consensual profanity in terms of user behavior and patterns.

Read more

4/12/2024

The Constant in HATE: Analyzing Toxicity in Reddit across Topics and Languages
Total Score

0

The Constant in HATE: Analyzing Toxicity in Reddit across Topics and Languages

Wondimagegnhue Tsegaye Tufa, Ilia Markov, Piek Vossen

Toxic language remains an ongoing challenge on social media platforms, presenting significant issues for users and communities. This paper provides a cross-topic and cross-lingual analysis of toxicity in Reddit conversations. We collect 1.5 million comment threads from 481 communities in six languages: English, German, Spanish, Turkish,Arabic, and Dutch, covering 80 topics such as Culture, Politics, and News. We thoroughly analyze how toxicity spikes within different communities in relation to specific topics. We observe consistent patterns of increased toxicity across languages for certain topics, while also noting significant variations within specific language communities.

Read more

4/30/2024

🛠️

Total Score

0

Grounding Toxicity in Real-World Events across Languages

Wondimagegnhue Tsegaye Tufa, Ilia Markov, Piek Vossen

Social media conversations frequently suffer from toxicity, creating significant issues for users, moderators, and entire communities. Events in the real world, like elections or conflicts, can initiate and escalate toxic behavior online. Our study investigates how real-world events influence the origin and spread of toxicity in online discussions across various languages and regions. We gathered Reddit data comprising 4.5 million comments from 31 thousand posts in six different languages (Dutch, English, German, Arabic, Turkish and Spanish). We target fifteen major social and political world events that occurred between 2020 and 2023. We observe significant variations in toxicity, negative sentiment, and emotion expressions across different events and language communities, showing that toxicity is a complex phenomenon in which many different factors interact and still need to be investigated. We will release the data for further research along with our code.

Read more

5/24/2024