Experiences of Censorship on TikTok Across Marginalised Identities

Read original: arXiv:2407.14164 - Published 7/22/2024 by Eddie L. Ungless, Nina Markl, Bjorn Ross
Total Score

0

Experiences of Censorship on TikTok Across Marginalised Identities

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper explores the experiences of marginalized users on the social media platform TikTok, focusing on instances of censorship and content moderation.
  • The researchers conducted interviews with TikTok users from diverse backgrounds to understand how content policies and algorithms may disproportionately impact certain communities.
  • The findings highlight systemic biases in TikTok's content moderation practices and the challenges marginalized users face in expressing themselves on the platform.

Plain English Explanation

Experiences of Censorship on TikTok Across Marginalised Identities

Social media platforms like TikTok often have content policies and automated systems in place to moderate user-generated content. However, these systems can sometimes unfairly target and censor posts from people with marginalized identities, such as racial minorities, LGBTQ+ individuals, or those with disabilities.

This research paper explores the experiences of these marginalized users on TikTok. The researchers interviewed people from diverse backgrounds to understand how TikTok's content moderation policies and algorithms may disproportionately impact their ability to express themselves on the platform.

The findings reveal systemic biases in TikTok's approach to content moderation. Marginalized users reported having their posts removed or accounts suspended for seemingly innocuous content, while similar posts from mainstream users were left untouched. This suggests the platform's automated systems may be unable to properly contextualize and evaluate content from marginalized perspectives.

Additionally, the researchers found that marginalized users often felt powerless to challenge TikTok's decisions or advocate for more inclusive policies. This can create a chilling effect, where people from diverse backgrounds are hesitant to share their authentic experiences out of fear of being censored.

The paper highlights the importance of ensuring social media platforms foster an inclusive and equitable environment for all users, regardless of their identity or background. By addressing the biases and shortcomings in their content moderation practices, platforms like TikTok can work to empower marginalized communities and give them a stronger voice in the digital space.

Technical Explanation

The researchers conducted a qualitative study to explore the experiences of censorship on TikTok across marginalized identities. They recruited a diverse sample of TikTok users from various backgrounds, including racial minorities, LGBTQ+ individuals, and users with disabilities.

Through semi-structured interviews, the researchers gathered insights into how these marginalized users perceived and experienced TikTok's content moderation policies and practices. The interview protocol focused on understanding participants' experiences with content removal, account suspension, and interactions with TikTok's support systems.

The analysis of the interview data revealed several key themes:

  1. Disproportionate Censorship: Marginalized users reported having their content removed or their accounts suspended for seemingly innocuous posts, while similar content from mainstream users was left untouched. This suggests systemic biases in TikTok's automated content moderation systems.

  2. Lack of Transparency and Recourse: Participants expressed frustration with the opaque nature of TikTok's content moderation processes and the difficulty in challenging platform decisions. Many felt powerless to advocate for more inclusive policies.

  3. Chilling Effect on Expression: The fear of arbitrary censorship led some marginalized users to self-censor or limit their authentic expression on the platform, stifling their ability to share their experiences.

The researchers argue that these findings highlight the need for social media platforms to address biases in their content moderation practices and work towards more inclusive and equitable policies. By empowering marginalized users and giving them a stronger voice, platforms can foster a more diverse and representative digital space.

Critical Analysis

The study provides valuable insights into the experiences of marginalized users on TikTok, shedding light on the challenges they face in expressing themselves on the platform. The researchers' qualitative approach, involving in-depth interviews with a diverse sample of participants, allows for a nuanced understanding of the systemic biases and power imbalances within TikTok's content moderation system.

However, the study also has some limitations. As a qualitative investigation, the findings may not be generalizable to the entire TikTok user base, and larger-scale quantitative analyses could provide a broader perspective on the prevalence and patterns of censorship across different marginalized groups.

Additionally, the research does not delve into the technical details of TikTok's content moderation algorithms or the specific criteria used to flag and remove content. Further insight into the inner workings of these systems could help identify more precise points of intervention and improvement.

Future research could explore the experiences of marginalized users on other social media platforms, drawing comparisons and identifying common themes or platform-specific challenges. Longitudinal studies tracking the evolution of content moderation policies and their impact on marginalized communities would also be valuable.

Overall, this paper serves as an important contribution to the growing body of research on algorithmic bias and the disproportionate impact of content moderation on underrepresented groups. By highlighting the need for more inclusive and transparent platform policies, the study encourages social media companies to prioritize equity and empower marginalized voices in the digital sphere.

Conclusion

The research on experiences of censorship on TikTok across marginalized identities reveals significant systemic biases in the platform's content moderation practices. Marginalized users, including racial minorities, LGBTQ+ individuals, and people with disabilities, reported disproportionate censorship of their posts and a lack of transparency in TikTok's decision-making processes.

These findings underscore the importance of ensuring social media platforms foster more inclusive and equitable environments for all users, regardless of their identity or background. By addressing the biases in their automated systems and empowering marginalized communities, platforms like TikTok can work to create a digital space that truly represents the diversity of its user base and gives a voice to those who have historically been marginalized.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Experiences of Censorship on TikTok Across Marginalised Identities
Total Score

0

Experiences of Censorship on TikTok Across Marginalised Identities

Eddie L. Ungless, Nina Markl, Bjorn Ross

TikTok has seen exponential growth as a platform, fuelled by the success of its proprietary recommender algorithm which serves tailored content to every user - though not without controversy. Users complain of their content being unfairly suppressed by ''the algorithm'', particularly users with marginalised identities such as LGBTQ+ users. Together with content removal, this suppression acts to censor what is shared on the platform. Journalists have revealed biases in automatic censorship, as well as human moderation. We investigate experiences of censorship on TikTok, across users marginalised by their gender, LGBTQ+ identity, disability or ethnicity. We survey 627 UK-based TikTok users and find that marginalised users often feel they are subject to censorship for content that does not violate community guidelines. We highlight many avenues for future research into censorship on TikTok, with a focus on users' folk theories, which greatly shape their experiences of the platform.

Read more

7/22/2024

We're not all construction workers: Algorithmic Compression of Latinidad on TikTok
Total Score

0

We're not all construction workers: Algorithmic Compression of Latinidad on TikTok

Nina Lutz, Cecilia Aragon

The Latinx diaspora in the United States is a rapidly growing and complex demographic who face intersectional harms and marginalizations in sociotechnical systems and are currently underserved in CSCW research. While the field understands that algorithms and digital content are experienced differently by marginalized populations, more investigation is needed about how Latinx people experience social media and, in particular, visual media. In this paper, we focus on how Latinx people experience the algorithmic system of the video-sharing platform TikTok. Through a bilingual interview and visual elicitation study of 19 Latinx TikTok users and 59 survey participants, we explore how Latinx individuals experience TikTok and its Latinx content. We find Latinx TikTok users actively use platform affordances to create positive and affirming identity content feeds, but these feeds are interrupted by negative content (i.e. violence, stereotypes, linguistic assumptions) due to platform affordances that have unique consequences for Latinx diaspora users. We discuss these implications on Latinx identity and representation, introduce the concept of textit{algorithmic identity compression}, where sociotechncial systems simplify, flatten, and conflate intersection identities, resulting in compression via the loss of critical cultural data deemed unnecessary by these systems and designers of them. This study explores how Latinx individuals are particularly vulnerable to this in sociotechnical systems, such as, but not limited to, TikTok.

Read more

7/22/2024

🛸

Total Score

0

Learning about Data, Algorithms, and Algorithmic Justice on TikTok in Personally Meaningful Ways

Luis Morales-Navarro, Yasmin B. Kafai, Ha Nguyen, Kayla DesPortes, Ralph Vacca, Camillia Matuk, Megan Silander, Anna Amato, Peter Woods, Francisco Castro, Mia Shaw, Selin Akgun, Christine Greenhow, Antero Garcia

TikTok, a popular short video sharing application, emerged as the dominant social media platform for young people, with a pronounced influence on how young women and people of color interact online. The application has become a global space for youth to connect with each other, offering not only entertainment but also opportunities to engage with artificial intelligence/machine learning (AI/ML)-driven recommendations and create content using AI/M-powered tools, such as generative AI filters. This provides opportunities for youth to explore and question the inner workings of these systems, their implications, and even use them to advocate for causes they are passionate about. We present different perspectives on how youth may learn in personally meaningful ways when engaging with TikTok. We discuss how youth investigate how TikTok works (considering data and algorithms), take into account issues of ethics and algorithmic justice and use their understanding of the platform to advocate for change.

Read more

5/27/2024

Modeling offensive content detection for TikTok
Total Score

0

Modeling offensive content detection for TikTok

Kasper Cools, Gideon Mailette de Buy Wenniger, Clara Maathuis

The advent of social media transformed interpersonal communication and information consumption processes. This digital landscape accommodates user intentions, also resulting in an increase of offensive language and harmful behavior. Concurrently, social media platforms collect vast datasets comprising user-generated content and behavioral information. These datasets are instrumental for platforms deploying machine learning and data-driven strategies, facilitating customer insights and countermeasures against social manipulation mechanisms like disinformation and offensive content. Nevertheless, the availability of such datasets, along with the application of various machine learning techniques, to researchers and practitioners, for specific social media platforms regarding particular events, is limited. In particular for TikTok, which offers unique tools for personalized content creation and sharing, the existing body of knowledge would benefit from having diverse comprehensive datasets and associated data analytics solutions on offensive content. While efforts from social media platforms, research, and practitioner communities are seen on this behalf, such content continues to proliferate. This translates to an essential need to make datasets publicly available and build corresponding intelligent solutions. On this behalf, this research undertakes the collection and analysis of TikTok data containing offensive content, building a series of machine learning and deep learning models for offensive content detection. This is done aiming at answering the following research question: How to develop a series of computational models to detect offensive content on TikTok?. To this end, a Data Science methodological approach is considered, 120.423 TikTok comments are collected, and on a balanced, binary classification approach, F1 score performance results of 0.863 is obtained.

Read more

9/2/2024