Breaking the Silence Detecting and Mitigating Gendered Abuse in Hindi, Tamil, and Indian English Online Spaces

2404.02013

YC

0

Reddit

0

Published 4/4/2024 by Advaitha Vetagiri, Gyandeep Kalita, Eisha Halder, Chetna Taparia, Partha Pakray, Riyanka Manna
Breaking the Silence Detecting and Mitigating Gendered Abuse in Hindi, Tamil, and Indian English Online Spaces

Abstract

Online gender-based harassment is a widespread issue limiting the free expression and participation of women and marginalized genders in digital spaces. Detecting such abusive content can enable platforms to curb this menace. We participated in the Gendered Abuse Detection in Indic Languages shared task at ICON2023 that provided datasets of annotated Twitter posts in English, Hindi and Tamil for building classifiers to identify gendered abuse. Our team CNLP-NITS-PP developed an ensemble approach combining CNN and BiLSTM networks that can effectively model semantic and sequential patterns in textual data. The CNN captures localized features indicative of abusive language through its convolution filters applied on embedded input text. To determine context-based offensiveness, the BiLSTM analyzes this sequence for dependencies among words and phrases. Multiple variations were trained using FastText and GloVe word embeddings for each language dataset comprising over 7,600 crowdsourced annotations across labels for explicit abuse, targeted minority attacks and general offences. The validation scores showed strong performance across f1-measures, especially for English 0.84. Our experiments reveal how customizing embeddings and model hyperparameters can improve detection capability. The proposed architecture ranked 1st in the competition, proving its ability to handle real-world noisy text with code-switching. This technique has a promising scope as platforms aim to combat cyber harassment facing Indic language internet users. Our Code is at https://github.com/advaithavetagiri/CNLP-NITS-PP

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper investigates detecting and mitigating gendered abuse in online spaces using Hindi, Tamil, and Indian English text.
  • It collects a dataset of abusive comments and trains models to identify gendered abuse in these languages.
  • The paper proposes techniques to mitigate the impact of gendered abuse, such as content moderation and education.

Plain English Explanation

The research paper examines the problem of gendered abuse, which is when people use harmful or discriminatory language against others based on their gender, in online spaces in India. The authors recognized that this is a significant issue, as women and other marginalized genders often face abuse and harassment online that can negatively impact their well-being and participation.

To address this problem, the researchers collected a dataset of abusive comments in Hindi, Tamil, and Indian English. They then developed machine learning models that can automatically detect when these comments contain gendered abuse. This allows for more effective content moderation and the ability to address this abuse more quickly.

Additionally, the paper proposes strategies to mitigate the impact of gendered abuse, such as educating users about respectful online behavior and providing support resources for those who experience this kind of harassment. The goal is to create safer and more inclusive online spaces for all.

Technical Explanation

The paper begins by discussing the prevalence of gendered abuse in online platforms, particularly for Indian users communicating in Hindi, Tamil, and English. The authors note that existing research on abuse detection has largely focused on English, creating a need to develop techniques for other languages.

To address this, the researchers constructed a dataset of abusive comments in the three target languages, manually annotating them for the presence of gendered abuse. They used this dataset to train machine learning models, including transformer-based language models, to automatically identify gendered abuse.

The paper evaluates the performance of these models, showing strong results in detecting gendered abuse across the three languages. It also explores techniques for mitigating the impact of such abuse, such as content moderation workflows and educational interventions to promote respectful online discourse.

Critical Analysis

The paper provides a valuable contribution by tackling the important challenge of gendered abuse in non-English online spaces. The multi-lingual approach is particularly notable, as it expands beyond the typical focus on English-language platforms.

That said, the dataset construction and annotation process could be further elaborated on. It is not clear how the researchers ensured comprehensive coverage of abusive language and avoid potential biases in the annotations.

Additionally, while the mitigation strategies proposed are promising, more details on their practical implementation and evaluation would strengthen the work. The paper could also have discussed potential ethical considerations around automated moderation and the risk of false positives.

Overall, the research represents an important step forward in addressing gendered abuse, but there remains ample room for further exploration and refinement of the techniques.

Conclusion

This paper tackles the critical issue of gendered abuse in online spaces across Hindi, Tamil, and Indian English. By developing models to detect such abuse and proposing mitigation strategies, the researchers aim to create safer and more inclusive digital environments for users in India.

While the technical approaches show promise, the work also highlights the need for continued research and real-world deployment to fully understand the complexities of this problem. Ongoing collaboration between academia, industry, and affected communities will be key to driving meaningful progress in this area.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🤖

The Uli Dataset: An Exercise in Experience Led Annotation of oGBV

Arnav Arora, Maha Jinadoss, Cheshta Arora, Denny George, Brindaalakshmi, Haseena Dawood Khan, Kirti Rawat, Div, Ritash, Seema Mathur, Shivani Yadav, Shehla Rashid Shora, Rie Raut, Sumit Pawar, Apurva Paithane, Sonia, Vivek, Dharini Priscilla, Khairunnisha, Grace Banu, Ambika Tandon, Rishav Thakker, Rahul Dev Korra, Aatman Vaidya, Tarunima Prabhakar

YC

0

Reddit

0

Online gender based violence has grown concomitantly with adoption of the internet and social media. Its effects are worse in the Global majority where many users use social media in languages other than English. The scale and volume of conversations on the internet has necessitated the need for automated detection of hate speech, and more specifically gendered abuse. There is, however, a lack of language specific and contextual data to build such automated tools. In this paper we present a dataset on gendered abuse in three languages- Hindi, Tamil and Indian English. The dataset comprises of tweets annotated along three questions pertaining to the experience of gender abuse, by experts who identify as women or a member of the LGBTQIA community in South Asia. Through this dataset we demonstrate a participatory approach to creating datasets that drive AI systems.

Read more

6/26/2024

💬

Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology

Rishav Hada, Safiya Husain, Varun Gumma, Harshita Diddee, Aditya Yadavalli, Agrima Seth, Nidhi Kulkarni, Ujwal Gadiraju, Aditya Vashistha, Vivek Seshadri, Kalika Bali

YC

0

Reddit

0

Existing research in measuring and mitigating gender bias predominantly centers on English, overlooking the intricate challenges posed by non-English languages and the Global South. This paper presents the first comprehensive study delving into the nuanced landscape of gender bias in Hindi, the third most spoken language globally. Our study employs diverse mining techniques, computational models, field studies and sheds light on the limitations of current methodologies. Given the challenges faced with mining gender biased statements in Hindi using existing methods, we conducted field studies to bootstrap the collection of such sentences. Through field studies involving rural and low-income community women, we uncover diverse perceptions of gender bias, underscoring the necessity for context-specific approaches. This paper advocates for a community-centric research design, amplifying voices often marginalized in previous studies. Our findings not only contribute to the understanding of gender bias in Hindi but also establish a foundation for further exploration of Indic languages. By exploring the intricacies of this understudied context, we call for thoughtful engagement with gender bias, promoting inclusivity and equity in linguistic and cultural contexts beyond the Global North.

Read more

5/13/2024

Exploiting Hatred by Targets for Hate Speech Detection on Vietnamese Social Media Texts

Exploiting Hatred by Targets for Hate Speech Detection on Vietnamese Social Media Texts

Cuong Nhat Vo, Khanh Bao Huynh, Son T. Luu, Trong-Hop Do

YC

0

Reddit

0

The growth of social networks makes toxic content spread rapidly. Hate speech detection is a task to help decrease the number of harmful comments. With the diversity in the hate speech created by users, it is necessary to interpret the hate speech besides detecting it. Hence, we propose a methodology to construct a system for targeted hate speech detection from online streaming texts from social media. We first introduce the ViTHSD - a targeted hate speech detection dataset for Vietnamese Social Media Texts. The dataset contains 10K comments, each comment is labeled to specific targets with three levels: clean, offensive, and hate. There are 5 targets in the dataset, and each target is labeled with the corresponding level manually by humans with strict annotation guidelines. The inter-annotator agreement obtained from the dataset is 0.45 by Cohen's Kappa index, which is indicated as a moderate level. Then, we construct a baseline for this task by combining the Bi-GRU-LSTM-CNN with the pre-trained language model to leverage the power of text representation of BERTology. Finally, we suggest a methodology to integrate the baseline model for targeted hate speech detection into the online streaming system for practical application in preventing hateful and offensive content on social media.

Read more

5/1/2024

Deep Learning Approaches for Detecting Adversarial Cyberbullying and Hate Speech in Social Networks

Deep Learning Approaches for Detecting Adversarial Cyberbullying and Hate Speech in Social Networks

Sylvia Worlali Azumah, Nelly Elsayed, Zag ElSayed, Murat Ozer, Amanda La Guardia

YC

0

Reddit

0

Cyberbullying is a significant concern intricately linked to technology that can find resolution through technological means. Despite its prevalence, technology also provides solutions to mitigate cyberbullying. To address growing concerns regarding the adverse impact of cyberbullying on individuals' online experiences, various online platforms and researchers are actively adopting measures to enhance the safety of digital environments. While researchers persist in crafting detection models to counteract or minimize cyberbullying, malicious actors are deploying adversarial techniques to circumvent these detection methods. This paper focuses on detecting cyberbullying in adversarial attack content within social networking site text data, specifically emphasizing hate speech. Utilizing a deep learning-based approach with a correction algorithm, this paper yielded significant results. An LSTM model with a fixed epoch of 100 demonstrated remarkable performance, achieving high accuracy, precision, recall, F1-score, and AUC-ROC scores of 87.57%, 88.73%, 87.57%, 88.15%, and 91% respectively. Additionally, the LSTM model's performance surpassed that of previous studies.

Read more

6/27/2024