Narratives at Conflict: Computational Analysis of News Framing in Multilingual Disinformation Campaigns
0
Sign in to get full access
Overview
- The research paper explores how computational analysis can be used to study news framing and disinformation campaigns across multiple languages.
- The study examines how different narratives and frames are used in news coverage to shape public opinion.
- The research aims to develop new methods for monitoring and analyzing multilingual disinformation efforts.
Plain English Explanation
The paper looks at how news stories can be used to spread misinformation or push certain narratives. Researchers used computer programs to analyze news articles in different languages and identify the different ways the stories were being framed. This can help understand how disinformation campaigns operate across multiple languages and platforms.
The key idea is that the way a news story is presented - the "frame" or narrative used - can significantly impact how people interpret the information. By studying these framing techniques computationally, the researchers hoped to develop new tools for tracking and analyzing complex disinformation efforts that span languages and media outlets.
Technical Explanation
The paper describes a computational approach for analyzing news framing across multiple languages. The researchers collected a dataset of news articles in English, Russian, and Ukrainian covering the 2022 Russian invasion of Ukraine. They used natural language processing techniques to extract the key narratives and frames present in the articles.
Some of the specific methods employed include:
- Topic modeling to identify the main themes and topics discussed
- Narrative mapping to visualize the relationships between different storylines
- Language model-based framing analysis to quantify the prevalence of certain frames
The researchers then compared the narratives and frames used across the different language versions of the news coverage. This allowed them to uncover systematic differences in how the conflict was portrayed in Russian, Ukrainian, and English-language media.
Critical Analysis
The paper provides a novel computational approach for studying multilingual disinformation campaigns. However, the authors acknowledge several limitations:
- The analysis is focused on a single geopolitical conflict, so the generalizability to other domains is unclear.
- The news article dataset, while large, may not be fully comprehensive or representative of all coverage.
- The specific natural language processing techniques used have their own biases and shortcomings that could impact the findings.
Additionally, the paper does not deeply explore the real-world societal implications of these framing dynamics or how the insights could be applied in practice to combat disinformation. Further research is needed to understand the full impact and develop effective mitigation strategies.
Conclusion
This research demonstrates the potential of computational methods to shed light on the complex landscape of multilingual disinformation. By analyzing how narratives and frames differ across language barriers, the study offers new ways to monitor and understand the tactics used in coordinated influence campaigns.
While preliminary, this work lays the groundwork for developing more robust tools to detect, track, and counter the spread of false or misleading information online. Continued advancements in this area could have significant implications for media literacy, democratic discourse, and societal resilience to manipulation.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Narratives at Conflict: Computational Analysis of News Framing in Multilingual Disinformation Campaigns
Antonina Sinelnik, Dirk Hovy
Any report frames issues to favor a particular interpretation by highlighting or excluding certain aspects of a story. Despite the widespread use of framing in disinformation, framing properties and detection methods remain underexplored outside the English-speaking world. We explore how multilingual framing of the same issue differs systematically. We use eight years of Russia-backed disinformation campaigns, spanning 8k news articles in 4 languages targeting 15 countries. We find that disinformation campaigns consistently and intentionally favor specific framing, depending on the target language of the audience. We further discover how Russian-language articles consistently highlight selected frames depending on the region of the media coverage. We find that the two most prominent models for automatic frame analysis underperform and show high disagreement, highlighting the need for further research.
Read more8/27/2024
0
A Study on Scaling Up Multilingual News Framing Analysis
Syeda Sabrina Akter, Antonios Anastasopoulos
Media framing is the study of strategically selecting and presenting specific aspects of political issues to shape public opinion. Despite its relevance to almost all societies around the world, research has been limited due to the lack of available datasets and other resources. This study explores the possibility of dataset creation through crowdsourcing, utilizing non-expert annotators to develop training corpora. We first extend framing analysis beyond English news to a multilingual context (12 typologically diverse languages) through automatic translation. We also present a novel benchmark in Bengali and Portuguese on the immigration and same-sex marriage domains. Additionally, we show that a system trained on our crowd-sourced dataset, combined with other existing ones, leads to a 5.32 percentage point increase from the baseline, showing that crowdsourcing is a viable option. Last, we study the performance of large language models (LLMs) for this task, finding that task-specific fine-tuning is a better approach than employing bigger non-specialized models.
Read more4/3/2024
0
Evaluating the Ability of Computationally Extracted Narrative Maps to Encode Media Framing
Sebasti'an Concha Mac'ias, Brian Keith Norambuena
Narratives serve as fundamental frameworks in our understanding of the world and play a crucial role in collaborative sensemaking, providing a versatile foundation for sensemaking. Framing is a subtle yet potent mechanism that influences public perception through specific word choices, shaping interpretations of reported news events. Despite the recognized importance of narratives and framing, a significant gap exists in the literature with regard to the explicit consideration of framing within the context of computational extraction and representation. This article explores the capabilities of a specific narrative extraction and representation approach -- narrative maps -- to capture framing information from news data. The research addresses two key questions: (1) Does the narrative extraction method capture the framing distribution of the data set? (2) Does it produce a representation with consistent framing? Our results indicate that while the algorithm captures framing distributions, achieving consistent framing across various starting and ending events poses challenges. Our results highlight the potential of narrative maps to provide users with insights into the intricate framing dynamics within news narratives. However, we note that directly leveraging framing information in the computational narrative extraction process remains an open challenge.
Read more5/7/2024
💬
0
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection
Valeria Pastorino, Jasivan A. Sivakumar, Nafise Sadat Moosavi
Previous studies on framing have relied on manual analysis or fine-tuning models with limited annotated datasets. However, pre-trained models, with their diverse training backgrounds, offer a promising alternative. This paper presents a comprehensive analysis of GPT-4, GPT-3.5 Turbo, and FLAN-T5 models in detecting framing in news headlines. We evaluated these models in various scenarios: zero-shot, few-shot with in-domain examples, cross-domain examples, and settings where models explain their predictions. Our results show that explainable predictions lead to more reliable outcomes. GPT-4 performed exceptionally well in few-shot settings but often misinterpreted emotional language as framing, highlighting a significant challenge. Additionally, the results suggest that consistent predictions across multiple models could help identify potential annotation inaccuracies in datasets. Finally, we propose a new small dataset for real-world evaluation on headlines from a diverse set of topics.
Read more6/18/2024