Mapping News Narratives Using LLMs and Narrative-Structured Text Embeddings
0
Sign in to get full access
Overview
- Researchers explore using large language models (LLMs) and narrative-structured text embeddings to map news narratives.
- Approach involves training LLMs on news articles and using the embeddings to visualize narrative structures and connections.
- Aims to provide a tool for better understanding how news stories and themes evolve over time and across outlets.
Plain English Explanation
The paper describes a method for [object Object] using large language models (LLMs) and [object Object].
The key idea is to train an LLM on a large corpus of news articles. This allows the model to learn the common patterns and structures used in news writing. The researchers then use this trained model to generate [object Object] that capture the narrative structure of individual news stories.
By visualizing the relationships between these narrative-structured embeddings, the researchers can [object Object] over time and across different news outlets. This could provide valuable insights into how stories are framed, how themes spread, and how public discourse shifts.
The goal is to develop a tool that can help researchers, journalists, and the public better understand the dynamics of news coverage and [object Object].
Technical Explanation
The researchers first trained an LLM on a large corpus of news articles from various sources. They then used this trained model to generate [object Object] for individual news stories.
These embeddings capture not just the semantic content of the text, but also its underlying narrative structure - things like the sequence of events, the key characters and their roles, the thematic arcs, and so on. The researchers hypothesized that visualizing the relationships between these narrative-structured embeddings could reveal important insights about how news narratives evolve over time and across different outlets.
To test this, they developed a visualization tool that allows users to explore the [object Object] of news coverage. This includes features like:
- Plotting news stories as points in a 2D space, with the distances between them reflecting the similarity of their narrative structures
- Tracing how individual stories or themes move through this narrative landscape over time
- Identifying clusters of related stories that share common narrative patterns
- Highlighting key pivot points where narratives shift or diverge
Through experiments with real-world news data, the researchers demonstrated the potential of this approach to provide [object Object] about the dynamics of news coverage and public discourse.
Critical Analysis
The researchers acknowledge several limitations and areas for further research:
- The quality and representativeness of the training data is crucial - biases in the news corpus could lead to biases in the narrative mappings.
- The narrative-structured embeddings rely on the ability of the LLM to accurately capture the underlying narrative structure of news stories. More work is needed to validate and refine this approach.
- The visualization tools are still fairly basic - more advanced interactive features and analytical capabilities could enhance the usefulness of the system.
- The researchers focused on English-language news, but the approach could potentially be extended to other languages and media formats.
Additionally, some potential concerns to consider:
- Privacy and ethical implications of using LLMs to analyze news narratives, particularly around the profiling of individuals or groups.
- The risk of the system being used to manipulate public opinion or reinforce existing biases, rather than providing objective insights.
- The challenge of ensuring the transparency and interpretability of the narrative mapping process, so that users can understand and critically evaluate the insights generated.
Overall, the research presents an innovative approach to [object Object], but further work is needed to address these important considerations.
Conclusion
This paper explores the use of large language models and narrative-structured text embeddings to [object Object] over time and across different media sources. The researchers demonstrate the potential of this approach to provide valuable insights into how stories are framed, how themes spread, and how public discourse shifts.
While the research has limitations and raises important ethical concerns, it represents an exciting step towards developing tools that can help us better [object Object]. By visualizing the narrative landscape of news coverage, researchers, journalists, and the public can gain new perspectives on the dynamics of information and influence in our society.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Mapping News Narratives Using LLMs and Narrative-Structured Text Embeddings
Jan Elfes
Given the profound impact of narratives across various societal levels, from personal identities to international politics, it is crucial to understand their distribution and development over time. This is particularly important in online spaces. On the Web, narratives can spread rapidly and intensify societal divides and conflicts. While many qualitative approaches exist, quantifying narratives remains a significant challenge. Computational narrative analysis lacks frameworks that are both comprehensive and generalizable. To address this gap, we introduce a numerical narrative representation grounded in structuralist linguistic theory. Chiefly, Greimas' Actantial Model represents a narrative through a constellation of six functional character roles. These so-called actants are genre-agnostic, making the model highly generalizable. We extract the actants using an open-source LLM and integrate them into a Narrative-Structured Text Embedding that captures both the semantics and narrative structure of a text. We demonstrate the analytical insights of the method on the example of 5000 full-text news articles from Al Jazeera and The Washington Post on the Israel-Palestine conflict. Our method successfully distinguishes articles that cover the same topics but differ in narrative structure.
Read more9/11/2024
0
Can Nuanced Language Lead to More Actionable Insights? Exploring the Role of Generative AI in Analytical Narrative Structure
Vidya Setlur, Larry Birnbaum
Relevant language describing trends in data can be useful for generating summaries to help with readers' takeaways. However, the language employed in these often template-generated summaries tends to be simple, ranging from describing simple statistical information (e.g., extrema and trends) without additional context and richer language to provide actionable insights. Recent advances in Large Language Models (LLMs) have shown promising capabilities in capturing subtle nuances in language when describing information. This workshop paper specifically explores how LLMs can provide more actionable insights when describing trends by focusing on three dimensions of analytical narrative structure: semantic, rhetorical, and pragmatic. Building on prior research that examines visual and linguistic signatures for univariate line charts, we examine how LLMs can further leverage the semantic dimension of analytical narratives using quantified semantics to describe shapes in trends as people intuitively view them. These semantic descriptions help convey insights in a way that leads to a pragmatic outcome, i.e., a call to action, persuasion, warning vs. alert, and situational awareness. Finally, we identify rhetorical implications for how well these generated narratives align with the perceived shape of the data, thereby empowering users to make informed decisions and take meaningful actions based on these data insights.
Read more5/7/2024
0
Are Large Language Models Capable of Generating Human-Level Narratives?
Yufei Tian, Tenghao Huang, Miri Liu, Derek Jiang, Alexander Spangher, Muhao Chen, Jonathan May, Nanyun Peng
This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects: i) story arcs, ii) turning points, and iii) affective dimensions, including arousal and valence. By leveraging expert and automatic annotations, we uncover significant discrepancies between the LLM- and human- written stories. While human-written stories are suspenseful, arousing, and diverse in narrative structures, LLM stories are homogeneously positive and lack tension. Next, we measure narrative reasoning skills as a precursor to generative capacities, concluding that most LLMs fall short of human abilities in discourse understanding. Finally, we show that explicit integration of aforementioned discourse features can enhance storytelling, as is demonstrated by over 40% improvement in neural storytelling in terms of diversity, suspense, and arousal.
Read more7/19/2024
š¤
0
New!Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AI
Riona Matsuoka, Hiroki Matsumoto, Takahiro Yoshida, Tomohiro Watanabe, Ryoma Kondo, Ryohei Hisano
Written texts reflect an author's perspective, making the thorough analysis of literature a key research method in fields such as the humanities and social sciences. However, conventional text mining techniques like sentiment analysis and topic modeling are limited in their ability to capture the hierarchical narrative structures that reveal deeper argumentative patterns. To address this gap, we propose a method that leverages large language models (LLMs) to extract and organize these structures into a hierarchical framework. We validate this approach by analyzing public opinions on generative AI collected by Japan's Agency for Cultural Affairs, comparing the narratives of supporters and critics. Our analysis provides clearer visualization of the factors influencing divergent opinions on generative AI, offering deeper insights into the structures of agreement and disagreement.
Read more9/18/2024