Nested Event Extraction upon Pivot Element Recogniton

Read original: arXiv:2309.12960 - Published 4/9/2024 by Weicheng Ren, Zixuan Li, Xiaolong Jin, Long Bai, Miao Su, Yantao Liu, Saiping Guan, Jiafeng Guo, Xueqi Cheng
Total Score

0

⛏️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Nested Event Extraction (NEE) aims to extract complex event structures where one event contains other events as its arguments in a recursive manner.
  • Nested events involve a special type of element called Pivot Elements (PEs) that serve as arguments for outer events and triggers for inner events, connecting the nested structure.
  • Existing NEE methods struggle to handle the dual identities of PEs, so this paper proposes a new model called PerNee that focuses on recognizing PEs to extract nested events.

Plain English Explanation

Imagine you're reading an article about a complex news story. In this story, there might be a main event, like a political rally, that contains smaller events within it, such as a speech by a politician or a protest by activists. These nested events are all part of the overall story.

The goal of Nested Event Extraction is to automatically identify and extract these complex, multi-layered event structures from text. The key challenge is that some elements, like the politician's speech, can play dual roles - they are part of the larger rally event, but also trigger their own, inner events.

The new PerNee model proposed in this paper focuses on recognizing these special "pivot elements" that connect the nested events. By better understanding how these pivot elements function, the model can more effectively extract the full hierarchy of events from the text.

Technical Explanation

The PerNee model has two main steps:

  1. Recognizing the triggers (keywords) for both the outer-nest and inner-nest events.
  2. Classifying the relationship between pairs of triggers to identify the pivot elements that link the nested events.

PerNee uses a prompt learning approach to incorporate information about both event types and argument roles. This helps the model build better representations of the triggers and arguments, leading to improved performance on nested event extraction.

The paper also introduces a new dataset called ACE2005-Nest, which contains a wider range of nested event types compared to previous benchmarks. This allows for more comprehensive evaluation of NEE systems.

Experiments show that PerNee outperforms previous state-of-the-art methods on multiple nested event extraction datasets, including ACE2005-Nest, Genia11, and Genia13.

Critical Analysis

A key limitation mentioned in the paper is the reliance on existing NEE datasets, which are narrow in scope and focused on specific domains. The new ACE2005-Nest dataset helps address this, but there is still room for further expansion and diversification of benchmark data.

Additionally, the paper does not deeply explore potential biases or failure cases of the PerNee model. More analysis of the model's strengths, weaknesses, and edge cases would provide a more well-rounded understanding of its capabilities and limitations.

While the prompt learning approach shows promising results, further research is needed to understand how the choice of prompts and learning objectives impact the model's performance on nested event extraction. Exploring alternative architectures or training regimes could also lead to further improvements.

Conclusion

This paper presents a novel Nested Event Extraction model called PerNee that focuses on recognizing the pivot elements that connect nested events. By better handling these dual-identity elements, PerNee achieves state-of-the-art performance on multiple benchmarks.

The introduction of the more diverse ACE2005-Nest dataset is also a valuable contribution, as it provides a richer testbed for evaluating NEE systems. Overall, this research represents an important step forward in the field of complex event extraction, with potential applications in areas like news analysis, intelligence gathering, and scientific literature processing.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

⛏️

Total Score

0

Nested Event Extraction upon Pivot Element Recogniton

Weicheng Ren, Zixuan Li, Xiaolong Jin, Long Bai, Miao Su, Yantao Liu, Saiping Guan, Jiafeng Guo, Xueqi Cheng

Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively. Nested events involve a kind of Pivot Elements (PEs) that simultaneously act as arguments of outer-nest events and as triggers of inner-nest events, and thus connect them into nested structures. This special characteristic of PEs brings challenges to existing NEE methods, as they cannot well cope with the dual identities of PEs. Therefore, this paper proposes a new model, called PerNee, which extracts nested events mainly based on recognizing PEs. Specifically, PerNee first recognizes the triggers of both inner-nest and outer-nest events and further recognizes the PEs via classifying the relation type between trigger pairs. The model uses prompt learning to incorporate information from both event types and argument roles for better trigger and argument representations to improve NEE performance. Since existing NEE datasets (e.g., Genia11) are limited to specific domains and contain a narrow range of event types with nested structures, we systematically categorize nested events in the generic domain and construct a new NEE dataset, called ACE2005-Nest. Experimental results demonstrate that PerNee consistently achieves state-of-the-art performance on ACE2005-Nest, Genia11, and Genia13. The ACE2005-Nest dataset and the code of the PerNee model are available at https://github.com/waysonren/PerNee.

Read more

4/9/2024

⛏️

Total Score

0

Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction

Wanlong Liu, Li Zhou, Dingyi Zeng, Yichen Xiao, Shaohuan Cheng, Chen Zhang, Grandee Lee, Malu Zhang, Wenyu Chen

Recent mainstream event argument extraction methods process each event in isolation, resulting in inefficient inference and ignoring the correlations among multiple events. To address these limitations, here we propose a multiple-event argument extraction model DEEIA (Dependency-guided Encoding and Event-specific Information Aggregation), capable of extracting arguments from all events within a document simultaneouslyThe proposed DEEIA model employs a multi-event prompt mechanism, comprising DE and EIA modules. The DE module is designed to improve the correlation between prompts and their corresponding event contexts, whereas the EIA module provides event-specific information to improve contextual understanding. Extensive experiments show that our method achieves new state-of-the-art performance on four public datasets (RAMS, WikiEvents, MLEE, and ACE05), while significantly saving the inference time compared to the baselines. Further analyses demonstrate the effectiveness of the proposed modules.

Read more

6/18/2024

Harvesting Events from Multiple Sources: Towards a Cross-Document Event Extraction Paradigm
Total Score

0

Harvesting Events from Multiple Sources: Towards a Cross-Document Event Extraction Paradigm

Qiang Gao, Zixiang Meng, Bobo Li, Jun Zhou, Fei Li, Chong Teng, Donghong Ji

Document-level event extraction aims to extract structured event information from unstructured text. However, a single document often contains limited event information and the roles of different event arguments may be biased due to the influence of the information source. This paper addresses the limitations of traditional document-level event extraction by proposing the task of cross-document event extraction (CDEE) to integrate event information from multiple documents and provide a comprehensive perspective on events. We construct a novel cross-document event extraction dataset, namely CLES, which contains 20,059 documents and 37,688 mention-level events, where over 70% of them are cross-document. To build a benchmark, we propose a CDEE pipeline that includes 5 steps, namely event extraction, coreference resolution, entity normalization, role normalization and entity-role resolution. Our CDEE pipeline achieves about 72% F1 in end-to-end cross-document event extraction, suggesting the challenge of this task. Our work builds a new line of information extraction research and will attract new research attention.

Read more

6/26/2024

CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News
Total Score

0

CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News

Mengna Zhu, Zijie Xu, Kaisheng Zeng, Kaiming Xiao, Mao Wang, Wenjun Ke, Hongbin Huang

Extracting structured event knowledge, including event triggers and corresponding arguments, from military texts is fundamental to many applications, such as intelligence analysis and decision assistance. However, event extraction in the military field faces the data scarcity problem, which impedes the research of event extraction models in this domain. To alleviate this problem, we propose CMNEE, a large-scale, document-level open-source Chinese Military News Event Extraction dataset. It contains 17,000 documents and 29,223 events, which are all manually annotated based on a pre-defined schema for the military domain including 8 event types and 11 argument role types. We designed a two-stage, multi-turns annotation strategy to ensure the quality of CMNEE and reproduced several state-of-the-art event extraction models with a systematic evaluation. The experimental results on CMNEE fall shorter than those on other domain datasets obviously, which demonstrates that event extraction for military domain poses unique challenges and requires further research efforts. Our code and data can be obtained from https://github.com/Mzzzhu/CMNEE.

Read more

4/19/2024