AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling

Read original: arXiv:2407.04079 - Published 7/8/2024 by Mariia Fedorova, Timothee Mickus, Niko Partanen, Janine Siewert, Elena Spaziani, Andrey Kutuzov
Total Score

0

AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper describes the AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling.
  • The shared task aims to advance the field of semantic change modeling by encouraging the development of models that can explain their predictions.
  • Participants are tasked with building models that can detect and explain semantic changes in words across multiple languages.

Plain English Explanation

The AXOLOTL'24 Shared Task focuses on the challenge of modeling semantic change - how the meanings of words evolve over time. Participants in this shared task are asked to develop models that can not only detect when a word's meaning has changed, but also explain why those changes occurred.

This is an important problem because being able to understand and explain how language evolves can provide insights into cultural, historical, and social changes. The shared task aims to drive progress in this area by encouraging researchers to create more interpretable and transparent models that can elucidate the reasons behind semantic shifts.

Technical Explanation

The AXOLOTL'24 Shared Task focuses on the challenge of modeling semantic change - how the meanings of words evolve over time. Participants are tasked with building models that can detect when a word's meaning has changed and explain the reasons behind those changes.

The shared task encompasses multiple languages, requiring participants to develop multilingual models that can handle semantic changes across different linguistic and cultural contexts. The models must not only identify when a word's meaning has shifted, but also provide explanations for the observed changes.

This is a significant challenge, as explaining semantic changes requires understanding the complex interplay of factors such as cultural, historical, and social influences. By encouraging the development of more interpretable and transparent models, the AXOLOTL'24 Shared Task aims to advance the field of semantic change modeling and provide valuable insights into the evolution of language.

Critical Analysis

The AXOLOTL'24 Shared Task represents an important step forward in the field of semantic change modeling, as it pushes researchers to go beyond simply detecting changes and instead focus on explaining the reasons behind those changes. This shift towards more interpretable and transparent models is a promising direction, as it can provide valuable insights into the complex social and cultural factors that influence language evolution.

However, the task also faces several challenges. Developing multilingual models that can accurately detect and explain semantic changes across diverse linguistic and cultural contexts is a significant technical hurdle. Additionally, the task of explaining semantic changes may require advances in areas such as structured reasoning and [causal inference**, which are active areas of research.

Furthermore, the shared task may face challenges in terms of data availability and quality, as tracing the evolution of word meanings over time requires longitudinal corpus data that may not be readily available or well-curated for all languages.

Conclusion

The AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling represents a significant advancement in the field of language modeling and understanding. By focusing on the development of interpretable and transparent models that can explain the reasons behind semantic changes, the shared task has the potential to provide valuable insights into the complex social, cultural, and historical factors that shape the evolution of language.

While the task faces technical and data-related challenges, its emphasis on explainability and multilingualism is a crucial step towards building more versatile and insightful language models that can better serve the needs of diverse communities and applications.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling
Total Score

0

AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling

Mariia Fedorova, Timothee Mickus, Niko Partanen, Janine Siewert, Elena Spaziani, Andrey Kutuzov

This paper describes the organization and findings of AXOLOTL'24, the first multilingual explainable semantic change modeling shared task. We present new sense-annotated diachronic semantic change datasets for Finnish and Russian which were employed in the shared task, along with a surprise test-only German dataset borrowed from an existing source. The setup of AXOLOTL'24 is new to the semantic change modeling field, and involves subtasks of identifying unknown (novel) senses and providing dictionary-like definitions to these senses. The methods of the winning teams are described and compared, thus paving a path towards explainability in computational approaches to historical change of meaning.

Read more

7/8/2024

Deep-change at AXOLOTL-24: Orchestrating WSD and WSI Models for Semantic Change Modeling
Total Score

0

Deep-change at AXOLOTL-24: Orchestrating WSD and WSI Models for Semantic Change Modeling

Denis Kokosinskii, Mikhail Kuklin, Nikolay Arefyev

This paper describes our solution of the first subtask from the AXOLOTL-24 shared task on Semantic Change Modeling. The goal of this subtask is to distribute a given set of usages of a polysemous word from a newer time period between senses of this word from an older time period and clusters representing gained senses of this word. We propose and experiment with three new methods solving this task. Our methods achieve SOTA results according to both official metrics of the first substask. Additionally, we develop a model that can tell if a given word usage is not described by any of the provided sense definitions. This model serves as a component in one of our methods, but can potentially be useful on its own.

Read more

8/12/2024

🔎

Total Score

0

TartuNLP @ AXOLOTL-24: Leveraging Classifier Output for New Sense Detection in Lexical Semantics

Aleksei Dorkin, Kairit Sirts

We present our submission to the AXOLOTL-24 shared task. The shared task comprises two subtasks: identifying new senses that words gain with time (when comparing newer and older time periods) and producing the definitions for the identified new senses. We implemented a conceptually simple and computationally inexpensive solution to both subtasks. We trained adapter-based binary classification models to match glosses with usage examples and leveraged the probability output of the models to identify novel senses. The same models were used to match examples of novel sense usages with Wiktionary definitions. Our submission attained third place on the first subtask and the first place on the second subtask.

Read more

7/8/2024

Presence or Absence: Are Unknown Word Usages in Dictionaries?
Total Score

0

Presence or Absence: Are Unknown Word Usages in Dictionaries?

Xianghe Ma, Dominik Schlechtweg, Wei Zhao

There has been a surge of interest in computational modeling of semantic change. The foci of previous works are on detecting and interpreting word senses gained over time; however, it remains unclear whether the gained senses are covered by dictionaries. In this work, we aim to fill this research gap by comparing detected word senses with dictionary sense inventories in order to bridge between the communities of lexical semantic change detection and lexicography. We evaluate our system in the AXOLOTL-24 shared task for Finnish, Russian and German languages cite{fedorova-etal-2024-axolotl}. Our system is fully unsupervised. It leverages a graph-based clustering approach to predict mappings between unknown word usages and dictionary entries for Subtask 1, and generates dictionary-like definitions for those novel word usages through the state-of-the-art Large Language Models such as GPT-4 and LLaMA-3 for Subtask 2. In Subtask 1, our system outperforms the baseline system by a large margin, and it offers interpretability for the mapping results by distinguishing between matched and unmatched (novel) word usages through our graph-based clustering approach. Our system ranks first in Finnish and German, and ranks second in Russian on the Subtask 2 test-phase leaderboard. These results show the potential of our system in managing dictionary entries, particularly for updating dictionaries to include novel sense entries. Our code and data are made publicly availablefootnote{url{https://github.com/xiaohemaikoo/axolotl24-ABDN-NLP}}.

Read more

7/8/2024