Towards Systematic Monolingual NLP Surveys: GenA of Greek NLP

Read original: arXiv:2407.09861 - Published 7/16/2024 by Juli Bakagianni, Kanella Pouli, Maria Gavriilidou, John Pavlopoulos

👨‍🏫

Overview

This paper introduces a systematic method for conducting monolingual surveys of Natural Language Processing (NLP) research, focusing on the underrepresented Greek language.
Monolingual NLP surveys are rare, but can provide valuable insights for addressing the linguistic diversity of global communication.
The proposed method involves a structured search protocol to select and organize publications, classify language resources (LRs) by availability and datasets by annotation, and assess language support per NLP task.
The authors apply this method to a systematic literature review of Greek NLP research from 2012 to 2022, highlighting the progress and challenges in this area.

Plain English Explanation

Most NLP research has historically focused on the English language, due to the availability of resources, the size of the research community, and market demands. However, there is a growing recognition of the need for inclusivity and effectiveness across diverse languages and cultures.

This paper introduces a new method for conducting in-depth surveys of NLP research for individual languages, using Greek as a case study. The authors argue that these "monolingual" surveys can complement the broader trend towards multilingual NLP by providing a comprehensive understanding of the progress and challenges for specific languages.

The proposed method involves a structured search process to identify relevant publications, organize them into a taxonomy of NLP tasks, and classify the available language resources and datasets. This systematic approach helps avoid common issues like data leakage and contamination, and provides a clear assessment of the support for each NLP task in the target language.

By applying this method to Greek NLP research from 2012 to 2022, the authors have created a detailed overview of the current state and challenges in this field. They discuss the progress made, highlight the available Greek language resources, and outline areas where more linguistic diversity is needed.

The authors believe that similar monolingual NLP surveys could be conducted for many other languages, helping to address the imbalance in NLP research and support for underrepresented languages around the world.

Technical Explanation

The paper presents a structured method for conducting systematic and comprehensive monolingual surveys of NLP research. The key elements of this method include:

Structured Search Protocol: The authors use a well-defined search protocol to identify relevant publications in the target language, ensuring a comprehensive and consistent approach.
Taxonomy of NLP Tasks: The publications are organized into a taxonomy of NLP tasks, providing a clear framework for understanding the progress and challenges in different areas of NLP.
Language Resource Classification: The available language resources (LRs) are classified according to their level of availability and usability, highlighting publicly-accessible and machine-actionable resources.
Dataset Classification: Datasets are classified based on their annotation, further emphasizing the availability and quality of the data used in the research.
Comprehensive Review: By applying this method, the authors conduct a detailed literature review of Greek NLP research from 2012 to 2022, covering the current state, progress, and challenges in this field.

The authors demonstrate the benefits of this systematic approach, including the ability to avoid common issues like data leakage and contamination, and to provide a clear assessment of language support per NLP task. They argue that similar monolingual NLP surveys could be valuable for many other underrepresented languages, complementing the broader trend towards multilingual NLP and helping to address the linguistic diversity of global communication.

Critical Analysis

The authors have presented a well-structured and thorough method for conducting monolingual NLP surveys, which could be a valuable addition to the field. However, there are a few potential limitations and areas for further research:

Scalability: While the method appears comprehensive, it may be resource-intensive to apply to a large number of languages. The authors acknowledge this challenge and suggest that it could be addressed through automation and collaboration.
Generalizability: The effectiveness of the method has only been demonstrated for the Greek language. Further testing and refinement may be necessary to ensure its applicability to a wider range of languages, especially those with significantly different linguistic characteristics.
Evaluation Metrics: The authors focus on the availability and usability of language resources and datasets, but do not provide a clear set of metrics for evaluating the overall progress and quality of NLP research in the target language. Developing a more robust evaluation framework could enhance the usefulness of these monolingual surveys.
Interdisciplinary Collaboration: Engaging with linguists, language experts, and local communities could help to enrich the understanding of language-specific challenges and inform the development of more effective NLP solutions.

Despite these potential limitations, the authors' systematic approach to monolingual NLP surveys is a valuable contribution to the field. Continuing to explore and refine this method could lead to important insights for addressing the linguistic diversity of global communication.

Conclusion

This paper introduces a structured method for conducting comprehensive monolingual surveys of NLP research, addressing the historical bias towards English-centric NLP. By applying this method to Greek NLP, the authors have created a detailed overview of the current state and challenges in this field, highlighting the available language resources and datasets.

The authors argue that similar monolingual surveys could be valuable for many other underrepresented languages, complementing the broader trend towards multilingual NLP and helping to address the linguistic diversity of global communication. While the method may face some scalability and generalization challenges, it represents an important step towards a more inclusive and effective NLP landscape.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

👨‍🏫

Towards Systematic Monolingual NLP Surveys: GenA of Greek NLP

Juli Bakagianni, Kanella Pouli, Maria Gavriilidou, John Pavlopoulos

Natural Language Processing (NLP) research has traditionally been predominantly focused on English, driven by the availability of resources, the size of the research community, and market demands. Recently, there has been a noticeable shift towards multilingualism in NLP, recognizing the need for inclusivity and effectiveness across diverse languages and cultures. Monolingual surveys have the potential to complement the broader trend towards multilingualism in NLP by providing foundational insights and resources necessary for effectively addressing the linguistic diversity of global communication. However, monolingual NLP surveys are extremely rare in literature. This study fills the gap by introducing a method for creating systematic and comprehensive monolingual NLP surveys. Characterized by a structured search protocol, it can be used to select publications and organize them through a taxonomy of NLP tasks. We include a classification of Language Resources (LRs), according to their availability, and datasets, according to their annotation, to highlight publicly-available and machine-actionable LRs. By applying our method, we conducted a systematic literature review of Greek NLP from 2012 to 2022, providing a comprehensive overview of the current state and challenges of Greek NLP research. We discuss the progress of Greek NLP and outline encountered Greek LRs, classified by availability and usability. As we show, our proposed method helps avoid common pitfalls, such as data leakage and contamination, and to assess language support per NLP task. We consider this systematic literature review of Greek NLP an application of our method that showcases the benefits of a monolingual NLP survey. Similar applications could be regard the myriads of languages whose progress in NLP lags behind that of well-supported languages.

7/16/2024

NLP for The Greek Language: A Longer Survey

Katerina Papantoniou, Yannis Tzitzikas

English language is in the spotlight of the Natural Language Processing (NLP) community with other languages, like Greek, lagging behind in terms of offered methods, tools and resources. Due to the increasing interest in NLP, in this paper we try to condense research efforts for the automatic processing of Greek language covering the last three decades. In particular, we list and briefly discuss related works, resources and tools, categorized according to various processing layers and contexts. We are not restricted to the modern form of Greek language but also cover Ancient Greek and various Greek dialects. This survey can be useful for researchers and students interested in NLP tasks, Information Retrieval and Knowledge Management for the Greek language.

8/21/2024

🌿

Natural Language Processing for Dialects of a Language: A Survey

Aditya Joshi, Raj Dabre, Diptesh Kanojia, Zhuang Li, Haolan Zhan, Gholamreza Haffari, Doris Dippold

State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets. This survey delves into an important attribute of these datasets: the dialect of a language. Motivated by the performance degradation of NLP models for dialectic datasets and its implications for the equity of language technologies, we survey past research in NLP for dialects in terms of datasets, and approaches. We describe a wide range of NLP tasks in terms of two categories: natural language understanding (NLU) (for tasks such as dialect classification, sentiment analysis, parsing, and NLU benchmarks) and natural language generation (NLG) (for summarisation, machine translation, and dialogue systems). The survey is also broad in its coverage of languages which include English, Arabic, German among others. We observe that past work in NLP concerning dialects goes deeper than mere dialect classification, and . This includes early approaches that used sentence transduction that lead to the recent approaches that integrate hypernetworks into LoRA. We expect that this survey will be useful to NLP researchers interested in building equitable language technologies by rethinking LLM benchmarks and model architectures.

4/1/2024

A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers

Kaiyu Huang, Fengran Mo, Hongliang Li, You Li, Yuanchi Zhang, Weijian Yi, Yulong Mao, Jinchen Liu, Yuzhuang Xu, Jinan Xu, Jian-Yun Nie, Yang Liu

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs.

5/20/2024