Bridging MDE and AI: A Systematic Review of Domain-Specific Languages and Model-Driven Practices in AI Software Systems Engineering

2307.04599

YC

0

Reddit

0

Published 5/7/2024 by Simon Raedler, Luca Berardinelli, Karolin Winter, Abbas Rahimi, Stefanie Rinderle-Ma
Bridging MDE and AI: A Systematic Review of Domain-Specific Languages and Model-Driven Practices in AI Software Systems Engineering

Abstract

Background:Technical systems are growing in complexity with more components and functions across various disciplines. Model-Driven Engineering (MDE) helps manage this complexity by using models as key artifacts. Domain-Specific Languages (DSL) supported by MDE facilitate modeling. As data generation in product development increases, there's a growing demand for AI algorithms, which can be challenging to implement. Integrating AI algorithms with DSL and MDE can streamline this process. Objective:This study aims to investigate the existing model-driven approaches relying on DSL in support of the engineering of AI software systems to sharpen future research further and define the current state of the art. Method:We conducted a Systemic Literature Review (SLR), collecting papers from five major databases resulting in 1335 candidate studies, eventually retaining 18 primary studies. Each primary study will be evaluated and discussed with respect to the adoption of MDE principles and practices and the phases of AI development support aligned with the stages of the CRISP-DM methodology. Results:The study's findings show that language workbenches are of paramount importance in dealing with all aspects of modeling language development and are leveraged to define DSL explicitly addressing AI concerns. The most prominent AI-related concerns are training and modeling of the AI algorithm, while minor emphasis is given to the time-consuming preparation of the data. Early project phases that support interdisciplinary communication of requirements, e.g., CRISP-DM Business Understanding phase, are rarely reflected. Conclusion:The study found that the use of MDE for AI is still in its early stages, and there is no single tool or method that is widely used. Additionally, current approaches tend to focus on specific stages of development rather than providing support for the entire development process.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a systematic literature review on the use of model-driven engineering (MDE) for artificial intelligence (AI) systems.
  • The authors explore how MDE techniques can be applied to the development and deployment of AI applications, addressing challenges such as complexity, scalability, and reusability.
  • The review covers a wide range of topics, including framework to model ML engineering processes, synergy between large language models and MDE, and multimodal conceptual frameworks for data-to-product AI systems.

Plain English Explanation

The paper looks at how a software engineering approach called model-driven engineering (MDE) can be used to build and deploy artificial intelligence (AI) systems. MDE is a way of designing and developing software by creating models, or high-level representations, of the system. The authors investigate how this approach can help address some of the challenges in building complex AI applications, such as making them more scalable, reusable, and easier to manage.

The review covers a range of topics related to applying MDE to AI. For example, it discusses a framework that can be used to model the process of developing machine learning (ML) systems, as well as how large language models can work together with MDE techniques. It also looks at a multimodal conceptual framework for building AI systems that can handle different types of data, like text and images.

The key idea is that by using MDE, researchers and developers can create more structured and organized AI systems, which can make them more reliable, scalable, and easier to maintain over time.

Technical Explanation

The paper conducts a systematic literature review to examine how model-driven engineering (MDE) techniques can be applied to the development and deployment of artificial intelligence (AI) systems. MDE is a software engineering approach that focuses on creating high-level models of a system, which can then be transformed into working code and other artifacts.

The authors review a wide range of publications that explore the intersection of MDE and AI, covering topics such as a framework for modeling the machine learning engineering process, the synergy between large language models and MDE, and a multimodal conceptual framework for data-to-product AI systems. They also discuss research on automating the synthesis of domain-specific large language models and a benchmark for evaluating large language models in multimodal tasks.

The key insights from the review include the potential of MDE to address challenges such as complexity, scalability, and reusability in the development of AI systems. By using models to represent the structure and behavior of AI applications, the authors suggest that developers can create more organized and maintainable systems.

Critical Analysis

The paper provides a comprehensive overview of the current research on applying model-driven engineering (MDE) techniques to artificial intelligence (AI) systems. However, the authors acknowledge that the field is still relatively young, and there are several limitations and areas for further research.

One potential limitation is the scope of the reviewed literature, which may not capture all the relevant work in this rapidly evolving field. Additionally, the authors note that many of the proposed approaches and frameworks are still in the conceptual or early development stages, and their practical impact and effectiveness in real-world AI projects remain to be fully evaluated.

Furthermore, the paper does not delve deeply into the specific challenges and trade-offs involved in integrating MDE with AI, such as the potential tension between the structured, model-driven approach and the inherent complexity and uncertainty of many AI systems. Further research may be needed to explore these issues in more detail.

Overall, the paper provides a valuable synthesis of the current state of research in this area and highlights the promising potential of MDE for improving the development and deployment of AI applications. However, it also underscores the need for continued investigation and experimentation to fully realize the benefits and address the challenges of this emerging approach.

Conclusion

This systematic literature review examines the application of model-driven engineering (MDE) techniques to the development and deployment of artificial intelligence (AI) systems. The authors identify a range of research addressing the integration of MDE and AI, covering topics such as frameworks for modeling machine learning engineering processes, the synergy between large language models and MDE, and multimodal conceptual frameworks for data-to-product AI systems.

The key takeaway is that MDE has the potential to address various challenges in AI development, such as complexity, scalability, and reusability, by providing a more structured and organized approach to building these systems. However, the field is still emerging, and further research is needed to fully understand the practical implications and effectiveness of integrating MDE and AI in real-world applications.

Overall, this review highlights the growing interest and potential of using model-driven engineering techniques to advance the development and deployment of increasingly sophisticated artificial intelligence systems.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

A Framework to Model ML Engineering Processes

A Framework to Model ML Engineering Processes

Sergio Morales, Robert Claris'o, Jordi Cabot

YC

0

Reddit

0

The development of Machine Learning (ML) based systems is complex and requires multidisciplinary teams with diverse skill sets. This may lead to communication issues or misapplication of best practices. Process models can alleviate these challenges by standardizing task orchestration, providing a common language to facilitate communication, and nurturing a collaborative environment. Unfortunately, current process modeling languages are not suitable for describing the development of such systems. In this paper, we introduce a framework for modeling ML-based software development processes, built around a domain-specific language and derived from an analysis of scientific and gray literature. A supporting toolkit is also available.

Read more

4/30/2024

Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems

Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems

Nenad Petrovic, Fengjunjie Pan, Krzysztof Lebioda, Vahid Zolfaghari, Sven Kirchner, Nils Purschke, Muhammad Aqib Khan, Viktor Vorobev, Alois Knoll

YC

0

Reddit

0

We present a prototype of a tool leveraging the synergy of model driven engineering (MDE) and Large Language Models (LLM) for the purpose of software development process automation in the automotive industry. In this approach, the user-provided input is free form textual requirements, which are first translated to Ecore model instance representation using an LLM, which is afterwards checked for consistency using Object Constraint Language (OCL) rules. After successful consistency check, the model instance is fed as input to another LLM for the purpose of code generation. The generated code is evaluated in a simulated environment using CARLA simulator connected to an example centralized vehicle architecture, in an emergency brake scenario.

Read more

4/9/2024

šŸ“Š

DSDL: Data Set Description Language for Bridging Modalities and Tasks in AI Data

Bin Wang, Linke Ouyang, Fan Wu, Wenchang Ning, Xiao Han, Zhiyuan Zhao, Jiahui Peng, Yiying Jiang, Dahua Lin, Conghui He

YC

0

Reddit

0

In the era of artificial intelligence, the diversity of data modalities and annotation formats often renders data unusable directly, requiring understanding and format conversion before it can be used by researchers or developers with different needs. To tackle this problem, this article introduces a framework called Dataset Description Language (DSDL) that aims to simplify dataset processing by providing a unified standard for AI datasets. DSDL adheres to the three basic practical principles of generic, portable, and extensible, using a unified standard to express data of different modalities and structures, facilitating the dissemination of AI data, and easily extending to new modalities and tasks. The standardized specifications of DSDL reduce the workload for users in data dissemination, processing, and usage. To further improve user convenience, we provide predefined DSDL templates for various tasks, convert mainstream datasets to comply with DSDL specifications, and provide comprehensive documentation and DSDL tools. These efforts aim to simplify the use of AI data, thereby improving the efficiency of AI development.

Read more

5/29/2024

šŸ—£ļø

A Systematic Literature Review on the Use of Machine Learning in Software Engineering

Nyaga Fred, I. O. Temkin

YC

0

Reddit

0

Software engineering (SE) is a dynamic field that involves multiple phases all of which are necessary to develop sustainable software systems. Machine learning (ML), a branch of artificial intelligence (AI), has drawn a lot of attention in recent years thanks to its ability to analyze massive volumes of data and extract useful patterns from data. Several studies have focused on examining, categorising, and assessing the application of ML in SE processes. We conducted a literature review on primary studies to address this gap. The study was carried out following the objective and the research questions to explore the current state of the art in applying machine learning techniques in software engineering processes. The review identifies the key areas within software engineering where ML has been applied, including software quality assurance, software maintenance, software comprehension, and software documentation. It also highlights the specific ML techniques that have been leveraged in these domains, such as supervised learning, unsupervised learning, and deep learning. Keywords: machine learning, deep learning, software engineering, natural language processing, source code

Read more

6/21/2024