Generative AI for Requirements Engineering: A Systematic Literature Review

Read original: arXiv:2409.06741 - Published 9/12/2024 by Haowei Cheng, Jati H. Husen, Sien Reeve Peralta, Bowen Jiang, Nobukazu Yoshioka, Naoyasu Ubayashi, Hironori Washizaki
Total Score

0

Generative AI for Requirements Engineering: A Systematic Literature Review

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Provides a systematic literature review of the use of generative AI for requirements engineering
  • Examines the current state of research in this area and identifies key trends, techniques, and applications
  • Offers insights into the maturity and potential of generative AI for requirements engineering tasks

Plain English Explanation

This research paper takes a close look at how generative AI is being used in the field of requirements engineering. Requirements engineering is the process of defining the needs and constraints for a software or system development project.

The paper systematically reviews the existing research in this area to understand the current state of the technology and its applications. It identifies the key techniques that researchers are using, such as language models and generative adversarial networks, as well as the main use cases they are exploring, like generating user stories and requirements documents.

The review provides insights into the maturity and potential of generative AI for requirements engineering tasks. It highlights both the promising capabilities as well as the limitations and challenges that researchers are grappling with in this emerging field.

Technical Explanation

The paper conducts a systematic literature review to analyze the current state of research on using generative AI techniques for requirements engineering tasks.

The authors followed a rigorous methodology to identify and analyze relevant papers published between 2010-2022. This included searching multiple scholarly databases, applying inclusion/exclusion criteria, and performing a quality assessment of the selected studies.

The review examines the key techniques used in this domain, such as language models, generative adversarial networks, and reinforcement learning. It also catalogues the main application areas explored, including generating user stories, requirements documents, and software design artifacts.

The analysis provides insights into the maturity of this research area, noting both the promising advancements as well as the significant technical and practical challenges that remain to be addressed.

Critical Analysis

The paper provides a comprehensive and rigorous review of the current state of research on using generative AI for requirements engineering. However, it also acknowledges several key limitations and areas for further investigation:

  • The field is still relatively young, with most of the reviewed studies being proof-of-concept or preliminary in nature. More extensive real-world evaluations and longitudinal studies are needed to assess the practical viability and benefits of these techniques.

  • There are open questions around the reliability, accuracy, and trustworthiness of generative AI models when it comes to mission-critical requirements engineering tasks. Ensuring the safety and robustness of these systems is an important area for future work.

  • The review highlights a lack of diversity in the research, with most studies coming from a small number of research groups. Broader collaboration and interdisciplinary perspectives could help drive faster progress in this area.

  • The paper notes that most of the existing work has focused on generating textual artifacts like requirements documents. Expanding the capabilities of generative AI to handle other types of requirements, such as visual, mathematical, or behavioral, could significantly broaden its applicability.

Overall, the systematic review provides a solid foundation for understanding the current state of the art, while also identifying key challenges and opportunities for advancing the use of generative AI in requirements engineering.

Conclusion

This systematic literature review offers a comprehensive analysis of the emerging field of using generative AI techniques for requirements engineering tasks.

The research highlights both the promising capabilities of these approaches, such as automating the generation of requirements artifacts, as well as the significant technical and practical hurdles that must be overcome. Key areas for future work include improving the reliability and trustworthiness of generative models, expanding their capabilities beyond textual requirements, and conducting more extensive real-world evaluations.

As the field of requirements engineering continues to evolve, the insights provided by this systematic review can help guide researchers and practitioners in leveraging the power of generative AI to improve the efficiency and effectiveness of the requirements engineering process.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Generative AI for Requirements Engineering: A Systematic Literature Review
Total Score

0

Generative AI for Requirements Engineering: A Systematic Literature Review

Haowei Cheng, Jati H. Husen, Sien Reeve Peralta, Bowen Jiang, Nobukazu Yoshioka, Naoyasu Ubayashi, Hironori Washizaki

Context: Generative AI (GenAI) has emerged as a transformative tool in software engineering, with requirements engineering (RE) actively exploring its potential to revolutionize processes and outcomes. The integration of GenAI into RE presents both promising opportunities and significant challenges that necessitate systematic analysis and evaluation. Objective: This paper presents a comprehensive systematic literature review (SLR) analyzing state-of-the-art applications and innovative proposals leveraging GenAI in RE. It surveys studies focusing on the utilization of GenAI to enhance RE processes while identifying key challenges and opportunities in this rapidly evolving field. Method: A rigorous SLR methodology was used to analyze 27 carefully selected primary studies in-depth. The review examined research questions pertaining to the application of GenAI across various RE phases, the models and techniques used, and the challenges encountered in implementation and adoption. Results: The most salient findings include i) a predominant focus on the early stages of RE, particularly the elicitation and analysis of requirements, indicating potential for expansion into later phases; ii) the dominance of large language models, especially the GPT series, highlighting the need for diverse AI approaches; and iii) persistent challenges in domain-specific applications and the interpretability of AI-generated outputs, underscoring areas requiring further research and development. Conclusions: The results highlight the critical need for comprehensive evaluation frameworks, improved human-AI collaboration models, and thorough consideration of ethical implications in GenAI-assisted RE. Future research should prioritize extending GenAI applications across the entire RE lifecycle, enhancing domain-specific capabilities, and developing strategies for responsible AI integration in RE practices.

Read more

9/12/2024

Generative Artificial Intelligence: A Systematic Review and Applications
Total Score

0

Generative Artificial Intelligence: A Systematic Review and Applications

Sandeep Singh Sengar, Affan Bin Hasan, Sanjay Kumar, Fiona Carroll

In recent years, the study of artificial intelligence (AI) has undergone a paradigm shift. This has been propelled by the groundbreaking capabilities of generative models both in supervised and unsupervised learning scenarios. Generative AI has shown state-of-the-art performance in solving perplexing real-world conundrums in fields such as image translation, medical diagnostics, textual imagery fusion, natural language processing, and beyond. This paper documents the systematic review and analysis of recent advancements and techniques in Generative AI with a detailed discussion of their applications including application-specific models. Indeed, the major impact that generative AI has made to date, has been in language generation with the development of large language models, in the field of image translation and several other interdisciplinary applications of generative AI. Moreover, the primary contribution of this paper lies in its coherent synthesis of the latest advancements in these areas, seamlessly weaving together contemporary breakthroughs in the field. Particularly, how it shares an exploration of the future trajectory for generative AI. In conclusion, the paper ends with a discussion of Responsible AI principles, and the necessary ethical considerations for the sustainability and growth of these generative models.

Read more

5/21/2024

🤖

Total Score

0

A Systematic Review of Generative AI for Teaching and Learning Practice

Bayode Ogunleye, Kudirat Ibilola Zakariyyah, Oluwaseun Ajao, Olakunle Olayinka, Hemlata Sharma

The use of generative artificial intelligence (GenAI) in academia is a subjective and hotly debated topic. Currently, there are no agreed guidelines towards the usage of GenAI systems in higher education (HE) and, thus, it is still unclear how to make effective use of the technology for teaching and learning practice. This paper provides an overview of the current state of research on GenAI for teaching and learning in HE. To this end, this study conducted a systematic review of relevant studies indexed by Scopus, using the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. The search criteria revealed a total of 625 research papers, of which 355 met the final inclusion criteria. The findings from the review showed the current state and the future trends in documents, citations, document sources/authors, keywords, and co-authorship. The research gaps identified suggest that while some authors have looked at understanding the detection of AI-generated text, it may be beneficial to understand how GenAI can be incorporated into supporting the educational curriculum for assessments, teaching, and learning delivery. Furthermore, there is a need for additional interdisciplinary, multidimensional studies in HE through collaboration. This will strengthen the awareness and understanding of students, tutors, and other stakeholders, which will be instrumental in formulating guidelines, frameworks, and policies for GenAI usage.

Read more

6/17/2024

How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions
Total Score

0

How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions

Umm-e- Habiba, Markus Haug, Justus Bogner, Stefan Wagner

Artificial intelligence (AI) permeates all fields of life, which resulted in new challenges in requirements engineering for artificial intelligence (RE4AI), e.g., the difficulty in specifying and validating requirements for AI or considering new quality requirements due to emerging ethical implications. It is currently unclear if existing RE methods are sufficient or if new ones are needed to address these challenges. Therefore, our goal is to provide a comprehensive overview of RE4AI to researchers and practitioners. What has been achieved so far, i.e., what practices are available, and what research gaps and challenges still need to be addressed? To achieve this, we conducted a systematic mapping study combining query string search and extensive snowballing. The extracted data was aggregated, and results were synthesized using thematic analysis. Our selection process led to the inclusion of 126 primary studies. Existing RE4AI research focuses mainly on requirements analysis and elicitation, with most practices applied in these areas. Furthermore, we identified requirements specification, explainability, and the gap between machine learning engineers and end-users as the most prevalent challenges, along with a few others. Additionally, we proposed seven potential research directions to address these challenges. Practitioners can use our results to identify and select suitable RE methods for working on their AI-based systems, while researchers can build on the identified gaps and research directions to push the field forward.

Read more

9/12/2024