Standardizing Knowledge Engineering Practices with a Reference Architecture
2404.03624
0
0
Abstract
Knowledge engineering is the process of creating and maintaining knowledge-producing systems. Throughout the history of computer science and AI, knowledge engineering workflows have been widely used given the importance of high-quality knowledge for reliable intelligent agents. Meanwhile, the scope of knowledge engineering, as apparent from its target tasks and use cases, has been shifting, together with its paradigms such as expert systems, semantic web, and language modeling. The intended use cases and supported user requirements between these paradigms have not been analyzed globally, as new paradigms often satisfy prior pain points while possibly introducing new ones. The recent abstraction of systemic patterns into a boxology provides an opening for aligning the requirements and use cases of knowledge engineering with the systems, components, and software that can satisfy them best. This paper proposes a vision of harmonizing the best practices in the field of knowledge engineering by leveraging the software engineering methodology of creating reference architectures. We describe how a reference architecture can be iteratively designed and implemented to associate user needs with recurring systemic patterns, building on top of existing knowledge engineering workflows and boxologies. We provide a six-step roadmap that can enable the development of such an architecture, providing an initial design and outcome of the definition of architectural scope, selection of information sources, and analysis. We expect that following through on this vision will lead to well-grounded reference architectures for knowledge engineering, will advance the ongoing initiatives of organizing the neurosymbolic knowledge engineering space, and will build new links to the software architectures and data science communities.
Create account to get full access
Overview
- This paper proposes a reference architecture framework to standardize knowledge engineering (KE) practices across different domains and applications.
- The authors argue that a shared reference architecture is needed to consolidate the various KE paradigms and enable more cohesive and interoperable KE systems.
- The reference architecture outlines key components, interfaces, and patterns to guide the design and development of KE solutions.
Plain English Explanation
The paper is about creating a common blueprint or "reference architecture" for how knowledge engineering (KE) systems should be built. KE is the process of capturing, organizing, and using knowledge to solve problems, often with the help of AI and other technologies.
Currently, there are many different ways to build KE systems, each with their own approaches and tools. This can make it hard for these systems to work together or for companies to reuse work from previous projects. The authors believe a shared reference architecture would help standardize KE practices and make KE systems more consistent and compatible.
The proposed reference architecture lays out the key components and connections needed in a KE system, like how to gather and represent knowledge, how to reason about that knowledge, and how to apply it to tasks. It provides a common language and structure that KE practitioners can use, similar to how reference architectures are used in other fields like software or building design.
By having this shared blueprint, the authors hope KE systems will become more interoperable, reusable, and scalable across different domains and applications. This could make it easier for organizations to adopt and deploy KE solutions to tackle complex real-world problems.
Technical Explanation
The paper presents a reference architecture framework for standardizing knowledge engineering (KE) practices. The authors argue that the fragmentation of KE paradigms and approaches has hindered the development of cohesive, interoperable KE systems.
The reference architecture consists of several key components:
- Knowledge Acquisition & Representation: Specifies how to capture and model domain knowledge from various sources, including expert input, data, and ontologies.
- Knowledge Reasoning: Outlines approaches for reasoning over the knowledge base to derive new insights, make inferences, and support decision-making.
- Knowledge Application: Describes how the acquired and reasoned knowledge can be applied to concrete tasks, such as question answering, task planning, and anomaly detection.
- Knowledge Lifecycle Management: Covers the processes for maintaining, updating, and governing the knowledge base over time.
The authors also define interfaces between these components to enable modular and extensible KE system architectures. Additionally, the framework incorporates crosscutting concerns like security, provenance, and explainability.
The reference architecture is intended to serve as a common blueprint to guide the design and development of KE solutions, promoting consistency, interoperability, and reuse across diverse domains and applications.
Critical Analysis
The authors make a compelling case for the need to standardize KE practices through a unifying reference architecture. The proposed framework addresses key challenges around the fragmentation of KE approaches and the lack of interoperability between KE systems.
However, the paper does not provide extensive details on how the reference architecture would be implemented or validated in practice. The authors acknowledge that further work is needed to refine the framework and demonstrate its utility across real-world use cases.
Additionally, the paper does not delve into potential challenges around the adoption and governance of the reference architecture. Ensuring broad acceptance and adherence to the standard may require significant coordination and collaboration across the KE community.
Future research could explore the practical application of the reference architecture, including case studies demonstrating its impact on KE system development and integration. Investigating the governance and maintenance of the reference architecture over time would also be a valuable area of investigation.
Conclusion
This paper presents a reference architecture framework to help standardize knowledge engineering (KE) practices and enable more cohesive, interoperable KE systems. By providing a common blueprint for the key components and interfaces of KE solutions, the authors aim to consolidate the fragmented KE landscape and promote greater consistency and reuse.
The proposed reference architecture has the potential to significantly improve the development and deployment of KE applications across diverse domains. If widely adopted, it could facilitate the integration of KE capabilities into a broader range of enterprise systems and facilitate the sharing of knowledge assets.
While further work is needed to refine and validate the reference architecture, this research represents an important step towards establishing a more cohesive and scalable approach to knowledge engineering.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
📈
Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents
Qinghua Lu, Liming Zhu, Xiwei Xu, Zhenchang Xing, Stefan Harrer, Jon Whittle
0
0
Foundation models, such as large language models (LLMs), have been widely recognised as transformative AI technologies due to their capabilities to understand and generate content, including plans with reasoning capabilities. Foundation model based agents derive their autonomy from the capabilities of foundation models, which enable them to autonomously break down a given goal into a set of manageable tasks and orchestrate task execution to meet the goal. Despite the huge efforts put into building foundation model based agents, the architecture design of the agents has not yet been systematically explored. Also, while there are significant benefits of using agents for planning and execution, there are serious considerations regarding responsible AI related software quality attributes, such as security and accountability. Therefore, this paper presents a pattern-oriented reference architecture that serves as guidance when designing foundation model based agents. We evaluate the completeness and utility of the proposed reference architecture by mapping it to the architecture of two real-world agents.
4/4/2024
Enhancing Research Information Systems with Identification of Domain Experts
Gautam Kishore Shahi, Oliver Hummel
0
0
Research organisations and their research outputs have been growing considerably in the past decades. This large body of knowledge attracts various stakeholders, e.g., for knowledge sharing, technology transfer, or potential collaborations. However, due to the large amount of complex knowledge created, traditional methods of manually curating catalogues are often out of time, imprecise, and cumbersome. Finding domain experts and knowledge within any larger organisation, scientific and also industrial, has thus become a serious challenge. Hence, exploring an institutions domain knowledge and finding its experts can only be solved by an automated solution. This work presents the scheme of an automated approach for identifying scholarly experts based on their publications and, prospectively, their teaching materials. Based on a search engine, this approach is currently being implemented for two universities, for which some examples are presented. The proposed system will be helpful for finding peer researchers as well as starting points for knowledge exploitation and technology transfer. As the system is designed in a scalable manner, it can easily include additional institutions and hence provide a broader coverage of research facilities in the future.
4/5/2024
🏋️
New!Machine Learning-Enabled Software and System Architecture Frameworks
Armin Moin, Atta Badii, Stephan Gunnemann, Moharram Challenger
0
0
Various architecture frameworks for software, systems, and enterprises have been proposed in the literature. They identified several stakeholders and defined modeling perspectives, architecture viewpoints, and views to frame and address stakeholder concerns. However, the stakeholders with data science and Machine Learning (ML) related concerns, such as data scientists and data engineers, are yet to be included in existing architecture frameworks. Only this way can we envision a holistic system architecture description of an ML-enabled system. Note that the ML component behavior and functionalities are special and should be distinguished from traditional software system behavior and functionalities. The main reason is that the actual functionality should be inferred from data instead of being specified at design time. Additionally, the structural models of ML components, such as ML model architectures, are typically specified using different notations and formalisms from what the Software Engineering (SE) community uses for software structural models. Yet, these two aspects, namely ML and non-ML, are becoming so intertwined that it necessitates an extension of software architecture frameworks and modeling practices toward supporting ML-enabled system architectures. In this paper, we address this gap through an empirical study using an online survey instrument. We surveyed 61 subject matter experts from over 25 organizations in 10 countries.
6/28/2024
🤖
Towards Responsible and Safe AI in the Era of Foudnation Models: A Reference Architecture for Designing Foundation Model based Systems
Qinghua Lu, Liming Zhu, Xiwei Xu, Zhenchang Xing, Jon Whittle
0
0
The release of ChatGPT, Gemini, and other large language model has drawn huge interests on foundations models. There is a broad consensus that foundations models will be the fundamental building blocks for future AI systems. However, there is a lack of systematic guidance on the architecture design. Particularly, the the rapidly growing capabilities of foundations models can eventually absorb other components of AI systems, posing challenges of moving boundary and interface evolution in architecture design. Furthermore, incorporating foundations models into AI systems raises significant concerns about responsible and safe AI due to their opaque nature and rapidly advancing intelligence. To address these challenges, the paper first presents an architecture evolution of AI systems in the era of foundation models, transitioning from foundation-model-as-a-connector to foundation-model-as-a-monolithic architecture. The paper then identifies key design decisions and proposes a pattern-oriented reference architecture for designing responsible foundation-model-based systems. The patterns can enable the potential of foundation models while ensuring associated risks.
5/28/2024