Bridging Domain Knowledge and Process Discovery Using Large Language Models

Overview

• Automated process discovery methods often overlook valuable domain knowledge.
• This paper leverages Large Language Models (LLMs) to integrate domain knowledge directly into process discovery.
• The framework creates a bridge between natural language process knowledge and the discovery of robust process models.
• A case study with the UWV employee insurance agency demonstrates the practical benefits and effectiveness of the approach.

Plain English Explanation

When organizations try to analyze and improve their internal processes, they often use automated process discovery methods. These methods can uncover patterns and insights from data about how a process actually works. However, they may miss out on important domain knowledge - information that subject matter experts have about how the process should work, or detailed process documentation.

This research paper proposes a new way to incorporate that valuable domain knowledge directly into the process discovery process. The key is using large language models - powerful AI systems that can understand and generate human-like text. By using rules derived from these language models, the researchers were able to guide the automated discovery of process models so they align with both the real-world data and the domain expertise.

This creates a bridge between the natural language knowledge that people have about a process, and the detailed process models that can be used for further analysis and improvement. The researchers demonstrated the practical benefits of this approach through a case study with a government insurance agency, showing how it can enhance standard process discovery techniques.

Technical Explanation

The paper presents a framework that leverages large language models (LLMs) to enhance automated process discovery. LLMs are used to extract rules and constraints from domain knowledge, which are then integrated directly into the model construction process.

The key steps are:

1. Domain Knowledge Extraction: LLM-based prompts are used to elicit relevant process knowledge from subject matter experts and documentation.
2. Rule Derivation: The extracted knowledge is used to derive a set of rules and constraints that should guide the process model.
3. Model Construction: An automated discovery algorithm incorporates the LLM-derived rules to construct a process model that aligns with both the data and the domain knowledge.

This approach creates a feedback loop between the natural language process knowledge and the formal process models, allowing domain expertise to directly shape the discovered models. The researchers evaluated their framework through a case study with the UWV employee insurance agency, demonstrating its practical benefits and effectiveness.

Critical Analysis

The paper makes a compelling case for the value of integrating domain knowledge into automated process discovery. By leveraging LLMs, the framework provides a systematic way to bridge the gap between informal process knowledge and the formal models used for analysis.

One limitation discussed is the reliance on subject matter experts to provide the initial domain knowledge. This could introduce biases or incomplete information. Further research could explore ways to more automatically extract relevant knowledge from a broader set of sources.

Additionally, the case study focuses on a single organizational context. More evaluations across diverse domains would help establish the generalizability of the approach. Potential challenges around scaling the framework to larger, more complex processes could also be investigated.

Overall, the paper presents an innovative solution to a significant challenge in process mining and analysis. By combining the strengths of automated discovery and domain expertise, it offers a promising path forward for organizations looking to gain deeper insights from their process data.

Conclusion

This research paper introduces a novel framework that leverages large language models to enhance automated process discovery. By integrating domain knowledge directly into the model construction process, the approach creates a bridge between natural language process expertise and the formal models used for analysis and improvement.

The demonstrated case study highlights the practical benefits of this approach, showing how it can produce process models that are better aligned with both real-world data and the insights of subject matter experts. As organizations increasingly rely on data-driven process analysis, this work represents an important step forward in unlocking the full value of their process knowledge.

Further research to address the identified limitations and expand the approach to additional contexts could lead to even more transformative advances in the field of process mining and analysis.