Adversarial System Variant Approximation to Quantify Process Model Generalization

Abstract

In process mining, process models are extracted from event logs using process discovery algorithms and are commonly assessed using multiple quality dimensions. While the metrics that measure the relationship of an extracted process model to its event log are well-studied, quantifying the level by which a process model can describe the unobserved behavior of its underlying system falls short in the literature. In this paper, a novel deep learning-based methodology called Adversarial System Variant Approximation (AVATAR) is proposed to overcome this issue. Sequence Generative Adversarial Networks are trained on the variants contained in an event log with the intention to approximate the underlying variant distribution of the system behavior. Unobserved realistic variants are sampled either directly from the Sequence Generative Adversarial Network or by leveraging the Metropolis-Hastings algorithm. The degree by which a process model relates to its underlying unknown system behavior is then quantified based on the realistic observed and estimated unobserved variants using established process model quality metrics. Significant performance improvements in revealing realistic unobserved variants are demonstrated in a controlled experiment on 15 ground truth systems. Additionally, the proposed methodology is experimentally tested and evaluated to quantify the generalization of 60 discovered process models with respect to their systems.

References in corpus (10)

• Neural Machine Translation by Jointly Learning to Align and Translate
• TensorFlow: A system for large-scale machine learning
• The relativistic discriminator: a key element missing from standard GAN
• MaskGAN: Better Text Generation via Filling in the______
• Automated Discovery of Business Process Simulation Models from Event Logs
• Process Mining for Python (PM4Py): Bridging the Gap Between Process- and Data Science
• Decay Replay Mining to Predict Next Process Events
• Neural Text Generation: Past, Present and Beyond
• Process Mining of Programmable Logic Controllers: Input/Output Event Logs
• Behavioral Petri Net Mining and Automated Analysis for Human-Computer Interaction Recommendations in Multi-Application Environments

Cited by in corpus (3)

• Tailoring Machine Learning for Process Mining
• Masking Neural Networks Using Reachability Graphs to Predict Process Events
• On the Performance Analysis of the Adversarial System Variant Approximation Method to Quantify Process Model Generalization