创建无偏见的公共基准数据集,防止数据泄漏,用于预测过程监控
Creating Unbiased Public Benchmark Datasets with Data Leakage Prevention for Predictive Process Monitoring
摘要:
人工智能的进步,特别是机器学习,越来越多地吸引了人们对预测过程监控的研究兴趣和努力,这是过程挖掘(PM)的子领域,涉及预测下一个事件,过程结果和剩余执行时间。不幸的是,研究人员使用各种数据集和方法将它们分成训练集和测试集。这些预处理步骤的文档并不总是完整的。因此,研究结果很难甚至不可能复制和比较论文。有时,使用非公有领域知识进一步阻碍了思想的公平竞争。通常,训练集和测试集没有完全分离,这是预测过程监控特有的数据泄漏问题。此外,测试集通常遭受偏见的情况下,持续时间和运行的情况下的数量的混合。这些障碍对该领域的进展构成挑战。本文的贡献是识别和证明这些障碍的重要性,并提出预处理步骤,以原则性的方式获得无偏的基准数据集,从而创建具有代表性的测试集,而不会导致数据泄漏,目的是公平竞争,促进开放科学,并有助于预测过程监测的更快进展。
英文摘要:
Advances in AI, and especially machine learning, are increasingly drawing research interest and efforts towards predictive process monitoring, the subfield of process mining (PM) that concerns predicting next events, process outcomes and remaining execution times. Unfortunately, researchers use a variety of datasets and ways to split them into training and test sets. The documentation of these preprocessing steps is not always complete. Consequently, research results are hard or even impossible to reproduce and to compare between papers. At times, the use of non-public domain knowledge further hampers the fair competition of ideas. Often the training and test sets are not completely separated, a data leakage problem particular to predictive process monitoring. Moreover, test sets usually suffer from bias in terms of both the mix of case durations and the number of running cases. These obstacles pose a challenge to the field's progress. The contribution of this paper is to identify and demonstrate the importance of these obstacles and to propose preprocessing steps to arrive at unbiased benchmark datasets in a principled way, thus creating representative test sets without data leakage with the aim of levelling the playing field, promoting open science and contributing to more rapid progress in predictive process monitoring.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。