Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available event logs. This paper presents empirical evidence that calls into question the effectiveness of these current evaluation approaches. We show that there is an enormous amount of example leakage in all of the commonly used event logs, so that rather trivial prediction approaches perform almost as well as ones that leverage deep learning. We further argue that designing robust evaluations requires a more profound conceptual engagement with the topic of next-activity prediction, and specifically with the notion of generalization to new data. To this end, we present various prediction scenarios that necessitate different types of generalization to guide future research.
An empirical comparison of deep-neural-network architectures for next activity prediction using context-enriched process event logs
Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大大学埃尔兰根-纽伦堡分校);University of Münster(明斯特大学);Vienna University of Economics and Business(维也纳经济大学)
Leveraging Taxonomy Similarity for Next Activity Prediction in Patient Treatment
German Reseach Centre for Artificial Intelligence (DFKI), SDS Branch Trier(德国人工智能研究中心(DFKI),特里尔分部);University of Trier, Business Information Systems II(特里尔大学,商业信息系统二系)
An Innovative Next Activity Prediction Using Process Entropy and Dynamic Attribute-Wise-Transformer in Predictive Business Process Monitoring
Department of Electrical and Computer Engineering, Faculty of Engineering and Computer Science, University of Victoria(维多利亚大学工程与计算机科学学院电气与计算机工程系);Department of Mechanical Engineering, Faculty of Engineering and Computer Science, University of Victoria(维多利亚大学工程与计算机科学学院机械工程系)
RLHGNN: Reinforcement Learning-driven Heterogeneous Graph Neural Network for Next Activity Prediction in Business Processes
College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);Zhejiang Key Laboratory of Visual Information Intelligent Processing(浙江省视觉信息智能处理重点实验室);University of Southern Queensland(南方昆士兰大学)
Next-Generation Travel Demand Modeling with a Generative Framework for Household Activity Coordination
University of California, Los Angeles(加州大学洛杉矶分校);UCLA Mobility Lab under the Department of Civil and Environmental Engineering(加州大学洛杉矶分校交通实验室);University of Louisville(路易斯维尔大学);Novateur Research Solutions(Novateur研究解决方案)