Predictive business process monitoring (PPM) has been around for several years as a use case of process mining. PPM enables foreseeing the future of a business process through predicting relevant information about how a running process instance might end, related performance indicators, and other predictable aspects. A big share of PPM approaches adopts a Machine Learning (ML) technique to address a prediction task, especially non-process-aware PPM approaches. Consequently, PPM inherits the challenges faced by ML approaches. One of these challenges concerns the need to gain user trust in the predictions generated. The field of explainable artificial intelligence (XAI) addresses this issue. However, the choices made, and the techniques employed in a PPM task, in addition to ML model characteristics, influence resulting explanations. A comparison of the influence of different settings on the generated explanations is missing. To address this gap, we investigate the effect of different PPM settings on resulting data fed into an ML model and consequently to a XAI method. We study how differences in resulting explanations may indicate several issues in underlying data. We construct a framework for our experiments including different settings at each stage of PPM with XAI integrated as a fundamental part. Our experiments reveal several inconsistencies, as well as agreements, between data characteristics (and hence expectations about these data), important data used by the ML model as a result of querying it, and explanations of predictions of the investigated ML model.
QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems
School of Mathematics, Physics & Computing, University of Southern Queensland（南昆士兰大学数学、物理与计算学院）；Department of Computing and Decision Sciences, Lingnan University（岭南大学计算与决策科学系）；School of Computer and Artificial Intelligence, Wuhan University of Technology（武汉理工大学计算机与人工智能学院）；Metro North Hospital and Health Service, Royal Brisbane and Women’s Hospital（布里斯班皇家妇女医院及北metro医院健康服务中心）；School of Nursing, Queensland University of Technology（昆士兰科技大学护理学院）
本文提出 QXAI 可解释 AI 框架，结合 Shapley 值与注意力 BiLSTM/ANN，实现患者心率预测和活动分类的全局与局部解释。
We are witnessing the emergence of an AI economy and society where AI technologies are increasingly impacting health care, business, transportation and many aspects of everyday life. Many successes have been reported where AI systems even surpassed the accuracy of human experts. However, AI systems may produce errors, can exhibit bias, may be sensitive to noise in the data, and often lack technical and judicial transparency resulting in reduction in trust and challenges in their adoption. These recent shortcomings and concerns have been documented in scientific but also in general press such a…
An Explainable AI based approach for Monitoring Animal Health
Water Technology Development Hub(AWaDH), Indian Institute of Technology（印度理工学院水技术发展中心）；Academy of Scientific and Innovative Research (AcSIR)（科学与创新研究院）；Department of Higher Education（高等教育部）
University of Lille（里尔大学）；ENSAIT（国立高等艺术与纺织工业学院）；GEMTEX–Laboratoire de Génie et Matériaux Textiles（纺织工程与材料实验室）；University of Kent（肯特大学）
Deep learning play a vital role in classifying different arrhythmias using the electrocardiography (ECG) data. Nevertheless, training deep learning models normally requires a large amount of data and it can lead to privacy concerns. Unfortunately, a large amount of healthcare data cannot be easily collected from a single silo. Additionally, deep learning models are like black-box, with no explainability of the predicted results, which is often required in clinical healthcare. This limits the application of deep learning in real-world health systems. In this paper, we design a new explainable a…
In healthcare, AI systems support clinicians and patients in diagnosis, treatment, and monitoring, but many systems' poor explainability remains challenging for practical application. Overcoming this barrier is the goal of explainable AI (XAI). However, an explanation can be perceived differently and, thus, not solve the black-box problem for everyone. The domain of Human-Centered AI deals with this problem by adapting AI to users. We present a user-centered persona concept to evaluate XAI and use it to investigate end-users preferences for various explanation styles and contents in a mobile h…
HU University of Applied Sciences Utrecht（乌得勒支应用科学大学）；De Nederlandsche Bank（荷兰中央银行）
Explainable artificial intelligence (xAI) is seen as a solution to making AI systems less of a black box. It is essential to ensure transparency, fairness, and accountability, which are especially paramount in the financial sector. The aim of this study was a preliminary investigation of the perspectives of supervisory authorities and regulated entities regarding the application of xAI in the fi-nancial sector. Three use cases (consumer credit, credit risk, and anti-money laundering) were examined using semi-structured interviews at three banks and two supervisory authorities in the Netherland…
A surge of interest in explainable AI (XAI) has led to a vast collection of algorithmic work on the topic. While many recognize the necessity to incorporate explainability features in AI systems, how to address real-world user needs for understanding AI remains an open question. By interviewing 20 UX and design practitioners working on various AI products, we seek to identify gaps between the current XAI algorithmic work and practices to create explainable AI products. To do so, we develop an algorithm-informed XAI question bank in which user needs for explainability are represented as prototy…
Explainable AI for Biodiversity Monitoring and Ecological Image Analysis
Pratt School of Engineering, Duke University（杜克大学工程学院）；British Antarctic Survey（英国南极调查局）；Department of Applied Mathematics and Theoretical Physics, University of Cambridge（剑桥大学应用数学与理论物理系）；Duke University Division of Marine Science and Conservation, Nicholas School of the Environment, Duke University Marine Laboratory（杜克大学海洋科学与保护分会，尼古拉斯环境学院，杜克大学海洋实验室）
Prompting Large Language Models for Training-Free Non-Intrusive Load Monitoring
Southern University of Science；Technology \& Peng Cheng Laboratory；The Chinese University of Hong Kong, Shenzhen；The Hong Kong University of Science；Tsinghua University
Indian Institute of Technology, Kharagpur（印度理工学院卡拉格普尔分校）；IBM Research Europe（IBM欧洲研究院）
An active learning (AL) algorithm seeks to construct an effective classifier with a minimal number of labeled examples in a bootstrapping manner. While standard AL heuristics, such as selecting those points for annotation for which a classification model yields least confident predictions, there has been no empirical investigation to see if these heuristics lead to models that are more interpretable to humans. In the era of data-driven learning, this is an important research direction to pursue. This paper describes our work-in-progress towards developing an AL selection function that in addit…
Federal University of Pará（帕拉联邦大学）；Federal Institute of Pará（帕拉联邦学院）；Montpellier University（蒙彼利埃大学）；Vale Institute of Technology（淡水河谷研究所）
Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI measures used today explain these types of models, generating attribute rankings aimed at explaining the model, that is, the analysis of Attribute Importance of Model. There is no consensus on which XAI measure generates an overall explainability rank. For this reason, several proposals for tools have emerged (Ciu, Dalex, Eli5, Lofo, Shap and Skater). An experimental benchmark of explainable AI techniques capable of producin…
University of Washington（华盛顿大学）；Arthur AI（亚瑟人工智能公司）
Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of machine learning models is essential to the development of trustworthy machine learning based systems. A burgeoning body of research seeks to define the goals and methods of explainability in machine learning. In this paper, we seek to review and categorize research on counterfactual explanations, a specific class of explanation that provides a link between…
Explainable Predictive Process Monitoring: A User Evaluation
Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）；Free University of Bozen-Bolzano（博尔扎诺自由大学）；University of Tartu（塔尔图大学）；Ulsan National Institute of Science and Technology（蔚山科学技术院）；Utrecht University（乌得勒支大学）；Carnegie Mellon University（卡内基梅隆大学）
University of Tartu（塔尔图大学）；Carnegie Mellon University（卡内基梅隆大学）
Prescriptive process monitoring methods seek to optimize a business process by recommending interventions at runtime to prevent negative outcomes or poorly performing cases. In recent years, various prescriptive process monitoring methods have been proposed. This paper studies existing methods in this field via a Systematic Literature Review (SLR). In order to structure the field, the paper proposes a framework for characterizing prescriptive process monitoring methods according to their performance objective, performance metrics, intervention types, modeling techniques, data inputs, and inter…
University of Oxford（牛津大学）；University of Nottingham（诺丁汉大学）
The automotive industry has witnessed an increasing level of development in the past decades; from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in Artificial Intelligence (AI), automotive companies now employ blackbox AI models to enable vehicles to perceive their environments and make driving decisions with little or no input from a human. With the hope to deploy autonomous vehicles (AV) on a commercial scale, the acceptance of AV by society becomes paramount and may largely depend on their degree of transpare…
On Thin Ice: Towards Explainable Conservation Monitoring via Attribution and Perturbations
Duke University（杜克大学）；University of Agder（阿格德大学）；University of Cambridge（剑桥大学）；U.S. National Park Service Department of Interior（美国国家公园管理局）；Alaska Spatial Science Fairbanks, AK（阿拉斯加空间科学研究所）
University of Pavia（帕维亚大学）；Free University of Bozen-Bolzano（博尔扎诺自由大学）
A key challenge for Industry 4.0 applications is to develop control systems for automated manufacturing services that are capable of addressing both data integration and semantic interoperability issues, as well as monitoring and decision making tasks. To address such an issue in advanced manufacturing systems, principled knowledge representation approaches based on formal ontologies have been proposed as a foundation to information management and maintenance in presence of heterogeneous data sources. In addition, ontologies provide reasoning and querying capabilities to aid domain experts and…
