Explainable AI is an important area of research within which Explainable Planning is an emerging topic. In this paper, we argue that Explainable Planning can be designed as a service -- that is, as a wrapper around an existing planning system that utilises the existing planner to assist in answering contrastive questions. We introduce a prototype framework to facilitate this, along with some examples of how a planner can be used to address certain types of contrastive questions. We discuss the main advantages and limitations of such an approach and we identify open questions for Explainable Planning as a service that identify several possible research directions.
IBM Research AI（IBM研究院人工智能部）；Arizona State University（亚利桑那州立大学）
In this paper, we provide a comprehensive outline of the different threads of work in Explainable AI Planning (XAIP) that has emerged as a focus area in the last couple of years and contrast that with earlier efforts in the field in terms of techniques, target users, and delivery mechanisms. We hope that the survey will provide guidance to new researchers in automated planning towards the role of explanations in the effective design of human-in-the-loop systems, as well as provide the established researcher with some perspective on the evolution of the exciting world of explainable planning.
This paper presents JEDAI, an AI system designed for outreach and educational efforts aimed at non-AI experts. JEDAI features a novel synthesis of research ideas from integrated task and motion planning and explainable AI. JEDAI helps users create high-level, intuitive plans while ensuring that they will be executable by the robot. It also provides users customized explanations about errors and helps improve their understanding of AI planning as well as the limits and capabilities of the underlying robot system.
Computer Science Department, Arizona State University（亚利桑那州立大学计算机科学系）；IBM T. J. Watson Research Center（IBM T.J.沃森研究中心）
In this paper, we report on the visualization capabilities of an Explainable AI Planning (XAIP) agent that can support human in the loop decision making. Imposing transparency and explainability requirements on such agents is especially important in order to establish trust and common ground with the end-to-end automated planning system. Visualizing the agent's internal decision-making processes is a crucial step towards achieving this. This may include externalizing the "brain" of the agent -- starting from its sensory inputs, to progressively higher order decisions made by it in order to dri…
Artificial intelligence (AI) enables machines to learn from human experience, adjust to new inputs, and perform human-like tasks. AI is progressing rapidly and is transforming the way businesses operate, from process automation to cognitive augmentation of tasks and intelligent process/data analytics. However, the main challenge for human users would be to understand and appropriately trust the result of AI algorithms and methods. In this paper, to address this challenge, we study and analyze the recent work done in Explainable Artificial Intelligence (XAI) methods and tools. We introduce a no…
One of the core envisions of the sixth-generation (6G) wireless networks is to accumulate artificial intelligence (AI) for autonomous controlling of the Internet of Everything (IoE). Particularly, the quality of IoE services delivery must be maintained by analyzing contextual metrics of IoE such as people, data, process, and things. However, the challenges incorporate when the AI model conceives a lake of interpretation and intuition to the network service provider. Therefore, this paper provides an explainable artificial intelligence (XAI) framework for quality-aware IoE service delivery that…
An Explainable AI Framework for Dynamic Resource Management in Vehicular Network Slicing
Institute for Safe Autonomy and School of Physics, Engineering and Technology（安全自主研究所和物理、工程与技术学院）；School of Electrical and Electronic Engineering（电气与电子工程学院）；University of Leeds（利兹大学）；School of Computer Science（计算机科学学院）；University College Dublin（都柏林大学学院）
University of Stuttgart（斯图加特大学）；Fraunhofer Institute for Industrial Engineering IAO（弗劳恩霍夫工业工程研究所）
With recent progress in the field of Explainable Artificial Intelligence (XAI) and increasing use in practice, the need for an evaluation of different XAI methods and their explanation quality in practical usage scenarios arises. For this purpose, we present VitrAI, which is a web-based service with the goal of uniformly demonstrating four different XAI algorithms in the context of three real life scenarios and evaluating their performance and comprehensibility for humans. This work reveals practical obstacles when adopting XAI methods and gives qualitative estimates on how well different appr…
Washington University in St. Louis（圣路易斯华盛顿大学）；New Mexico State University（新墨西哥州立大学）
In this paper, we build upon notions from knowledge representation and reasoning (KR) to expand a preliminary logic-based framework that characterizes the model reconciliation problem for explainable planning. We also provide a detailed exposition on the relationship between similar KR techniques, such as abductive explanations and belief change, and their applicability to explainable planning.
Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been implemented in numerous open source and commercial packages and explainable ML is also an important, mandatory, or embedded aspect of commercial predictive modeling in industries like financial services. However, like many technologies, explainable ML can be misused, particularly as a faulty safeguard for harmful black-boxes, e.g. fairwashing or scaffolding,…
Mepco Schlenk Engineering College（梅普科施伦克工程学院）；Pusan National University（釜山国立大学）；Shenzhen University（深圳大学）；Zhejiang University（浙江大学）；Zhejiang Lab（之江实验室）；Southeast University（东南大学）
Explainable Artificial Intelligence (XAI) is transforming the field of Artificial Intelligence (AI) by enhancing the trust of end-users in machines. As the number of connected devices keeps on growing, the Internet of Things (IoT) market needs to be trustworthy for the end-users. However, existing literature still lacks a systematic and comprehensive survey work on the use of XAI for IoT. To bridge this lacking, in this paper, we address the XAI frameworks with a focus on their characteristics and support for IoT. We illustrate the widely-used XAI services for IoT applications, such as securit…
Royal Bank of Canada（加拿大皇家银行）；Innopolis University（Innopolis 大学）；University of Manitoba（曼尼托巴大学）
The remarkable advancements in Deep Learning (DL) algorithms have fueled enthusiasm for using Artificial Intelligence (AI) technologies in almost every domain; however, the opaqueness of these algorithms put a question mark on their applications in safety-critical systems. In this regard, the `explainability' dimension is not only essential to both explain the inner workings of black-box algorithms, but it also adds accountability and transparency dimensions that are of prime importance for regulators, consumers, and service providers. eXplainable Artificial Intelligence (XAI) is the set of te…
As AI is increasingly being adopted into application solutions, the challenge of supporting interaction with humans is becoming more apparent. Partly this is to support integrated working styles, in which humans and intelligent systems cooperate in problem-solving, but also it is a necessary step in the process of building trust as humans migrate greater responsibility to such systems. The challenge is to find effective ways to communicate the foundations of AI-driven behaviour, when the algorithms that drive it are far from transparent to humans. In this paper we consider the opportunities th…
FST.ai 2.5: Explainable and Uncertainty-Aware AI for Olympic and Para-Taekwondo Decision Support, Athlete Digital Twins, and Federation-Scale Analytics
King’s College London（伦敦国王学院）；University of Lincoln（林肯大学）
Artificial Intelligence (AI) is being increasingly used to develop systems that produce intelligent solutions. However, there is a major concern that whether the systems built will be trusted by humans. In order to establish trust in AI systems, there is a need for the user to understand the reasoning behind their solutions and therefore, the system should be able to explain and justify its output. In this paper, we use argumentation to provide explanations in the domain of AI planning. We present argument schemes to create arguments that explain a plan and its components; and a set of critica…
Explainable AI in Grassland Monitoring: Enhancing Model Performance and Domain Adaptability
Leibniz-Institut für Agrartechnik und Bioökonomie e.V. (ATB)（莱布尼茨农业工程与生物经济研究所）；Technische Universität Berlin（柏林工业大学）；Understandable Machine Intelligence Lab (UMI Lab)（可理解机器智能实验室）；Universität Potsdam（波茨坦大学）
An Explainable Emotion Alignment Framework for LLM-Empowered Agent in Metaverse Service Ecosystem
College of Intelligence and Computing（智能与计算学院）；Tianjin University（天津大学）；Tianjin Key Laboratory of Healhy Habitat and Smart Technology（天津健康人居环境与智能技术重点实验室）；Laboratory of Computation and Analytics of Complex Management Systems（复杂管理系统计算与分析实验室）；Faculty of Environment, Science and Economy（环境、科学与经济学院）
King’s College London（伦敦国王学院）；University of Lincoln（林肯大学）
Artificial Intelligence (AI) is being increasingly deployed in practical applications. However, there is a major concern whether AI systems will be trusted by humans. In order to establish trust in AI systems, there is a need for users to understand the reasoning behind their solutions. Therefore, systems should be able to explain and justify their output. In this paper, we propose an argument scheme-based approach to provide explanations in the domain of AI planning. We present novel argument schemes to create arguments that explain a plan and its key elements; and a set of critical questions…
Arizona State University（亚利桑那州立大学）；IBM Research AI（IBM研究AI部门）
A new design of an AI assistant that has become increasingly popular is that of an "aggregated assistant" -- realized as an orchestrated composition of several individual skills or agents that can each perform atomic tasks. In this paper, we will talk about the role of planning in the automated composition of such assistants and explore how concepts in automated planning can help to establish transparency of the inner workings of the assistant to the end-user.
Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review
School of Informatics, University of Edinburgh（爱丁堡大学信息学院）；Institute of Automotive Engineering, Technical University (TU) of Darmstadt（达姆施塔特工业大学汽车工程研究所）；School of Engineering and Physical Sciences, Heriot-Watt University（赫瑞瓦特大学工程与物理科学学院）
Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A review
University of Eastern Finland（东芬兰大学）；School of Computing（计算机学院）；Shenzhen Technology University（深圳技术大学）；College of Big Data and Internet（大数据与互联网学院）；Chengdu University of Information Technology（成都信息工程大学）；College of Blockchain industry（区块链产业学院）；College of Health Science and Environmental Engineering（健康科学与环境工程学院）
Ford Motor Company（福特汽车公司）；State University of New York - Binghamton（纽约州立大学宾汉姆顿分校）
Everyday tasks are characterized by their varieties and variations, and frequently are not clearly specified to service agents. This paper presents a comprehensive approach to enable a service agent to deal with everyday tasks in open, uncontrolled environments. We introduce a generic structure for representing tasks, and another structure for representing situations. Based on the two newly introduced structures, we present a methodology of situation handling that avoids hard-coding domain rules while improving the scalability of real-world task planning systems.
LIRE Laboratory（LIRE实验室）；Mentouri University of Constantine（君士坦丁门图里大学）
The process-based semantic composition of Web Services is gaining a considerable momentum as an approach for the effective integration of distributed, heterogeneous, and autonomous applications. To compose Web Services semantically, we need an ontology. There are several ways of inserting semantics in Web Services. One of them consists of using description languages like OWL-S. In this paper, we introduce our work which consists in the proposition of a new model and the use of semantic matching technology for semantic and dynamic composition of ebXML business processes.
SAP Research（SAP研究院）；Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）
Thanks to recent advances, AI Planning has become the underlying technique for several applications. Figuring prominently among these is automated Web Service Composition (WSC) at the "capability" level, where services are described in terms of preconditions and effects over ontological concepts. A key issue in addressing WSC as planning is that ontologies are not only formal vocabularies; they also axiomatize the possible relationships between concepts. Such axioms correspond to what has been termed "integrity constraints" in the actions and change literature, and applying a web service is es…
New Insights into Automatic Treatment Planning for Cancer Radiotherapy Using Explainable Artificial Intelligence
Department of Physics, The University of Texas at Arlington（德克萨斯大学阿灵顿分校物理系）；Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University（约翰霍普金斯大学放射肿瘤学与分子放射科学系）
Heterogeneous Graph Neural Networks with Post-hoc Explanations for Multi-modal and Explainable Land Use Inference
Imperial College London, Department of Civil and Environmental Engineering（帝国理工学院伦敦校区土木与环境工程系）；Imperial College London, Department of Computing（帝国理工学院伦敦校区计算机系）
This paper gives a survey on the current state of Web Service Compositions and the difficulties and solutions to automated Web Service Compositions. This first gives a definition of Web Service Composition and the motivation and goal of it. It then explores into why we need automated Web Service Compositions and formally defines the domains. Techniques and solutions are proposed by the papers we surveyed to solve the current difficulty of automated Web Service Composition. Verification and future work is discussed at the end to further extend the topic.
University of Tübingen（图宾根大学）；Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）；Max Planck Institute for Informatics（马克斯·普朗克信息学研究所）
Planning an optimal route in a complex environment requires efficient reasoning about the surrounding scene. While human drivers prioritize important objects and ignore details not relevant to the decision, learning-based planners typically extract features from dense, high-dimensional grid representations containing all vehicle and road context information. In this paper, we propose PlanT, a novel approach for planning in the context of self-driving that uses a standard transformer architecture. PlanT is based on imitation learning with a compact object-level input representation. On the Long…
Deep learning adoption in the financial services industry has been limited due to a lack of model interpretability. However, several techniques have been proposed to explain predictions made by a neural network. We provide an initial investigation into these techniques for the assessment of credit risk with neural networks.
Automated and Explainable Denial of Service Analysis for AI-Driven Intrusion Detection Systems
Computer and Information Science Department, Fordham University（福特汉姆大学计算机与信息科学系）；RENCI, University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校RENCI）；Department of Mathematics and Computer Science, Royal Military College of Canada（加拿大皇家军事学院数学与计算机科学系）；Data Science Department, University of North Texas（德克萨斯大学纳夫卡特数据科学系）
Explainable planning is widely accepted as a prerequisite for autonomous agents to successfully work with humans. While there has been a lot of research on generating explanations of solutions to planning problems, explaining the absence of solutions remains an open and under-studied problem, even though such situations can be the hardest to understand or debug. In this paper, we show that hierarchical abstractions can be used to efficiently generate reasons for unsolvability of planning problems. In contrast to related work on computing certificates of unsolvability, we show that these method…
Knowledge Graph Fusion with Large Language Models for Accurate, Explainable Manufacturing Process Planning
School of Mechanical, Aerospace, and Manufacturing Engineering University of Connecticut Storrs, Connecticut, USA（机械、航空航天与制造工程学院 美国康涅狄格大学 斯托尔斯分校）；The United States Army Combat Capabilities Development Command Ground Vehicle Systems Center Warren, Michigan, USA（美国陆军作战能力发展司令部地面车辆系统中心 华伦，密歇根州，美国）
The financial services industry has unique explainability and fairness challenges arising from compliance and ethical considerations in credit decisioning. These challenges complicate the use of model machine learning and artificial intelligence methods in business decision processes.
In 2019, The Centers for Medicare and Medicaid Services (CMS) launched an Artificial Intelligence (AI) Health Outcomes Challenge seeking solutions to predict risk in value-based care for incorporation into CMS Innovation Center payment and service delivery models. Recently, modern language models have played key roles in a number of health related tasks. This paper presents, to the best of our knowledge, the first application of these models to patient readmission prediction. To facilitate this, we create a dataset of 1.2 million medical history samples derived from the Limited Dataset (LDS) i…
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学）；Siemens Healthcare GmbH（西门子医疗有限公司）；University of Applied Sciences Amberg-Weiden（安贝格-魏登应用技术大学）；infoteam Software AG（infoteam软件股份公司）；Siemens Shanghai Medical Equipment Ltd.（西门子上海医疗设备有限公司）
The most important goal of customer services is to keep the customer satisfied. However, service resources are always limited and must be prioritized. Therefore, it is important to identify customers who potentially become unsatisfied and might lead to escalations. Today this prioritization of customers is often done manually. Data science on IoT data (esp. log data) for machine health monitoring, as well as analytics on enterprise data for customer relationship management (CRM) have mainly been researched and applied independently. In this paper, we present a framework for a data-driven decis…
College of Information Science and Engineering, Ritsumeikan University（立命馆大学信息科学与工程学院）
Tidy-up tasks by service robots in home environments are challenging in robotics applications because they involve various interactions with the environment. In particular, robots are required not only to grasp, move, and release various home objects but also to plan the order and positions for placing the objects. In this paper, we propose a novel planning method that can efficiently estimate the order and positions of the objects to be tidied up by learning the parameters of a probabilistic generative model. The model allows a robot to learn the distributions of the co-occurrence probability…
In this study, we propose task planning framework for multiple robots that builds on a behavior tree (BT). BTs communicate with a data distribution service (DDS) to send and receive data. Since the standard BT derived from one root node with a single tick is unsuitable for multiple robots, a novel type of BT action and improved nodes are proposed to control multiple robots through a DDS asynchronously. To plan tasks for robots efficiently, a single task planning unit is implemented with the proposed task types. The task planning unit assigns tasks to each robot simultaneously through a single …
A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics
University of Bonn（波恩大学）；Lamarr Institute for Machine Learning and Artificial Intelligence（拉马尔机器学习与人工智能研究所）；Center for Robotics（机器人中心）；Computer Science Institute VI（计算机科学第六研究所）；Autonomous Intelligent Systems group（自主智能系统组）
Opportunistic Collaborative Planning with Large Vision Model Guided Control and Joint Query-Service Optimization
Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong (Shenzhen)（深圳大数据研究院，香港中文大学（深圳））；Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences（深圳先进技术研究院，中国科学院）；State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau（智能城市物联网国家重点实验室，澳门大学）；Manifold Tech Limited（曼陀科技有限公司）；School of Electrical Engineering and Telecommunications, the University of New South Wales（新南威尔士大学电子与电信工程学院）
Nanyang Technological University（南洋理工大学）；Singapore Institute of Manufacturing Technology（新加坡制造技术研究院）；York University（约克大学）
Unmanned aerial vehicles (UAVs), also known as drones, have emerged as a promising mode of fast, energy-efficient, and cost-effective package delivery. A considerable number of works have studied different aspects of drone package delivery service by a supplier, one of which is delivery planning. However, existing works addressing the planning issues consider a simple case of perfect delivery without service interruption, e.g., due to accident which is common and realistic. Therefore, this paper introduces the joint ground and aerial delivery service optimization and planning (GADOP) framework…
Monash University（莫纳什大学）；Turning Point, Eastern Health Clinical School, Monash University（莫纳什大学东方健康临床学院Turning Point）
Emergency Medical Services (EMS) demand load has become a considerable burden for many government authorities, and EMS demand is often an early indicator for stress in communities, a warning sign of emerging problems. In this paper, we introduce Deep Planning and Policy Making Net (DeepPPMNet), a Long Short-Term Memory network based, global forecasting and inference framework to forecast the EMS demand, analyse causal relationships, and perform `what-if' analyses for policy-making across multiple local government areas. Unless traditional univariate forecasting techniques, the proposed method …
