arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.05488cs.AIcs.ITmath.IT
收藏

面向可解释人工智能的MCTS结构与约简

Structure and Reduction of MCTS for Explainable-AI

General Motors, Technical Center Israel(通用汽车以色列技术中心);School of Business Administration, The Hebrew University(希伯来大学工商管理学院)

Ronit Bustin, Claudia V. Goldman

AI总结:

该研究聚焦蒙特卡洛树搜索(MCTS)的可解释性,提出基于信息论的MCTS约简与信息提取新方法,可在低额外成本下生成人类可理解的决策解释,为序贯决策规划算法的可解释性提供理论与算法支撑。

摘要:

涵盖无限状态空间的复杂序贯决策规划问题已被证明可通过AlphaZero类算法求解。这类在利用蒙特卡洛树搜索(Monte Carlo Tree Search,MCTS)算法模拟未来推演的同时训练神经模型的方法,已被证实可应用于现实规划问题。因此,与最终行为策略交互的工程师和用户,可从获取这些规划器离线或在线决策的自动化解释中获益。本文聚焦蒙特卡洛树搜索数据结构内的信息,就其构建方式而言,这些信息包含了序贯决策算法的大部分推理过程,对其可解释性至关重要。我们提出了利用信息论工具简化和约简蒙特卡洛树搜索并提取信息的新方法,这类信息可直接用于构建人类可理解的解释。我们证明,作为蒙特卡洛树搜索构建过程的集成部分,基础可解释性指标可在有限额外计算成本下计算得到。本文聚焦理论与算法层面,并提供了示例说明所提方法如何用于构建人类可理解的解释。

英文摘要:

Complex sequential decision-making planning problems, covering infinite states' space have been shown to be solvable by AlphaZero type of algorithms. Such an approach that trains a neural model while simulating projection of futures with a Monte Carlo Tree Search algorithm were shown to be applicable to real life planning problems. As such, engineers and users interacting with the resulting policy of behavior might benefit from obtaining automated explanations about these planners' decisions offline or online. This paper focuses on the information within the Monte Carlo Tree Search data structure. Given its construction, this information contains much of the reasoning of the sequential decision-making algorithm and is essential for its explainability. We show novel methods using information theoretic tools for the simplification and reduction of the Monte Carlo Tree Search and the extraction of information. Such information can be directly used for the construction of human understandable explanations. We show that basic explainability quantities can be calculated with limited additional computational cost, as an integrated part of the Monte Carlo Tree Search construction process. We focus on the theoretical and algorithmic aspects and provide examples of how the methods presented here can be used in the construction of human understandable explanations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑