arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.06665cs.AI
收藏

领域级可解释性--在超人AI策略中建立信任的挑战

Domain-Level Explainability -- A Challenge for Creating Trust in Superhuman AI Strategies

Aleph Alpha GmbH(Aleph Alpha有限公司);University of Duisburg-Essen(杜伊斯堡-埃森大学)

Jonas Andrulis, Ole Meyer, Grégory Schott, Samuel Weinbach, Volker Gruhn

摘要:

对于战略问题,基于深度强化学习(DRL)的智能系统已经展示了令人印象深刻的学习高级解决方案的能力,这些解决方案可以远远超出人类的能力,特别是在处理复杂场景时。虽然这为开发具有开创性功能的智能辅助系统创造了新的机会,但将这项技术应用于现实世界的问题会带来重大风险,因此需要对其透明度和可靠性的信任。由于超人的策略是非直观和复杂的定义和现实世界的情况下,禁止可靠的性能评估,在这些系统中的信任的关键组成部分是难以实现的。可解释人工智能(XAI)通过各种措施成功地提高了现代人工智能系统的透明度,然而,XAI研究尚未提供在战略情况下为专家用户提供领域级见解的方法。在本文中,我们讨论了超人的DRL为基础的战略,其属性,将其转化为现实世界的环境中的要求和挑战,并通过可解释性作为一个关键技术的信任的影响。

英文摘要:

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex scenarios. While this creates new opportunities for the development of intelligent assistance systems with groundbreaking functionalities, applying this technology to real-world problems carries significant risks and therefore requires trust in their transparency and reliability. With superhuman strategies being non-intuitive and complex by definition and real-world scenarios prohibiting a reliable performance evaluation, the key components for trust in these systems are difficult to achieve. Explainable AI (XAI) has successfully increased transparency for modern AI systems through a variety of measures, however, XAI research has not yet provided approaches enabling domain level insights for expert users in strategic situations. In this paper, we discuss the existence of superhuman DRL-based strategies, their properties, the requirements and challenges for transforming them into real-world environments, and the implications for trust through explainability as a key technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑