arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.13323cs.AI
收藏

对比解释的BDI代理

Contrastive explanations of BDI agents

Victoria University of Wellington(惠灵顿维多利亚大学)

Michael Winikoff

AI总结:

本文提出对比性解释方法,用于BDI代理回答为何选择动作X而非其他动作F的问题,并评估其在提升信任和透明性方面的有效性。

摘要:

自主系统提供解释的能力对于支持透明性和促进(适当)信任的发展至关重要。先前的工作定义了一种机制,使Belief-Desire-Intention(BDI)代理能够回答“为什么你执行动作X?”类的问题。然而,我们知道我们问的是对比性问题(“为什么你执行X而不是F?”)。因此,我们扩展了先前的工作,使其能够回答此类问题。计算评估显示,使用对比性问题可显著减少解释长度。进行了一项人类受试者评估,以评估此类对比性回答是否更受欢迎,以及它们如何支持信任的发展和透明性。我们发现了一些证据表明对比性回答更受欢迎,以及它们导致更高的信任、感知理解和对系统正确性的信心。我们还评估了提供解释的益处。令人惊讶的是,没有明显的益处,并在某些情况下发现提供完整解释比不提供任何解释更差。

英文摘要:

The ability of autonomous systems to provide explanations is important for supporting transparency and aiding the development of (appropriate) trust. Prior work has defined a mechanism for Belief-Desire-Intention (BDI) agents to be able to answer questions of the form ``why did you do action $X$?''. However, we know that we ask \emph{contrastive} questions (``why did you do $X$ \emph{instead of} $F$?''). We therefore extend previous work to be able to answer such questions. A computational evaluation shows that using contrastive questions yields a significant reduction in explanation length. A human subject evaluation was conducted to assess whether such contrastive answers are preferred, and how well they support trust development and transparency. We found some evidence for contrastive answers being preferred, and some evidence that they led to higher trust, perceived understanding, and confidence in the system's correctness. We also evaluated the benefit of providing explanations at all. Surprisingly, there was not a clear benefit, and in some situations we found evidence that providing a (full) explanation was worse than not providing any explanation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑