arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.00366cs.SEcs.CY
收藏

如何评价可解释性?--三个标准的案例

How to Evaluate Explainability? -- A Case for Three Criteria

Timo Speith

摘要:

软件系统日益复杂,软件支持的决策对我们社会的影响越来越大,这引发了对安全、可靠和公平的软件的需求。可解释性被认为是实现这些品质的一种手段。它被认为是一种新兴的非功能需求(NFR),对系统质量有重大影响。然而,为了开发可解释的系统,我们需要了解系统何时满足NFR。为此,需要适当的评价方法。然而,该领域充斥着各种评价方法,对于哪些是“正确的”方法没有达成共识。更不用说,甚至没有就应该评估哪些标准达成一致。在这篇愿景论文中,我们将为系统应该提供的三个质量标准提供多学科的动机:可理解性,保真度和可评估性。我们的目的是推动关于这些标准的讨论,以便为它们设想适当的评价方法。

英文摘要:

The increasing complexity of software systems and the influence of software-supported decisions in our society have sparked the need for software that is safe, reliable, and fair. Explainability has been identified as a means to achieve these qualities. It is recognized as an emerging non-functional requirement (NFR) that has a significant impact on system quality. However, in order to develop explainable systems, we need to understand when a system satisfies this NFR. To this end, appropriate evaluation methods are required. However, the field is crowded with evaluation methods, and there is no consensus on which are the "right" ones. Much less, there is not even agreement on which criteria should be evaluated. In this vision paper, we will provide a multidisciplinary motivation for three such quality criteria concerning the information that systems should provide: comprehensibility, fidelity, and assessability. Our aim is to to fuel the discussion regarding these criteria, such that adequate evaluation methods for them will be conceived.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑