arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.02552cs.AIcs.CL
收藏

从黑盒到对话:将XAI融入对话代理

From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent

University of Marburg(马尔堡大学);University of Duisburg-Essen(杜伊斯堡-埃森大学);University of Mannheim(曼海姆大学)

Van Bach Nguyen, Jörg Schlötterer, Christin Seifert

AI总结:

本研究将XAI融入包含自然语言理解与生成组件的对话代理,通过扩展XAI问题库理解用户需求,并系统调研文献提供对应的解释方法清单,以实现关于机器学习模型的自然对话。

摘要:

可解释AI(XAI)的目标是设计方法以洞察深度神经网络等黑盒模型的推理过程,从而向人类进行解释。社会科学研究指出,此类解释应当是对话式的,类似于人与人之间的解释。在本研究中,我们展示了如何使用包含自然语言理解与生成组件的标准代理设计,将XAI融入对话代理中。我们基于一个XAI问题库,通过质量控制的释义对其进行扩展,以理解用户的信息需求。我们进一步系统地调研文献,寻找能够提供信息以回答这些问题的合适解释方法,并给出一份全面的建议清单。我们的工作是迈向与解释代理进行关于机器学习模型真正自然对话的第一步。全面的XAI问题及相应解释方法清单可支持其他研究人员提供必要信息以满足用户需求。为促进未来研究,我们发布了源代码和数据。

英文摘要:

The goal of Explainable AI (XAI) is to design methods to provide insights into the reasoning process of black-box models, such as deep neural networks, in order to explain them to humans. Social science research states that such explanations should be conversational, similar to human-to-human explanations. In this work, we show how to incorporate XAI in a conversational agent, using a standard design for the agent comprising natural language understanding and generation components. We build upon an XAI question bank, which we extend by quality-controlled paraphrases, to understand the user's information needs. We further systematically survey the literature for suitable explanation methods that provide the information to answer those questions, and present a comprehensive list of suggestions. Our work is the first step towards truly natural conversations about machine learning models with an explanation agent. The comprehensive list of XAI questions and the corresponding explanation methods may support other researchers in providing the necessary information to address users' demands. To facilitate future work, we release our source code and data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑