arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.20003cs.CL
收藏

生成XAI叙述的代理方法

An Agentic Approach to Generating XAI-Narratives

University of Antwerp(安特卫普大学)

Yifan He, David Martens

AI总结:

本文提出多代理框架生成和优化XAI叙述,通过多个批评代理反馈改进叙述的忠实性和连贯性。实验显示基本设计、批评设计和批评规则设计有效提升叙述忠实度,Claude-4.5-Sonnet在三次迭代后减少90%不忠实叙述。

摘要:

可解释人工智能(XAI)研究近年来取得了显著进展。然而,现有XAI方法因技术性和专家导向而受到批评,推动了更可解释和可访问的解释发展。为此,提出了基于大语言模型(LLM)生成XAI叙述的方法,将事后解释转化为更易懂的自然语言解释。本文提出一个多代理框架用于XAI叙述生成和优化。该框架包括Narrator,根据多个Critic Agents对忠实性和连贯性指标的反馈生成和修订叙述,从而通过迭代实现叙述改进。我们设计了五个代理系统(基本设计、批评设计、批评规则设计、连贯设计和连贯规则设计),并在五个LLM上五个表格数据集上系统评估其有效性。结果验证基本设计、批评设计和批评规则设计在所有LLM上有效提高叙述的忠实度。Claude-4.5-Sonnet在基本设计上表现最佳,在三次迭代后将不忠实叙述减少90%。为解决反复问题,我们进一步引入基于多数投票的集成策略。该方法对四个LLM性能提升显著,除了DeepSeek-V3.2-Exp。这些发现突显了代理系统生成忠实和连贯XAI叙述的潜力。

英文摘要:

Explainable AI (XAI) research has experienced substantial growth in recent years. Existing XAI methods, however, have been criticized for being technical and expert-oriented, motivating the development of more interpretable and accessible explanations. In response, large language model (LLM)-generated XAI narratives have been proposed as a promising approach for translating post-hoc explanations into more accessible, natural-language explanations. In this work, we propose a multi-agent framework for XAI narrative generation and refinement. The framework comprises the Narrator, which generates and revises narratives based on feedback from multiple Critic Agents on faithfulness and coherence metrics, thereby enabling narrative improvement through iteration. We design five agentic systems (Basic Design, Critic Design, Critic-Rule Design, Coherent Design, and Coherent-Rule Design) and systematically evaluate their effectiveness across five LLMs on five tabular datasets. Results validate that the Basic Design, the Critic Design, and the Critic-Rule Design are effective in improving the faithfulness of narratives across all LLMs. Claude-4.5-Sonnet on Basic Design performs best, reducing the number of unfaithful narratives by 90% after three rounds of iteration. To address recurrent issues, we further introduce an ensemble strategy based on majority voting. This approach consistently enhances performance for four LLMs, except for DeepSeek-V3.2-Exp. These findings highlight the potential of agentic systems to produce faithful and coherent XAI narratives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑