arXivDaily arXiv每日学术速递 周一至周五更新
稍安勿躁,官方尚未更新
arXiv 2606.03467cs.AI
收藏

StepFinder:多智能体系统中故障归因的时间语义框架

StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems

Peking University(北京大学)

Taiyu Zhu, Yifan Wu, Weilin Jin, Ying Li, Gang Huang

AI总结:

提出StepFinder框架,通过将执行日志编码为时间语义序列并利用时序建模与注意力模块,高效准确地定位多智能体系统中的故障根因步骤。

摘要:

基于LLM的多智能体系统在复杂多步骤任务中展现出显著的协作能力。然而,这些系统对单步执行错误高度敏感,错误会通过智能体交互传播并导致级联故障。为理解故障原因并提高系统可靠性,故障归因被引入作为一项任务,旨在自动识别导致故障的根因步骤。现有故障归因方法主要依赖LLM对原始执行轨迹进行推理,这不仅导致高推理成本和延迟,还受到冗余和噪声执行日志的干扰,使LLM难以准确识别真正的根因步骤。为此,我们提出StepFinder,一个轻量级故障归因框架。我们仅在特征构建阶段使用LLM将执行日志编码为时间语义序列。随后,应用参数高效的时序建模与注意力模块组合来捕捉轨迹的序列演化与跨步骤依赖。最后,通过多尺度差异和位置偏差细化步骤级错误分数,实现精确的根因识别。在Who&When基准上的实验结果表明,StepFinder在步骤级故障归因上优于基于LLM的方法,同时实现了显著更高的推理效率,与最快的基于LLM的方法相比,推理时间减少79%,且无文本生成开销。我们的代码可从此https URL获取。

英文摘要:

LLM-based multi-agent systems exhibit remarkable collaborative capabilities in complex multi-step tasks. However, these systems are highly sensitive to single-step execution errors that can propagate through agent interactions and lead to cascading failures. To understand the causes of failure and improve system reliability, failure attribution has been introduced as a task that aims to automatically identify the root cause step responsible for a failure. Existing failure attribution methods mainly rely on LLMs to reason over original execution trajectories, which not only incur high inference costs and latency, but also suffer from interference caused by redundant and noisy execution logs, causing LLMs to struggle in accurately identifying the true root cause step. To address this, we propose StepFinder, a lightweight failure attribution framework. We use LLMs solely during the feature construction phase to encode execution logs into temporal semantic sequences. Subsequently, a parameter-efficient combination of temporal modeling and attention modules is applied to capture the sequential evolution and cross-step dependencies of the trajectories. Finally, the step-level error score is refined through multi-scale differences and position bias, enabling precise root cause identification. Experimental results on the Who&When benchmark demonstrate that StepFinder outperforms LLM-based methods in step-level failure attribution while achieving substantially higher inference efficiency, reducing inference time by 79% compared with the fastest LLM-based method, with no text generation overhead. Our code is available at https://github.com/taiyu-zhu/StepFinder.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑