通过代理行为分层总结实现基于大语言模型的多代理系统交互诊断:DiLLS
DiLLS: Interactive Diagnosis of LLM-based Multi-agent Systems via Layered Summary of Agent Behaviors
AI总结:
DiLLS通过多层行为总结,帮助开发者更高效地诊断和理解基于LLM的多代理系统故障。
摘要:
基于大语言模型(LLM)的多代理系统在处理复杂任务方面表现出色。然而,代理行为的复杂性使得这些系统难以理解。当发生故障时,开发者往往难以确定根本原因并确定改进的可行路径。传统方法依赖于检查原始日志记录,但鉴于数据量大且复杂,效率低下。为了解决这一挑战,我们提出了一种框架和交互系统DiLLS,旨在揭示和组织多代理系统的的行为。关键思想是通过三个层次的查询完成来组织信息:活动、动作和操作。通过自然语言探测多代理系统,DiLLS推导并组织计划和执行信息,形成结构化的多层总结。通过用户研究,我们证明DiLLS显著提高了开发者在识别、诊断和理解LLM多代理系统故障时的有效性和效率。
英文摘要:
Large language model (LLM)-based multi-agent systems have demonstrated impressive capabilities in handling complex tasks. However, the complexity of agentic behaviors makes these systems difficult to understand. When failures occur, developers often struggle to identify root causes and to determine actionable paths for improvement. Traditional methods that rely on inspecting raw log records are inefficient, given both the large volume and complexity of data. To address this challenge, we propose a framework and an interactive system, DiLLS, designed to reveal and structure the behaviors of multi-agent systems. The key idea is to organize information across three levels of query completion: activities, actions, and operations. By probing the multi-agent system through natural language, DiLLS derives and organizes information about planning and execution into a structured, multi-layered summary. Through a user study, we show that DiLLS significantly improves developers' effectiveness and efficiency in identifying, diagnosing, and understanding failures in LLM-based multi-agent systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。