arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.02034cs.AI
收藏

多代理生成AI工作流的约束过程图

Constrained Process Maps for Multi-Agent Generative AI Workflows

Ananya Joshi, Michael Rudow

AI总结:

本研究提出了一种基于有限时间跨度马尔可夫决策过程的多代理系统,用于提升多步骤工作流中处理不确定性和协调的能力,通过案例研究验证了其在提高准确性和减少人工审查方面的显著效果。

摘要:

基于大型语言模型(LLM)的代理越来越多地用于在受监管的环境中执行复杂、多步骤的工作流程,如合规性和尽职调查。然而,许多代理架构主要依赖于单个代理的提示工程,使得难以观察或比较模型在互联决策阶段和人类监督下处理不确定性和协调的能力。我们引入了一个多代理系统,形式化为具有有向无环结构的有限时间跨度马尔可夫决策过程(MDP)。每个代理对应于特定的角色或决策阶段(例如合规工作流中的内容、业务或法律审查),具有预定义的转换表示任务升级或完成。通过蒙特卡洛估计在代理层面量化知识不确定性,而系统层面的不确定性则通过MDP在自动标记状态或人工审查状态中终止来捕捉。我们通过人工智能安全评估中的自我伤害检测案例研究来说明该方法,实现为一个多代理合规系统。结果表明,与单代理基线相比,该方法在准确性、所需人工审查减少和处理时间方面均有显著提升,包括准确性提高高达19%,所需人工审查减少高达85倍,以及在某些配置中处理时间减少。

英文摘要:

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a single agent, making it difficult to observe or compare how models handle uncertainty and coordination across interconnected decision stages and with human oversight. We introduce a multi-agent system formalized as a finite-horizon Markov Decision Process (MDP) with a directed acyclic structure. Each agent corresponds to a specific role or decision stage (e.g., content, business, or legal review in a compliance workflow), with predefined transitions representing task escalation or completion. Epistemic uncertainty is quantified at the agent level using Monte Carlo estimation, while system-level uncertainty is captured by the MDP's termination in either an automated labeled state or a human-review state. We illustrate the approach through a case study in AI safety evaluation for self-harm detection, implemented as a multi-agent compliance system. Results demonstrate improvements over a single-agent baseline, including up to a 19\% increase in accuracy, up to an 85x reduction in required human review, and, in some configurations, reduced processing time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑