arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.01548cs.AIcs.SE
收藏

基于图的自愈工具路由用于成本高效的LLM代理

Graph-Based Self-Healing Tool Routing for Cost-Efficient LLM Agents

Neeraj Bholani

AI总结:

Self-Healing Router通过自愈路由机制在LLM代理中实现成本高效且容错的工具使用,减少LLM调用并消除沉默故障。

摘要:

工具使用LLM代理面临可靠性与成本之间的权衡:将每个决策路由通过LLM可以提高正确性,但会带来高延迟和推理成本,而预编码的工作流图减少了成本,但在意外复合工具故障下变得脆弱。我们提出了Self-Healing Router,一种容错的编排架构,将大多数代理控制流决策视为路由而非推理。该系统结合(i)并行健康监视器,它们为运行时条件(如工具故障和风险信号)分配优先级分数,以及(ii)一个加权工具图,其中Dijkstra算法执行确定性的最短路径路由。当工具在执行中途失败时,其边会被重新加权为无穷大,并重新计算路径——产生自动恢复而无需调用LLM。LLM仅在没有可行路径时才被保留使用,从而实现目标降级或升级。先前基于图的工具使用系统(ControlLLM、ToolNet、NaviAgent)专注于工具选择和规划;我们的贡献是运行时容错,具有确定性的恢复和二进制可观测性——每个故障要么是记录的重新路由,要么是显式的升级,绝不会是沉默的跳过。在19个场景中,覆盖三种图拓扑(线性流水线、依赖DAG、并行扇出),Self-Healing Router在正确性上与ReAct相当,同时将控制平面LLM调用减少93%(9 vs 123汇总),并消除了在复合故障下观察到的静态工作流基线中的沉默故障情况。

英文摘要:

Tool-using LLM agents face a reliability-cost tradeoff: routing every decision through the LLM improves correctness but incurs high latency and inference cost, while pre-coded workflow graphs reduce cost but become brittle under unanticipated compound tool failures. We present Self-Healing Router, a fault-tolerant orchestration architecture that treats most agent control-flow decisions as routing rather than reasoning. The system combines (i) parallel health monitors that assign priority scores to runtime conditions such as tool outages and risk signals, and (ii) a cost-weighted tool graph where Dijkstra's algorithm performs deterministic shortest-path routing. When a tool fails mid-execution, its edges are reweighted to infinity and the path is recomputed -- yielding automatic recovery without invoking the LLM. The LLM is reserved exclusively for cases where no feasible path exists, enabling goal demotion or escalation. Prior graph-based tool-use systems (ControlLLM, ToolNet, NaviAgent) focus on tool selection and planning; our contribution is runtime fault tolerance with deterministic recovery and binary observability -- every failure is either a logged reroute or an explicit escalation, never a silent skip. Across 19 scenarios spanning three graph topologies (linear pipeline, dependency DAG, parallel fan-out), Self-Healing Router matches ReAct's correctness while reducing control-plane LLM calls by 93% (9 vs 123 aggregate) and eliminating the silent-failure cases observed in a well-engineered static workflow baseline under compound failures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑