工具使用LLM代理中的信息保真度:模型上下文协议的鞅分析
Information Fidelity in Tool-Using LLM Agents: A Martingale Analysis of the Model Context Protocol
AI总结:
本文提出了一种分析模型上下文协议中误差累积的理论框架,通过鞅分析证明误差呈现线性增长并受$O(\sqrt{T})$约束,实验验证了语义加权和周期性再定位对误差控制的有效性。
摘要:
随着基于大语言模型(LLMs)的AI代理越来越多地使用外部工具进行高风险决策,一个关键的可靠性问题浮现:误差如何在连续的工具调用中传播?我们介绍了第一个用于分析模型上下文协议(MCP)代理中误差累积的理论框架,证明累积失真呈现线性增长,并且以高概率偏离被$O(\sqrt{T})$界约束。这种集中性质确保了系统行为的可预测性,并排除了指数级失败模式。我们开发了一种结合离散事实匹配与连续语义相似度的混合失真度量指标,然后通过连续工具交互建立鞅集中界限。在Qwen2-7B、Llama-3-8B和Mistral-7B上的实验验证了我们的理论预测,显示经验失真遵循线性趋势,偏离始终在$O(\sqrt{T})$的包络内。关键发现包括:语义加权使失真减少80%,并且每9步进行一次周期性再定位即可实现误差控制。我们将这些集中保证转化为可信赖代理系统的可操作部署原则。
英文摘要:
As AI agents powered by large language models (LLMs) increasingly use external tools for high-stakes decisions, a critical reliability question arises: how do errors propagate across sequential tool calls? We introduce the first theoretical framework for analyzing error accumulation in Model Context Protocol (MCP) agents, proving that cumulative distortion exhibits linear growth and high-probability deviations bounded by $O(\sqrt{T})$. This concentration property ensures predictable system behavior and rules out exponential failure modes. We develop a hybrid distortion metric combining discrete fact matching with continuous semantic similarity, then establish martingale concentration bounds on error propagation through sequential tool interactions. Experiments across Qwen2-7B, Llama-3-8B, and Mistral-7B validate our theoretical predictions, showing empirical distortion tracks the linear trend with deviations consistently within $O(\sqrt{T})$ envelopes. Key findings include: semantic weighting reduces distortion by 80\%, and periodic re-grounding approximately every 9 steps suffices for error control. We translate these concentration guarantees into actionable deployment principles for trustworthy agent systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。