arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.19320cs.CLcs.AI
收藏

代理记忆的解剖结构:评估和系统限制的分类与实证分析

Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations

University of Texas at Dallas(德克萨斯大学达拉斯分校);University of California Davis(加州大学戴维斯分校);Texas A&M University(德克萨斯农工大学)

Dongming Jiang, Yi Li, Songtao Wei, Jinxin Yang, Ayushi Kishore, Alysa Zhao, Dingyi Kang, Xu Hu, Feng Chen, Qiannan Li, Bingzhe Li

AI总结:

本文通过分类和实证分析,探讨了代理记忆系统的架构和系统限制,揭示了现有系统在基准饱和效应、指标有效性、模型依赖性和内存维护开销等方面的问题,并提出了更可靠的评估方法和可扩展的系统设计方向。

摘要:

代理记忆系统使大型语言模型(LLM)代理能够在长时间交互中保持状态,支持超出固定上下文窗口的长周期推理和个性化。尽管架构发展迅速,这些系统的实证基础仍脆弱:现有基准通常规模不足,评估指标与语义效用不一致,性能在基础模型上变化显著,且系统层面的成本常被忽视。本文从架构和系统角度对代理记忆进行了结构化分析。我们首先基于四种记忆结构介绍了MAG系统简要分类。然后,我们分析了限制当前系统的关键痛点,包括基准饱和效应、指标有效性和判断敏感性、基础模型依赖的准确性,以及内存维护引入的延迟和吞吐量开销。通过将内存结构与实证限制联系起来,本文阐明了当前代理记忆系统为何经常无法达到其理论承诺,并概述了更可靠评估和可扩展系统设计的方向。

英文摘要:

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the empirical foundations of these systems remain fragile: existing benchmarks are often underscaled, evaluation metrics are misaligned with semantic utility, performance varies significantly across backbone models, and system-level costs are frequently overlooked. This survey presents a structured analysis of agentic memory from both architectural and system perspectives. We first introduce a concise taxonomy of MAG systems based on four memory structures. Then, we analyze key pain points limiting current systems, including benchmark saturation effects, metric validity and judge sensitivity, backbone-dependent accuracy, and the latency and throughput overhead introduced by memory maintenance. By connecting the memory structure to empirical limitations, this survey clarifies why current agentic memory systems often underperform their theoretical promise and outlines directions for more reliable evaluation and scalable system design.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑