arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03224cs.AIcs.LG
收藏

TAME: 一种可信的智能体记忆测试时演化与系统化基准测试

TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarking

East China Normal University(东华师范大学);Shanghai Innovation Institute(上海创新研究院);Shanghai Key Laboratory of Computer Software Evaluating and Testing(上海计算机软件评测与测试重点实验室);Huawei Noah’s Ark Lab(华为诺亚实验室)

Yu Cheng, Yongkang Hu, Jiuan Zhou, Yushuo Zhang, Yihang Chen, Huichi Zhou, Mingang Chen, Zhizhong Zhang, Kun Shao, Yuan Xie, Zhaoxia Yin

AI总结:

提出TAME框架,通过执行器-评估器循环实现记忆的可信演化,解决良性任务演化中智能体可信度下降问题,在GPT-5.2 AIME上准确率提升14.6个百分点。

摘要:

智能体记忆的测试时演化代表了推进AGI的关键范式,因为它通过经验积累增强复杂推理,而无需参数更新。然而,即使在良性任务演化过程中,智能体的安全对齐仍然脆弱,这种现象被称为智能体记忆误演化。为了评估这一现象,我们构建了Trust-Memevo基准测试,并发现智能体在良性任务演化过程中,多个任务的可信度整体下降。为了解决这个问题,我们提出了TAME,一个可信感知的记忆演化框架,其中共享记忆库由执行器和评估器共同管理。执行器检索并应用可迁移经验以支持任务求解,而评估器评估每个使用经验对结果的贡献,并产生可信感知的反馈以指导后续记忆使用。这种执行器-评估器循环使得记忆能够随时间被选择性强化、谨慎重用和持续扩展。实验表明,TAME在实现强任务性能的同时缓解了记忆误演化。特别是在GPT-5.2 AIME基准测试上,TAME相比现有最强方法准确率提高了14.6个百分点,并保持了有竞争力的可信度。

英文摘要:

Test-time evolution of agent memory represents a pivotal paradigm for advancing AGI, as it strengthens complex reasoning through experience accumulation without requiring parameter updates. However, even during benign task evolution, agent safety alignment remains vulnerable, a phenomenon known as Agent Memory Misevolution. To evaluate this phenomenon, we construct the Trust-Memevo benchmark and find that agents exhibit an overall decline in trustworthiness across multiple tasks during benign task evolution. To address this issue, we propose TAME, a trust-aware memory evolution framework in which a shared memory bank is jointly governed by an Executor and an Evaluator. The Executor retrieves and applies transferable experiences to support task solving, while the Evaluator assesses the contribution of each utilized experience to the outcome and produces trust-aware feedback to guide subsequent memory use. This executor-evaluator loop enables memory to be selectively reinforced, cautiously reused, and continuously expanded over time. Experiments show that TAME mitigates memory misevolution while achieving strong task performance. In particular, on the GPT-5.2 AIME benchmark, TAME improves accuracy by 14.6 percentage points over the strongest existing method and maintains competitive trustworthiness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑