arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03374cs.RO
收藏

eMEM:一种面向具身智能体的混合时空记忆系统

eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents

Automatika Robotics(Automatika机器人公司);Inria(法国国家信息与自动化研究所)

A. Haroon Rasheed, Maria Kabtoul

AI总结:

提出eMEM混合图记忆系统,通过多索引架构和分层整合管道实现具身智能体在空间、时间和语义上的高效记忆检索,并在ProcTHOR-10K基准测试中达到80.8加权平均分。

摘要:

我们提出eMEM(具身记忆),一种基于混合图的记忆系统,用于在物理环境中运行的具身智能体。当前的智能体记忆架构,如Generative Agents、MemGPT和A-MEM,将记忆视为文本流或知识图谱,但具身智能体需要同时能够按意义、空间和时间进行搜索的记忆。eMEM通过一个统一在单一图模型背后的多索引架构(用于结构化存储的SQLite、用于近似最近邻语义搜索的hnswlib以及用于空间查询的R-tree)填补了这一空白。一个分层整合管道将原始感知观察转化为压缩摘要,模仿生物系统中海马体-新皮层的整合。十个面向智能体的回忆工具暴露了记忆检索原语,包括概念到位置的解析和跨层回忆,作为LLM工具调用的第一类操作。该系统完全嵌入式,与智能体在同一进程中运行。此外,我们引入了eMEM-Bench v1,这是一个我们在ProcTHOR-10K场景上构建的用于具身记忆评估的基准。该基准明确围绕八个认知心理学范式(DRM诱饵、模式分离、模式完成、源监控、上下文依赖检索、长时程干扰、序列位置和增强保留曲线)组织,每个范式都经过选择,使得结果能够对照人类和先前智能体记忆系统的更广泛记忆系统文献进行解释;这是像LoCoMo或OpenEQA这样的表面任务基准无法提供的诊断水平。eMEM在988个探针上获得80.8加权平均分,在模拟延迟从1小时到1年的房间独特项目上保持平稳的保留曲线。我们表明,纯RAG基线(flat_rag消融)在上下文依赖检索上损失30分,在DRM诱饵拒绝上损失29分,分别隔离了多层存储和整合的贡献。我们发布了系统和基准代码。

英文摘要:

We present eMEM (Embodied Memory), a hybrid graph-based memory system for embodied agents operating in physical environments. Current agent memory architectures, such as Generative Agents, MemGPT, and A-MEM, treat memory as text streams or knowledge graphs, but embodied agents require memory that is simultaneously searchable by meaning, space, and time. eMEM fills this gap with a multi-index architecture (SQLITE for structured storage, hnswlib for approximate nearest neighbour semantic search, and an R-tree for spatial queries) unified behind a single graph model. A tiered consolidation pipeline transforms raw perceptual observations into compressed summaries, mirroring hippocampal-neocortical consolidation in biological systems. Ten agent-facing recall tools expose memory retrieval primitives, including concept-to-location resolution and cross layer recall, as first-class operations for LLM tool calling. The system is fully embedded and runs in-process alongside the agent. In addition we introduce eMEM-Bench v1, a benchmark we construct over ProcTHOR-10K scenes for embodied memory evaluation. The benchmark is organised explicitly around eight cognitive-psychology paradigms (DRM lures, pattern separation, pattern completion, source monitoring, context-dependent retrieval, long-horizon interference, serial position, and a foil augmented retention curve), each chosen so that the result is interpretable against the broader memory-systems literature in humans and prior agent-memory systems; a level of diagnostic that surface-task benchmarks like LoCoMo or OpenEQA cannot provide. eMEM scores 80.8 weighted mean over 988 probes, with a flat retention curve at ceiling from 1 h to 1 yr of simulated delay on room-unique items. We show that a pure RAG baseline (the flat_rag ablation) loses 30 pt on context dependent retrieval and 29 pt on DRM lure rejection, isolating the contribution of multi-layer storage and consolidation respectively. We release both the system and the benchmark code.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑