复现LightMem：朴素检索增强生成（Naive RAG）在记忆管理上效果相当
Reproducing LightMem: Naive RAG Is Just as Good for Memory Management
AI总结：
本研究复现轻量记忆管理方法LightMem，对比发现其效果取决于检索器和令牌预算，直接从原始用户回合检索的Naive RAG在匹配深度时表现更优，LightMem仅在严格令牌预算下占优，并非通用更好的记忆管理方案。
AI中文摘要：
长期对话智能体需要访问早期交互的信息，如用户偏好、过往请求或之前提及的事实。随着对话增长，重复提供完整对话历史成本高昂，因此许多记忆方法会将过往交互转换为可按需检索的紧凑条目。LightMem是一种近期的轻量记忆管理方法，在保持较低构建成本的同时表现出较强的有效性，但它仍依赖单独构建的记忆表示，且仅用一个检索器进行评估，其结果对检索器选择的敏感性、记忆构建是否丢弃答案相关信息尚不明确。本研究复现LightMem并将其与直接从原始用户回合检索的Naive RAG对比，复现了LightMem的主要配置趋势，但发现检索器选择是性能变化的主要来源：在固定LightMem存储上仅更换检索器，答案准确率从58.1%变为75.5%；构建的记忆也并非始终优于原始回合检索，匹配检索深度时Naive RAG通常表现更好，而LightMem主要在严格的回答令牌预算下表现更佳；最优（Oracle）评估进一步显示，记忆构建会去除部分答案相关信息。总体而言，LightMem提供的是上下文效率权衡，而非相对于Naive RAG的通用优势，其价值取决于检索器和可用令牌预算，这推动了未来在检索、重排序、查询表述及其与原始和构建记忆表示的交互方面的研究。
英文摘要：
Long-term conversational agents require access to information from earlier interactions, such as a user's preferences, past requests, or previously mentioned facts. Repeatedly providing the full dialogue history can be expensive as conversations grow, so many memory approaches instead transform past interactions into compact entries that can be retrieved when needed. LightMem is a recent lightweight memory-management approach that reports strong effectiveness while maintaining relatively low construction cost. However, it still relies on a separate constructed memory representation and is evaluated with only one retriever, leaving unclear how sensitive its results are to retriever choice and whether memory construction discards answer-relevant information. In this study, we reproduce LightMem and compare it with Naive RAG, which retrieves directly from raw user turns. We recover LightMem's main configuration trend, but find that retriever choice is a major source of performance variation: changing only the retriever over a fixed LightMem store shifts answer accuracy from 58.1% to 75.5%. Constructed memories also do not consistently outperform raw-turn retrieval. Naive RAG generally performs better at matched retrieval depths, whereas LightMem performs better mainly under tight answering-token budgets. Oracle evaluation further shows that memory construction removes some answer-relevant information. Overall, LightMem offers a context-efficiency trade-off rather than a general advantage over Naive RAG. Its value depends on the retriever and available token budget, motivating future work on retrieval, reranking, query formulation, and their interaction with raw and constructed memory representations.
