Lightweight LLM Agent Memory with Small Language Models
University of Electronic Science and Technology of China(电子科学与技术大学);Kyung Hee University(庆熙大学);City University of Hong Kong(香港城市大学);University of Oxford(牛津大学)
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen, Zhenzhen Huang, Pengcheng Zheng, Zhicheng Wang, Ping Guo, Fan Mo, Sung-Ho Bae, Jie Zou, Jiwei Wei, Yang Yang
Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low online overhead but suffer from unstable accuracy due to limited query construction and candidate filtering. In contrast, many systems use repeated large-model calls for online memory operations, improving accuracy but accumulating latency over long interactions. We propose LightMem, a lightweight memory system for better agent memory driven by Small Language Models (SLMs). LightMem modularizes memory retrieval, writing, and long-term consolidation, and separates online processing from offline consolidation to enable efficient memory invocation under bounded compute. We organize memory into short-term memory (STM) for immediate conversational context, mid-term memory (MTM) for reusable interaction summaries, and long-term memory (LTM) for consolidated knowledge, and uses user identifiers to support independent retrieval and incremental maintenance in multi-user settings. Online, LightMem operates under a fixed retrieval budget and selects memories via a two-stage procedure: vector-based coarse retrieval followed by semantic consistency re-ranking. Offline, it abstracts reusable interaction evidence and incrementally integrates it into LTM. Experiments show consistent gains across model scales, with an average F1 improvement of about 2.5 over A-MEM on LoCoMo, while achieving higher efficiency and low median latency (83 ms for retrieval and 581 ms end-to-end).
A Lightweight Modular Framework for Constructing Autonomous Agents Driven by Large Language Models: Design, Implementation, and Applications in AgentForge
Towards Scalable Lightweight GUI Agents via Multi-role Orchestration
Zhejiang Key Laboratory of Accessible Perception and Intelligent Systems, Zhejiang University(浙江可及感知与智能系统重点实验室,浙江大学);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);AntGroup(蚂蚁集团)
A collaborative agent with two lightweight synergistic models for autonomous crystal materials research
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Institute for Advanced Study, Chengdu University(成都大学高等研究院);Key Laboratory of Cyberspace Big Data Intelligent Security, Ministry of Education, Chongqing University of Posts and Telecommunications(重庆邮电大学教育部网络空间大数据智能安全重点实验室)
Graph-based Agent Memory: Taxonomy, Techniques, and Applications
The Hong Kong Polytechnic University(香港理工大学);School of Information(信息学院);Xiamen University(厦门大学);School of Computing and Information Systems(计算与信息学院);Singapore Management University(新加坡国立管理学院);School of Artificial Intelligence(人工智能学院)
MedFG-VQA: Low-Frequency Memory and Graph Attention for Lightweight Medical VQA
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);State Key Laboratory of Intelligent Manufacturing of Advanced Construction Machinery(高端工程机械智能制造国家重点实验室);Department of Electrical and Computer Engineering, Sungkyunkwan University(成均馆大学电气与计算机工程系);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院)
Towards Effective Offensive Security LLM Agents: Hyperparameter Tuning, LLM as a Judge, and a Lightweight CTF Benchmark
New York University(纽约大学);New York University Abu Dhabi(纽约大学阿布扎比分校);Indian Institute of Technology Kanpur(印度理工学院坎普尔分校);International Institute of Information Technology Hyderabad(国际信息技术学院海得拉巴分校)
LightMem: Lightweight and Efficient Memory-Augmented Generation
Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);State Key Lab. for Novel Software Technology, Nanjing University, P.R. China(南京大学软件新技术国家重点实验室,中国)
SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents
National University of Defense Technology(国防科技大学);University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);Zhejiang University(浙江大学)
Choosing How to Remember: Adaptive Memory Structures for LLM Agents
University of Technology Sydney(悉尼大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);University of California, Los Angeles(加州大学洛杉矶分校);The University of Melbourne(墨尔本大学)
AgentGate: A Lightweight Structured Routing Engine for the Internet of Agents
School of Artificial Intelligence, University of Science and Technology Beijing(北京科技大学人工智能学院);China Telecom Research Institute(中国电信研究院);Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences(中国科学院大学杭州高等研究院)
MetaCaster: Meta-Harness-Optimized Agent for End-to-End Few-Shot Learning of Lightweight Time Series Forecasters
University of Houston(休斯顿大学);NEC Labs(NEC实验室);University of Waterloo(滑铁卢大学);University of Connecticut(康涅狄格大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Singapore Management University(新加坡管理大学)
MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents
Department of Computer Science, The University of Texas at Dallas(德克萨斯大学达拉斯分校计算机科学系);Department of Electrical and Computer Engineering, University of Florida(佛罗里达大学电气与计算机工程系)
Beyond Similarity: Trustworthy Memory Search for Personal AI Agents
University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);University of California, Berkeley(加州大学伯克利分校)
SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memory
Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学校);School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学校)