UCAS-Terminus AI Lab, University of Chinese Academy of Sciences(中国科学院大学Terminus AI实验室,中国科学院大学);Centre for Artificial Intelligence and Robotics, HKISI-CAS(人工智能与机器人中心,中国科学院香港研究院);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院)
While large language model (LLM) agents have demonstrated impressive problem-solving capabilities, they typically operate as static systems, lacking the ability to evolve through lifelong interaction. Existing attempts to bridge this gap primarily rely on retrieving successful past trajectories as demonstrations. However, this paradigm faces two critical limitations. First, by focusing solely on success, agents overlook the rich pedagogical value embedded in failed attempts, preventing them from identifying and avoiding recurrent pitfalls. Second, continually accumulating textual experiences not only increases the time consumption during retrieval but also inevitably introduces noise and exhausts the largest context window of current LLMs. To address these challenges, we propose a novel self-evolving framework for LLM agents that introduces a complementary evolution mechanism: First, a contrastive reflection strategy is introduced to explicitly summarize error-prone patterns and capture reusable insights. Second, we propose a self-consolidation mechanism that distills non-parametric textual experience into compact learnable parameters. This enables the agent to internalize extensive historical experience directly into its latent space. Extensive experiments demonstrate the advantages of our method in long-term agent evolution.
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学计算机科学与工程系);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);Huawei Cloud(华为云);Huawei Theory Lab(华为理论实验室);Institute for Math and AI, Wuhan University(武汉大学数学与人工智能研究院)
Consolidation or Adaptation? PRISM: Disentangling SFT and RL Data via Gradient Concentration
Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology(哈尔滨工业大学社会计算与交互机器人研究中心);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
University of Pennsylvania(宾夕法尼亚大学);Brown University(布朗大学);Nanyang Technological University(南洋理工大学);University of Notre Dame(圣母大学);George Mason University(乔治梅森大学)
AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?
University of Chinese Academy of Sciences(中国科学院大学);Microsoft(微软公司);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Nanjing University(南京大学)
Self-Evolving Multi-Agent Network for Industrial IoT Predictive Maintenance
Department of Electronics Technology, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics(布达佩斯技术与经济大学电子技术系);DataScienceWorld;Department of Computer Science, The University of Alabama at Birmingham(阿拉巴马大学伯明翰分校计算机科学系)
Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Renmin University of China(中国人民大学);Princeton University(普林斯顿大学);Hong Kong University of Science and Technology(香港科技大学);Fudan University(复旦大学)
MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents
Nanyang Technological University(南洋理工大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Illinois Chicago(伊利诺伊大学芝加哥分校);Tsinghua University(清华大学)
HealthFlow: A Self-Evolving AI Agent with Meta Planning for Autonomous Healthcare Research
Peking University(北京大学);The University of Hong Kong(香港大学);The Hong Kong University of Science and Technology(香港科技大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)