EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle
Zhejiang University(浙江大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);East China Normal University(华东师范大学);Fudan University(复旦大学);Central South University(中南大学);Shanghai Innovation Institute(上海创新研究院);Shanghai Jiao Tong University(上海交通大学);University of Science and Technology of China(中国科学技术大学)
Current Large Language Model (LLM) agents show strong performance in tool use, but lack the crucial capability to systematically learn from their own experiences. While existing frameworks mainly focus on mitigating external knowledge gaps, they fail to address a more fundamental limitation: the inability to iteratively refine problem-solving strategies. In this work, we introduce EvolveR, a framework designed to enable agent to self-improve through a complete, closed-loop experience lifecycle. This lifecycle comprises two key stages: (1) Offline Self-Distillation, where the agent's interaction trajectories are synthesized into a structured repository of abstract, reusable strategic principles; (2) Online Interaction, where the agent interacts with tasks and actively retrieves distilled principles to guide its decision-making, accumulating a diverse set of behavioral trajectories. This loop employs a policy reinforcement mechanism to iteratively update the agent based on its performance. We demonstrate the effectiveness of EvolveR on complex multi-hop question-answering benchmarks, where it achieves superior performance over strong agentic baselines. Our work presents a comprehensive blueprint for agents that learn not only from external data but also from the consequences of their own actions, paving the way for more autonomous and continuously improving systems. Code is available at https://github.com/Edaizi/EvolveR.
Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology(香港科技大学);University of Michigan(密歇根大学)
When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems
Ant Group(蚂蚁集团);Zhejiang University(浙江大学);Tsinghua University(清华大学);Hangzhou Dianzi University(杭州电子科技大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Xi’an Jiaotong University(西安交通大学)
Experience Makes Skillful: Enabling Generalizable Medical Agent Reasoning via Self-Evolving Skill Memory
Fudan University(复旦大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Innovation Institute(上海创新研究院);Huazhong University of Science and Technology(华中科技大学)
Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
The Pennsylvania State University(宾夕法尼亚州立大学);UC Santa Cruz(加州大学圣克鲁兹分校);Amazon(亚马逊);Emory University(埃默里大学);UIUC(伊利诺伊大学香槟分校);Northeastern University(东北大学)
AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models
Department of Software \& Microelectronics Peking University Beijing, China;Department of Software \& Microelectronics Peking University Beijing, China hangli\;Department of Software \& Microelectronics Peking University Beijing, China zehua\;Department of Software \& Microelectronics Peking University Beijing, China xiaofan\;Economic Law School China University of Political Science;School of Computer Science Peking University Beijing, China
CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University(吉林大学知识驱动人机智能工程研究中心);International Center of Future Science, Jilin University(吉林大学未来科学国际中心);Department of Informatics, King’s College London(伦敦国王学院信息学院);The Alan Turing Institute(艾伦·图灵研究所);AI Centre, Department of Computer Science, UCL(UCL计算机科学系人工智能中心)
Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution
AGI Institute, School of Computer Science, Shanghai Jiao Tong University(AGI研究院,计算机科学学院,上海交通大学);Tongyi Lab, Alibaba Group(通义实验室,阿里巴巴集团);Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering, Shanghai Jiao Tong University(上海市教育委员会智能交互与认知工程重点实验室,上海交通大学)
Advancing LLM-Based Security Automation with Customized Group Relative Policy Optimization for Zero-Touch Networks
National Engineering Research Center for Mobile Network Technologies, Beijing University of Posts and Telecommunications(移动网络技术国家工程研究中心,北京邮电大学);Beijing University of Posts and Telecommunications(北京邮电大学);Singapore University of Technology and Design(新加坡科技设计大学);Department of Electronic Engineering, Kyung Hee University(韩国庆熙大学电子工程系)
WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction
University of California, Santa Barbara(加州大学圣芭芭拉分校);J.P. Morgan Chase(摩根大通);ETH Zurich(苏黎世联邦理工学院);Stanford University(斯坦福大学);Johns Hopkins University(约翰霍普金斯大学);Carnegie Mellon University(卡内基梅隆大学)
LLM-PBE: Assessing Data Privacy in Large Language Models
University of California, Berkeley(加州大学伯克利分校);University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);National University of Singapore(新加坡国立大学);Center for AI Safety(AI安全中心);University of Chicago(芝加哥大学)
Generative AI in Cybersecurity: A Comprehensive Review of LLM Applications and Vulnerabilities
Guelma University(盖勒马大学);Technology Innovation Institute(技术创新研究院);Concordia University(康考迪亚大学);University of Oslo(奥斯陆大学);Khalifa University of Science and Technology(哈利法科技大学)