Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories, we propose HiMem, a hierarchical long-term memory framework for long-horizon dialogues, designed to support memory construction, retrieval, and dynamic updating during sustained interactions. HiMem constructs cognitively consistent Episode Memory via a Topic-Aware Event--Surprise Dual-Channel Segmentation strategy, and builds Note Memory that captures stable knowledge through a multi-stage information extraction pipeline. These two memory types are semantically linked to form a hierarchical structure that bridges concrete interaction events and abstract knowledge, enabling efficient retrieval without sacrificing information fidelity. HiMem supports both hybrid and best-effort retrieval strategies to balance accuracy and efficiency, and incorporates conflict-aware Memory Reconsolidation to revise and supplement stored knowledge based on retrieval feedback. This design enables continual memory self-evolution over long-term use. Experimental results on long-horizon dialogue benchmarks demonstrate that HiMem consistently outperforms representative baselines in accuracy, consistency, and long-term reasoning, while maintaining favorable efficiency. Overall, HiMem provides a principled and scalable design paradigm for building adaptive and self-evolving LLM-based conversational agents. The code is available at https://github.com/jojopdq/HiMem.
HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Nanjing Artificial Intelligence Research of IA(IA南京人工智能研究院)
TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents
Institute of Automation, CAS(中国科学院自动化研究所);School of Artificial Intelligence, UCAS(中国科学技术大学人工智能学院);AI Lab, AIGility Cloud Innovation(AIGility云创新AI实验室);North China Electric Power University(华北电力大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Gaoling School of Artificial Intelligence, RUC(中国人民大学高陵人工智能学院);School of Biomedical Engineering, USTC(中国科学技术大学生物医学工程学院);Suzhou Institute for Advance Research, USTC(中国科学技术大学苏州市先进研究院);School of Computer Science and Technology, BJTU(北京理工大学计算机科学与技术学院);Hunan Central South Intelligent Equipment Co., Ltd.(湖南中南智能装备有限公司)
Solving the Granularity Mismatch: Hierarchical Preference Learning for Long-Horizon LLM Agents
Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(人工智能与数字经济广东实验室);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Baidu Inc.(百度公司)
DHRL: A Graph-Based Approach for Long-Horizon and Sparse Hierarchical Reinforcement Learning
Seoul National University(首尔国立大学);Artificial Intelligence Institute of Seoul National University (AIIS)(首尔国立大学人工智能研究所(AIIS));Automation and Systems Research Institute (ASRI)(自动化与系统研究所(ASRI))
Chain-of-Goals Hierarchical Policy for Long-Horizon Offline Goal-Conditioned RL
Department of Electrical and Computer Engineering, Seoul National University, Seoul, South Korea(首尔国立大学电气与计算机工程系);Department of Automotive Engineering, Ajou University, Gyeonggi-do, South Korea(全州大学汽车工程系)
Imagine to Ensure Safety in Hierarchical Reinforcement Learning
Cognitive AI Systems Lab(认知人工智能系统实验室);Moscow Independent Research Institute of Artificial Intelligence(莫斯科独立人工智能研究所);FRC Computer Science RAS(俄罗斯科学院联邦研究中心计算机科学研究所)
CHIME: Credit-Aware Hierarchical Memory Evolution for Long-Horizon Agentic Planning
Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能学院);Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan (Xiamen University), Ministry of Culture and Tourism(文化和旅游部闽台非物质文化遗产数字化保护与智能处理重点实验室(厦门大学));Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团)
Triplet2Track: A Hierarchical System with Object-Centric Representations for Reliable Long-Horizon Manipulation
School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院);School of Engineering and Informatics, University of Sussex(萨塞克斯大学工程与信息学院)
HiMAP-Travel: Hierarchical Multi-Agent Planning for Long-Horizon Constrained Travel
Department of XXX, University of YYY, Location, Country(YYY大学XXX系);School of ZZZ, Institute of WWW, Location, Country(WWW研究所ZZZ学院);Singapore Management University(新加坡管理大学)
Hierarchical Belief Modeling for Zero-Shot Opponent Adaptation in Partially Observable Multi-Agent Navigation
Tsinghua University(清华大学);Stevens Institute of Technology(史蒂文斯理工学院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Texas A&M University(德克萨斯A&M大学)
ContextFlow: Hierarchical Task-State Alignment for Long-Horizon Embodied Agents
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);Qiuzhen College, Tsinghua University(清华大学启祯学院);Beijing Institute of Mathematical Sciences and Applications(北京数学科学研究院);Department of Data Science and Analytics Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)数据科学与分析部门);Institute of Microelectronics, Chinese Academy of Sciences(中国科学院微电子研究所);University of Chinese Academy of Sciences(中国科学院大学)
StackPlanner: A Centralized Hierarchical Multi-Agent System with Task-Experience Memory Management
School of Computer Science, Peking University(北京大学计算机学院);National Engineering Research Center for Software Engineering, Peking University(北京大学软件工程国家工程研究中心);School of Public Affaris, Zhejiang University(浙江大学公共管理学院);School of Software & Microelectronics, Peking University(北京大学软件与微电子学院);GRG Banking Equipment Co., Ltd.(GRG银行设备有限公司);Center on Frontiers of Computing Studies, Peking University(北京大学计算前沿中心);Peking University Information Technology Institute (Tianjin Binhai)(北京大学信息技术研究院(天津滨海))
MA-CoNav: A Master-Slave Multi-Agent Framework with Hierarchical Collaboration and Dual-Level Reflection for Long-Horizon Embodied VLN
Southwestern University of Finance(西南财经大学);Department of Informatics,Universitat Hamburg, Hamburg, Germany(汉堡大学信息学院);University of Electronic Science(电子科学大学)