语言大模型 / LLM - arXivDaily 专题

2412.02252 2025-08-05 cs.CL 85%

Compressing KV Cache for Long-Context LLM Inference with Inter-Layer Attention Similarity

Da Ma, Lu Chen, Situo Zhang, Yuxun Miao, Su Zhu, Zhi Chen, Hongshen Xu, Hanqi Li, Shuai Fan, Lei Pan, Kai Yu

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments 14 pages, 7 figures, 7 tables

2503.21760 2025-08-04 cs.CL 85%

MemInsight: Autonomous Memory Augmentation for LLM Agents

Rana Salama, Jason Cai, Michelle Yuan, Anna Currey, Monica Sunkara, Yi Zhang, Yassine Benajiba

机构 * AWS AI（AWS人工智能）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2507.21428 2025-07-30 cs.CL 85%

MemTool: Optimizing Short-Term Memory Management for Dynamic Tool Calling in LLM Agent Multi-Turn Conversations

Elias Lumer, Anmol Gulati, Vamse Kumar Subbiah, Pradeep Honaganahalli Basavaraju, James A. Burke

机构 * Commercial Technology and Innovation Office, PricewaterhouseCoopers（普华永道商业技术与创新办公室）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 23 Pages, 20 Figures

2507.03153 2025-07-08 cs.LG 85%

HGCA: Hybrid GPU-CPU Attention for Long Context LLM Inference

Weishu Deng, Yujie Yang, Peiran Du, Lingfeng Xiang, Zhen Lin, Chen Zhong, Song Jiang, Hui Lu, Jia Rao

机构 * The University of Texas at Arlington（德克萨斯大学阿灵顿分校）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2501.12372 2025-06-12 cs.DB cs.AI 85%

Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL

Yeounoh Chung, Gaurav T. Kakkar, Yu Gan, Brenton Milne, Fatma Ozcan

机构 * Google（谷歌）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 13 pages, 6 figures, VLDB 2025

2502.14254 2025-06-12 cs.RO cs.AI 85%

Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigation

Lingfeng Zhang, Yuecheng Liu, Zhanguang Zhang, Matin Aghaei, Yaochen Hu, Hongjian Gu, Mohammad Ali Alomrani, David Gamaliel Arcos Bravo, Raika Karimi, Atia Hamidizadeh, Haoping Xu, Guowei Huang, Zhanpeng Zhang, Tongtong Cao, Weichao Qiu, Xingyue Quan, Jianye Hao, Yuzheng Zhuang, Yingxue Zhang

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.AI

2502.13172 2025-06-04 cs.CR cs.AI 85%

Unveiling Privacy Risks in LLM Agent Memory

Bo Wang, Weiyi He, Shenglai Zeng, Zhen Xiang, Yue Xing, Jiliang Tang, Pengfei He

机构 * Michigan State University（密歇根州立大学）； University of Georgia（佐治亚大学）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments ACL 2025 (Main Conference)

2505.11942 2025-06-02 cs.AI 85%

LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners

Junhao Zheng, Xidi Cai, Qiuke Li, Duzhen Zhang, ZhongZhi Li, Yingying Zhang, Le Song, Qianli Ma

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Project Page: https://caixd-220529.github.io/LifelongAgentBench/

2505.23844 2025-06-02 cs.CL 85%

Enabling Flexible Multi-LLM Integration for Scalable Knowledge Aggregation

Zhenglun Kong, Zheng Zhan, Shiyue Hou, Yifan Gong, Xin Meng, Pengwei Sui, Peiyan Dong, Xuan Shen, Zifeng Wang, Pu Zhao, Hao Tang, Stratis Ioannidis, Yanzhi Wang

机构 * Northeastern University（东北大学）； Peking University（北京大学）； Harvard University（哈佛大学）； Google（谷歌）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2504.00587 2025-06-02 cs.MA cs.CL 85%

AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems

Yingxuan Yang, Huacan Chai, Shuai Shao, Yuanyi Song, Siyuan Qi, Renting Rui, Weinan Zhang

机构 * Shanghai Jiao Tong University（上海交通大学）； SII

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2505.13528 2025-05-21 cs.IR cs.AI 85%

LLM-Based User Simulation for Low-Knowledge Shilling Attacks on Recommender Systems

Shengkang Gu, Jiahao Liu, Dongsheng Li, Guangping Zhang, Mingzhe Han, Hansu Gu, Peng Zhang, Ning Gu, Li Shang, Tun Lu

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 11 pages, under review

2407.04363 2025-05-16 cs.AI 85%

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents

Petr Anokhin, Nikita Semenov, Artyom Sorokin, Dmitry Evseev, Andrey Kravchenko, Mikhail Burtsev, Evgeny Burnaev

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Code for this work is avaliable at https://github.com/AIRI-Institute/AriGraph

2505.02099 2025-05-06 cs.AI 85%

MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agents

Zeyu Zhang, Quanyu Dai, Xu Chen, Rui Li, Zhongyang Li, Zhenhua Dong

机构 * Renmin University of China（中国人民大学）； Huawei Noah’s Ark Lab（华为诺亚实验室）； Huawei Technologies Ltd.（华为技术有限公司）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Just accepted by TheWebConf'25 Resource Track

2504.17967 2025-04-28 cs.AI 85%

LLM Agent Swarm for Hypothesis-Driven Drug Discovery

Kevin Song, Andrew Trotter, Jake Y. Chen

机构 * Systems Pharmacology AI Research Center, The University of Alabama at Birmingham（系统药理学人工智能研究中心，阿拉巴马大学伯明翰分校）； Department of Biomedical Engineering, The University of Alabama at Birmingham（生物医学工程系，阿拉巴马大学伯明翰分校）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 15 pages, 3 figures

2504.13928 2025-04-22 cs.HC cs.AI 85%

LLM-Driven NPCs: Cross-Platform Dialogue System for Games and Social Platforms

Li Song

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2504.07303 2025-04-11 cs.MA cs.AI 85%

Modeling Response Consistency in Multi-Agent LLM Systems: A Comparative Analysis of Shared and Separate Context Approaches

Tooraj Helmi

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2504.02509 2025-04-04 cs.AI cs.RO 85%

A Memory-Augmented LLM-Driven Method for Autonomous Merging of 3D Printing Work Orders

Yuhao Liu, Maolin Yang, Pingyu Jiang

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 6 pages, 5 figures

2503.23306 2025-04-01 cs.CL 85%

Focus Directions Make Your Language Models Pay More Attention to Relevant Contexts

Youxiang Zhu, Ruochen Li, Danqing Wang, Daniel Haehn, Xiaohui Liang

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

2405.02732 2025-03-20 cs.CL cs.IR 85%

Recall Them All: Retrieval-Augmented Language Models for Long Object List Extraction from Long Documents

Sneha Singhania, Simon Razniewski, Gerhard Weikum

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

2503.05394 2025-03-10 cs.SE cs.AI 85%

Static Program Analysis Guided LLM Based Unit Test Generation

Sujoy Roychowdhury, Giriprasad Sridhara, A K Raghavan, Joy Bose, Sourav Mazumdar, Hamender Singh, Srinivasan Bajji Sugumaran, Ricardo Britto

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2502.18712 2025-02-27 cs.AI cs.SI 85%

TrajLLM: A Modular LLM-Enhanced Agent-Based Framework for Realistic Human Trajectory Simulation

Chenlu Ju, Jiaxin Liu, Shobhit Sinha, Hao Xue, Flora Salim

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted WWW2025 Demo Paper

2502.07495 2025-02-12 cs.NI cs.LG 85%

LLM-Sketch: Enhancing Network Sketches with LLM

Yuanpeng Li, Zhen Xu, Zongwei Lv, Yannan Hu, Yong Cui, Tong Yang

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2502.06975 2025-02-12 cs.AI 85%

Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents

Mathis Pink, Qinyuan Wu, Vy Ai Vo, Javier Turek, Jianing Mu, Alexander Huth, Mariya Toneva

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2410.01805 2025-01-31 cs.CL 85%

Locret: Enhancing Eviction in Long-Context LLM Inference with Trained Retaining Heads on Consumer-Grade Devices

Yuxiang Huang, Binhang Yuan, Xu Han, Chaojun Xiao, Zhiyuan Liu

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Preprints

2501.15021 2025-01-28 cs.CL 85%

AKVQ-VL: Attention-Aware KV Cache Adaptive 2-Bit Quantization for Vision-Language Models

Zunhai Su, Wang Shen, Linge Li, Zhe Chen, Hanyu Wei, Huangqi Yu, Kehong Yuan

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

2407.12117 2025-01-16 cs.LG cs.DC 85%

MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2404.03565 2025-01-15 cs.CL 85%

Personalized LLM Response Generation with Parameterized Memory Injection

Kai Zhang, Yejin Kim, Xiaozhong Liu

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2412.15271 2024-12-23 cs.CL cs.IR 85%

A MapReduce Approach to Effectively Utilize Long Context Information in Retrieval Augmented Language Models

Gongbo Zhang, Zihan Xu, Qiao Jin, Fangyi Chen, Yilu Fang, Yi Liu, Justin F. Rousseau, Ziyang Xu, Zhiyong Lu, Chunhua Weng, Yifan Peng

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

2408.13889 2024-12-10 cs.CL 85%

LLM with Relation Classifier for Document-Level Relation Extraction

Xingzuo Li, Kehai Chen, Yunfei Long, Min Zhang

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2412.04093 2024-12-06 cs.AI 85%

Practical Considerations for Agentic LLM Systems

Chris Sypherd, Vaishak Belle

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 15 pages, 3 figures, 1 table

1. 长上下文与记忆 4797 篇

Compressing KV Cache for Long-Context LLM Inference with Inter-Layer Attention Similarity

MemInsight: Autonomous Memory Augmentation for LLM Agents

MemTool: Optimizing Short-Term Memory Management for Dynamic Tool Calling in LLM Agent Multi-Turn Conversations

HGCA: Hybrid GPU-CPU Attention for Long Context LLM Inference

Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL

Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigation

Unveiling Privacy Risks in LLM Agent Memory

LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners

Enabling Flexible Multi-LLM Integration for Scalable Knowledge Aggregation

AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems

LLM-Based User Simulation for Low-Knowledge Shilling Attacks on Recommender Systems

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents

MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agents

LLM Agent Swarm for Hypothesis-Driven Drug Discovery

LLM-Driven NPCs: Cross-Platform Dialogue System for Games and Social Platforms

Modeling Response Consistency in Multi-Agent LLM Systems: A Comparative Analysis of Shared and Separate Context Approaches

A Memory-Augmented LLM-Driven Method for Autonomous Merging of 3D Printing Work Orders

Focus Directions Make Your Language Models Pay More Attention to Relevant Contexts

Recall Them All: Retrieval-Augmented Language Models for Long Object List Extraction from Long Documents

Static Program Analysis Guided LLM Based Unit Test Generation

TrajLLM: A Modular LLM-Enhanced Agent-Based Framework for Realistic Human Trajectory Simulation

LLM-Sketch: Enhancing Network Sketches with LLM

Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents

Locret: Enhancing Eviction in Long-Context LLM Inference with Trained Retaining Heads on Consumer-Grade Devices

AKVQ-VL: Attention-Aware KV Cache Adaptive 2-Bit Quantization for Vision-Language Models

MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training

Personalized LLM Response Generation with Parameterized Memory Injection

A MapReduce Approach to Effectively Utilize Long Context Information in Retrieval Augmented Language Models

LLM with Relation Classifier for Document-Level Relation Extraction

Practical Considerations for Agentic LLM Systems