arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

语言大模型 / LLM

大语言模型、预训练、指令微调、后训练和语言模型应用。

共收录 4789 信号源:cs.CL, cs.AI, cs.LG

1. 长上下文与记忆 4789 篇

2501.06828 2025-03-14 cs.CV 89%

GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensing

Ruizhe Ou, Yuan Hu, Fan Zhang, Jiaxin Chen, Yu Liu

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.11230 2025-02-12 cs.LG cs.AI cs.CL cs.CV 89%

Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models

Hengyi Wang, Haizhou Shi, Shiwei Tan, Weiyi Qin, Wenyuan Wang, Tunyu Zhang, Akshay Nambi, Tanuja Ganu, Hao Wang

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG

Comments Accepted at NAACL 2025 Main

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.13986 2025-02-11 cs.LG cs.AI cs.CL cs.IR 89%

AgentMove: A Large Language Model based Agentic Framework for Zero-shot Next Location Prediction

Jie Feng, Yuwei Du, Jie Zhao, Yong Li

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG

Comments Accepted by NAACL 2025 as main conference paper, https://github.com/tsinghua-fib-lab/AgentMove

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.04997 2025-01-17 cs.IR 89%

Tapping the Potential of Large Language Models as Recommender Systems: A Comprehensive Framework and Empirical Analysis

Lanling Xu, Junjie Zhang, Bingqian Li, Jinpeng Wang, Sheng Chen, Wayne Xin Zhao, Ji-Rong Wen

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);prompting(abstract)

Comments 52 pages, under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.06709 2025-01-14 cs.DC 89%

Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management

Liu Qianli, Hong Zicong, Chen Fahao, Li Peng, Guo Song

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.01663 2024-12-03 cs.RO 89%

DaDu-E: Rethinking the Role of Large Language Model in Robotic Computing Pipeline

Wenhao Sun, Sai Hou, Zixuan Wang, Bo Yu, Shaoshan Liu, Xu Yang, Shuai Liang, Yiming Gan, Yinhe Han

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

Comments 27 pages, 5 figures, submitted to JFR

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.18143 2024-11-28 cs.CR cs.SE 89%

Harnessing Large Language Models for Seed Generation in Greybox Fuzzing

Wenxuan Shi, Yunhang Zhang, Xinyu Xing, Jun Xu

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.11417 2024-10-16 cs.CV cs.MM 89%

VidCompress: Memory-Enhanced Temporal Compression for Video Understanding in Large Language Models

Xiaohan Lan, Yitian Yuan, Zequn Jie, Lin Ma

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

Comments 9 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.04787 2024-07-09 cs.CL cs.AI cs.LG 89%

Re-Tuning: Overcoming the Compositionality Limits of Large Language Models with Recursive Tuning

Eric Pasewark, Kyle Montgomery, Kefei Duan, Dawn Song, Chenguang Wang

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.18852 2024-05-28 cs.PL cs.SE 89%

VERT: Verified Equivalent Rust Transpilation with Large Language Models as Few-Shot Learners

Aidan Z. H. Yang, Yoshiki Takashima, Brandon Paulsen, Josiah Dodds, Daniel Kroening

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.02135 2024-03-05 cs.HC 89%

Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation

Wazeer Zulfikar, Samantha Chan, Pattie Maes

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

Comments 18 pages, 9 figures, project page at https://www.media.mit.edu/projects/memoro/overview

Journal ref Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.04889 2024-01-11 cs.AI cs.CL cs.LG 89%

KwaiAgents: Generalized Information-seeking Agent System with Large Language Models

Haojie Pan, Zepeng Zhai, Hao Yuan, Yaojia Lv, Ruiji Fu, Ming Liu, Zhongyuan Wang, Bing Qin

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.08848 2023-05-16 cs.CL cs.AI cs.LG 89%

Small Models are Valuable Plug-ins for Large Language Models

Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.00016 2026-04-02 cs.CL cs.AI 89%

Are they human? Detecting large language models by probing human memory constraints

他们真的是人类吗?通过探测人类记忆限制来检测大语言模型

Simon Schug, Brenden M. Lake

机构 * Princeton University(普林斯顿大学)

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI;LLM(comments)

AI总结 本文通过探测人类认知限制来区分大语言模型与人类,展示了在特定任务中人类工作记忆容量的限制可被利用以识别非人类参与者。

Comments Code available at https://github.com/smonsays/llm-humanness

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.03538 2024-11-07 cs.LG cs.CL 89%

Long Context RAG Performance of Large Language Models

Quinn Leng, Jacob Portes, Sam Havens, Matei Zaharia, Michael Carbin

专题命中 长上下文与记忆 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG;foundation model(comments)

Comments 2024 NeurIPS workshop on Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.19621 2026-08-21 cs.CL 新提交 89%

Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories

通过纵向生活轨迹缓解大语言模型智能体中的本质主义身份偏差

Hexi Wang, Yujia Zhou, Bangde Du, Weihang Su, Xinyuan Cao, Qingyi Pan, Qingyao Ai, Yueyue Wu, Min Zhang, Yiqun Liu

专题命中 长上下文与记忆 :LLM(title,summary_cn);large language model(abstract);language model(abstract);分类 cs.CL

AI总结 针对现有LLM智能体存在的身份本质主义偏差导致组内反应同质化的问题,提出LifeMem纵向记忆框架,在Add Health等数据集上验证其可提升与人类数据的一致性。

Comments 23 pages, 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.19564 2026-08-21 cs.CL 新提交 89%

Remember, Verify, or Ask? Cross-Family Evaluation of Memory Commitment in LLM Agents

记住、验证还是询问?大语言模型智能体中记忆承诺的跨家族评估

Baichuan Li, Junyi Yao, Zihao Zheng

机构 * Southern Methodist University(南卫理公会大学) Washington University in St. Louis(圣路易斯华盛顿大学)

专题命中 长上下文与记忆 :LLM(title,summary_cn);prompting(abstract);分类 cs.CL

AI总结 本研究通过MCB数据集评估LLM智能体的记忆承诺,发现模型验证事实变化更可靠,策略提示可降低错误持久率,少样本提示能提升部分任务准确率,但澄清召回率仍较低。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.14401 2026-08-13 cs.AI cs.DB 版本更新 89%

Credo: Declarative Control of LLM Pipelines via Beliefs and Policies

Credo:通过信念和策略实现LLM流水线的声明式控制

Duo Lu, Andrew Crotty, Uğur Çetintemel

机构 * Brown University(布朗大学) Northwestern University(西北大学)

专题命中 长上下文与记忆 :LLM(title,title_cn);分类 cs.AI

AI总结 本文提出Credo,通过声明式策略和信念管理LLM流水线的决策,实现可适应、可审计和可组合的执行。

Comments VLDB 2026 (Demo)

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.03420 2026-08-05 cs.AI 新提交 89%

Towards Improving Sequential Decision-Making in LLM Agents via Experience Memory

基于经验记忆提升大语言模型智能体的序列决策能力

Jakub Rada, Viliam Lisý

专题命中 长上下文与记忆 :LLM(title,summary_cn);large language model(abstract);language model(abstract);分类 cs.AI

AI总结 本研究针对LLM智能体序列决策性能不足的问题,提出带经验记忆的智能体框架,通过对局后反思与规则提取,在不修改模型权重的情况下提升了井字棋任务的表现。

Comments 8 pages, 6 figures, 14 tables, 5 appendices, accepted at Neuro-Symbolic Intelligence for LLMs and Autonomous Agents workshop at IJCAI 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.30005 2026-08-03 cs.CL 版本更新 89%

LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception

LLM 智能体是潜在上下文管理者:通过本体感觉仪表盘引发自我管理上下文

Binyan Xu, Haitao Li, Kehuan Zhang

机构 * Tencent(腾讯)

专题命中 长上下文与记忆 :LLM(title,title_cn);language model(abstract);分类 cs.CL

AI总结 提出 VISTA 框架,通过为 LLM 智能体提供上下文状态仪表盘(令牌使用量、时效性、访问历史),无需训练即可实现自我上下文管理,在多个基准上显著提升性能。

Comments 27 pages, 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.05704 2026-07-24 cs.CR cs.AI 版本更新 89%

SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM Agent Safety

SafeHarbor:用于LLM智能体安全的分层记忆增强防护栏

Zhe Liu, Zonghao Ying, Wenxin Zhang, Quanchen Zou, Deyue Zhang, Dongdong Yang, Xiangzheng Zhang, Hao Peng

机构 * School of Cyber Science and Technology, Beihang University, Beijing, China(北京航空航天大学网络安全学院) Institute of Artificial Intelligence, Beihang University, Beijing, China(北京航空航天大学人工智能研究院) University of Chinese Academy of Sciences, Beijing, China(中国科学院大学) AI Security Lab, Beijing, China(360人工智能安全实验室)

专题命中 长上下文与记忆 :LLM(title,title_cn);foundation model(abstract);分类 cs.AI

AI总结 提出SafeHarbor框架,通过分层记忆系统和信息熵自进化机制,在保持高安全拒绝率的同时提升对良性请求的响应能力。

Comments Accepted by ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.23668 2026-06-23 cs.LG 新提交 89%

On the Limits of Prompt-Conditioned Language Models as General-Purpose Learners

关于提示条件语言模型作为通用学习器的局限性

David Mguni, Julian Ma, Jun Wang

机构 * Queen Mary University London(伦敦玛丽女王大学) University College London(伦敦大学学院)

专题命中 长上下文与记忆 :language model(title,abstract);LLM(abstract,abstract_cn);large language model(abstract);prompting(abstract)

AI总结 本文通过廉价谈话博弈模型分析提示条件语言模型,证明语言作为容量受限通道导致任务不可区分性,并因对齐约束产生不可约误差,从而否定其通过提示实现通用问题求解的能力。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.19847 2026-06-19 cs.CL 新提交 89%

AtomMem: Building Simple and Effective Memory System for LLM Agents via Atomic Facts

AtomMem: 通过原子事实构建简单有效的LLM智能体记忆系统

Yanyu Yao, Shangze Li, Zhi Zheng, Hui Zheng, Qi Liu, Tong Xu, Enhong Chen

机构 * State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(中国科学技术大学认知智能国家重点实验室) Anhui University(安徽大学)

专题命中 长上下文与记忆 :LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.CL

AI总结 针对现有记忆系统存储粗粒度、更新不稳定的问题,提出AtomMem,通过事实执行器提取高价值原子事实作为高效记忆表示,并组织为层次化事件结构和时间档案,实现价值密集存储和稳定演化,在LoCoMo基准上取得最优性能。

Comments 19 pages, 10 figures, 5 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.03083 2026-06-03 cs.AI 89%

DELTAMEM: Incremental Experience Memory for LLM Agents via Residual Trees

DELTAMEM: 通过残差树为LLM智能体增量式经验记忆

Haoran Tan, Zeyu Zhang, Zhicheng Cao, Rui Li, Xu Chen

机构 * Beijing Key Laboratory of Research on Large Models and Intelligent Governance(北京大模型与智能治理重点实验室) Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MOE(下一代智能搜索与推荐工程技术研究中心,教育部) Gaoling School of Artificial, Renmin University of China(中国人民大学人工智能学院) Duke University School of Medicine(杜克大学医学学院)

专题命中 长上下文与记忆 :LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI

AI总结 提出DeltaMem框架,通过构建两个独立的残差树(目标条件任务经验和场景级环境知识)组织经验记忆,利用增量节点减少冗余,并通过失败惩罚相似度扫描和自主合并机制实现高效检索与自组织,在多种交互环境中优于现有基线。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.01199 2026-06-02 cs.AI 89%

Can LLM Agents Sustain Long-Horizon Organizational Dynamics?

LLM智能体能否维持长期组织动态?

Xuancheng Zhu, Yang Yue, Shuaibing Wan, Zihan Dou, Xiaohan Zhang, Yongrui Liu, Guoshun Nan

机构 * Beijing University of Posts and Telecommunications(北京邮电大学)

专题命中 长上下文与记忆 :LLM(title,title_cn);language agent(abstract);分类 cs.AI

AI总结 提出TaskWeave分层智能体框架,通过记忆中心的协调机制(规划-分解-诊断-对齐循环和依赖感知追踪记忆)实现长期组织模拟,实验表明该框架能维持连贯的组织动态并产生可靠的人工制品。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.01473 2026-05-29 cs.CR cs.AI 89%

SelfGrader: LLM Jailbreak Detection via Anchored Token-Level Logits

SelfGrader: 基于锚定令牌级对数概率的LLM越狱检测

Zikai Zhang, Rui Hu, Olivera Kotevska, Jiahao Xu

机构 * Department of Computer Science and Engineering, University of Nevada, Reno(内华达大学里诺分校计算机科学与工程系) Oak Ridge National Laboratory(橡树岭国家实验室)

专题命中 长上下文与记忆 :LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI

AI总结 提出SelfGrader方法,利用锚定令牌级对数概率将越狱检测转化为数值评分问题,实现低延迟、低误报率的鲁棒检测。

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.18071 2026-05-19 cs.CL 89%

KVDrive: A Holistic Multi-Tier KV Cache Management System for Long-Context LLM Inference

KVDrive: 一个面向长上下文LLM推理的多层级KV缓存管理系统

Jian Lin, Jiazhi Mi, Zicong Hong, Haodong Wang, Qianli Liu, Haodyue Zhang, Peng Li, Song Guo

机构 * Hong Kong University of Science and Technology China(香港科技大学中国) Xi’an Jiaotong University China(西安交通大学中国)

专题命中 长上下文与记忆 :LLM(title,title_cn);分类 cs.CL

AI总结 本文提出KVDrive,一个面向长上下文LLM推理的多层级KV缓存管理系统,通过联合缓存放置、流水线调度和跨层级协调,实现了高吞吐量的推理,在有限的GPU预算下保持高精度。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.16752 2026-04-21 cs.AI 89%

Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents

不要开始无法完成的任务:对LLM代理支持状态分拣的反事实审计

Eren Unlu

机构 * Globeholder Paris, France(巴黎 Globeholder 机构,法国)

专题命中 长上下文与记忆 :LLM(title,title_cn);prompting(abstract);分类 cs.AI

AI总结 本文通过反事实审计框架评估LLM代理在任务分拣中的能力,发现默认执行过度承诺非完整任务,而通过特定提示条件可显著提升分拣准确性。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.13120 2026-04-16 cs.SE cs.AI 89%

AgentForge: Execution-Grounded Multi-Agent LLM Framework for Autonomous Software Engineering

AgentForge: 基于执行的多智能体LLM框架用于自主软件工程

Rajesh Kumar, Waqar Ali, Junaid Ahmed, Najma Imtiaz Ali, Shaban Usman

机构 * International Research Center for Complexity Sciences(复杂科学国际研究中心) Hangzhou International Innovation Institute(杭州国际创新研究院) Beihang University(北京航空航天大学) College of Science, Mathematics and Technology(科学、数学与技术学院) Wenzhou-Kean University(温州-凯恩大学) Fakulti Teknologi Maklumat dan Komunikasi(信息技术与通信学院) Universiti Teknikal Malaysia Melaka(马来西亚Melaka理工大学) Computer Systems Engineering Department(计算机系统工程系) Sukkur IBA University(苏库尔IBA大学) University of Electronic Science and Technology of China(电子科学与技术大学)

专题命中 长上下文与记忆 :LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI

AI总结 AgentForge通过引入执行验证原则,提升代码正确性验证,实现40.0%的SWE-BENCH Lite解决率,优于单智能体基线。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.12167 2026-04-15 cs.AI cs.NE 89%

EMBER: Autonomous Cognitive Behaviour from Learned Spiking Neural Network Dynamics in a Hybrid LLM Architecture

EMBER:在混合大语言模型架构中通过学习的脉冲神经网络动态实现自主认知行为

William Savage

机构 * Independent Researcher(独立研究者)

专题命中 长上下文与记忆 :LLM(title,abstract);large language model(abstract);language model(abstract);prompting(abstract)

AI总结 本文提出EMBER架构,通过学习的脉冲神经网络动态实现大语言模型与记忆之间的关系重组,利用STDP和奖励调节学习实现自主行为决策。

Comments Preprint. 9 pages, 2 figures, 3 tables. NeurIPS 2026 format

详情

展开后加载摘要…

URL PDF HTML 收藏