语言大模型 / LLM - arXivDaily 专题

2507.03305 2025-10-31 cs.DC 82%

Analysis and Optimized CXL-Attached Memory Allocation for Long-Context LLM Fine-Tuning

Yong-Cheng Liaw, Shuo-Han Chen

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

Comments 13 pages, 15 figures, 2 tables

2510.24726 2025-10-30 eess.SP cs.CY stat.AP 82%

Modelling Real-Life Cycling Decisions in Real Urban Settings Through Psychophysiology and LLM-Derived Contextual Data

Maximiliano Rosadio Z., Angel Jimenez-Molina, Bastián Henríquez, Paulina Leiva, Ricardo Hurtubia, Ricardo De La Paz Guala, Leandro Gayozo, C. Angelo Guevara

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

Comments 31 pages, 10 figures

2505.15962 2025-10-06 cs.CL cs.AI cs.LG 82%

Pre-training Limited Memory Language Models with Internal and External Knowledge

Linxi Zhao, Sofian Zalouk, Christian K. Belardi, Justin Lovelace, Jin Peng Zhou, Ryan Thomas Noonan, Dongyoung Go, Kilian Q. Weinberger, Yoav Artzi, Jennifer J. Sun

机构 * Department of Computer Science Cornell University（计算机科学系哥伦比亚大学）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Code, models, and data available at https://github.com/kilian-group/LMLM

2509.14223 2025-09-23 cs.LG cs.AI cs.CL 82%

Fresh in memory: Training-order recency is linearly encoded in language model activations

Dmitrii Krasheninnikov, Richard E. Turner, David Krueger

机构 * University of Cambridge（剑桥大学）； Mila, University of Montreal（蒙特利尔大学米尔研究所）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2508.16629 2025-08-26 cs.LG cs.AI cs.CL cs.IR 82%

Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework

Zeyu Zhang, Quanyu Dai, Rui Li, Xiaohe Bo, Xu Chen, Zhenhua Dong

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学人工智能学院）； Huawei Noah’s Ark Lab（华为诺亚实验室）

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 17 pages, 4 figures, 5 tables

2508.07026 2025-08-12 quant-ph 82%

Bridging Classical and Quantum Computing for Next-Generation Language Models

Yi Pan, Hanqi Jiang, Junhao Chen, Yiwei Li, Huaqin Zhao, Lin Zhao, Yohannes Abate, Yingfeng Wang, Tianming Liu

专题命中长上下文与记忆：language model(title,abstract)；large language model(abstract)

2508.02679 2025-08-11 cs.HC 82%

LLM Agent-Based Simulation of Student Activities and Mental Health Using Smartphone Sensing Data

Wayupuk Sommuang, Kun Kerdthaisong, Pasin Buakhaw, Aslan B. Wong, Nutchanon Yongsatianchot

专题命中长上下文与记忆：LLM(title,abstract)；prompting(abstract)

2503.02247 2025-07-22 cs.CV cs.RO 82%

WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation

Dujun Nie, Xianda Guo, Yiqun Duan, Ruijun Zhang, Long Chen

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）； School of Computer Science, Wuhan University（武汉大学计算机学院）； School of Computer Science, University of Technology Sydney（悉尼大学计算机学院）； IAIR, Xi’an Jiaotong University（西安交通大学IAIR）

专题命中长上下文与记忆：language model(title,abstract)；prompting(abstract)

Comments 8 pages, 5 figures

Journal ref IROS 2025

2412.16926 2025-05-29 cs.CL cs.AI cs.LG 82%

Revisiting In-Context Learning with Long Context Language Models

Jinheon Baek, Sun Jae Lee, Prakhar Gupta, Geunseob Oh, Siddharth Dalmia, Prateek Kolhar

机构 * KAIST（韩国科学技术院）； Google DeepMind（谷歌DeepMind）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL Findings 2025

2505.18279 2025-05-27 cs.MA cs.AI cs.CL cs.LG 82%

Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control

Alireza Rezazadeh, Zichao Li, Ange Lou, Yuying Zhao, Wei Wei, Yujia Bao

机构 * Center for Advanced AI, Accenture（Accenture高级人工智能研究中心）

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2505.11888 2025-05-20 cs.HC 82%

AR Secretary Agent: Real-time Memory Augmentation via LLM-powered Augmented Reality Glasses

Raphaël A. El Haddad, Zeyu Wang, Yeonsu Shin, Ranyi Liu, Yuntao Wang, Chun Yu

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

2412.17593 2025-04-30 cs.IR 82%

Leveraging Memory Retrieval to Enhance LLM-based Generative Recommendation

Chengbing Wang, Yang Zhang, Fengbin Zhu, Jizhi Zhang, Tianhao Shi, Fuli Feng

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

Comments Accepted by WWW'2025

2504.12526 2025-04-18 cs.LG cs.AI cs.CL 82%

MOM: Memory-Efficient Offloaded Mini-Sequence Inference for Long Context Language Models

Junyang Zhang, Tianyi Zhu, Cheng Luo, Anima Anandkumar

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Submitted to COLM

2410.10781 2025-03-04 cs.CL cs.AI cs.LG 82%

When Attention Sink Emerges in Language Models: An Empirical View

Xiangming Gu, Tianyu Pang, Chao Du, Qian Liu, Fengzhuo Zhang, Cunxiao Du, Ye Wang, Min Lin

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2025 (Spotlight)

2502.18465 2025-02-27 cs.SE 82%

Empirical Research on Utilizing LLM-based Agents for Automated Bug Fixing via LangGraph

Jialin Wang, Zhihua Duan

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

2410.04739 2024-12-30 cs.CL cs.AI cs.IR cs.LG 82%

TableRAG: Million-Token Table Understanding with Language Models

Si-An Chen, Lesly Miculicich, Julian Martin Eisenschlos, Zifeng Wang, Zilong Wang, Yanfei Chen, Yasuhisa Fujii, Hsuan-Tien Lin, Chen-Yu Lee, Tomas Pfister

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to NeurIPS 2024

2407.16695 2024-12-04 cs.CL cs.AI cs.LG 82%

Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack

Xiaoyue Xu, Qinyuan Ye, Xiang Ren

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2024 (Datasets and Benchmarks Track). Code: https://github.com/INK-USC/Lifelong-ICL Website: https://inklab.usc.edu/lifelong-icl/

2406.19508 2024-07-24 cs.SE 82%

Code Linting using Language Models

Darren Holden, Nafiseh Kahani

专题命中长上下文与记忆：language model(title,abstract)；large language model(abstract)

Comments 44 pages, 3 figures

2407.00020 2024-07-02 cs.CV cs.AI cs.CL cs.IT cs.LG math.IT 82%

Visual Language Model based Cross-modal Semantic Communication Systems

Feibo Jiang, Chuanguo Tang, Li Dong, Kezhi Wang, Kun Yang, Cunhua Pan

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 10 figures

2406.02080 2024-06-05 cs.CL cs.AI cs.LG math.DS 82%

LongSSM: On the Length Extension of State-space Models in Language Modelling

Shida Wang

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 23 pages

2404.00573 2024-04-02 cs.HC 82%

"My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents

Yuki Hou, Haruki Tamoto, Homei Miyashita

专题命中长上下文与记忆：LLM(title)；large language model(abstract)；language model(abstract)

Comments Accepted to CHI 2024 Late-Breaking Work

2310.16142 2023-10-26 cs.CL cs.AI cs.LG 82%

A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing

William Timkey, Tal Linzen

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments To appear in Findings of the Association for Computational Linguistics: EMNLP 2023

2310.10134 2023-10-17 cs.CL cs.AI cs.LG 82%

CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization

Bodhisattwa Prasad Majumder, Bhavana Dalvi Mishra, Peter Jansen, Oyvind Tafjord, Niket Tandon, Li Zhang, Chris Callison-Burch, Peter Clark

专题命中长上下文与记忆：language agent(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project page: https://allenai.github.io/clin/

2305.16349 2023-05-29 cs.CL cs.AI cs.LG 82%

Lexinvariant Language Models

Qian Huang, Eric Zelikman, Sarah Li Chen, Yuhuai Wu, Gregory Valiant, Percy Liang

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2210.03162 2022-10-10 cs.CL cs.AI cs.LG 82%

Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models

David Wingate, Mohammad Shoeybi, Taylor Sorensen

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Empirical Methods in Natural Language Processing, 2022 (Main-Long Paper)

2009.01803 2020-09-04 cs.NE cs.AI cs.CL cs.LG stat.ML 82%

Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language Modelling

Tsendsuren Munkhdalai

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 4 figures, 2 tables

1702.04521 2017-02-16 cs.CL cs.AI cs.LG cs.NE 82%

Frustratingly Short Attention Spans in Neural Language Modeling

Michał Daniluk, Tim Rocktäschel, Johannes Welbl, Sebastian Riedel

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published as a conference paper at ICLR 2017

2606.18677 2026-06-18 cs.LG cs.AI 新提交 82%

Bounded Context Management for Tabular Foundation Models on Stream Learning

表格基础模型在流学习中的有界上下文管理

Jinmo Lee, Doyun Choi, Moongi Choi, Jaemin Yoo

机构 * Seoul National University（首尔大学）； KAIST（韩国科学技术院）

专题命中长上下文与记忆：foundation model(title,abstract)；分类 cs.AI、cs.LG

AI总结针对表格流学习中分布漂移问题，提出上下文管理策略CURE，通过不确定性门控准入和冗余感知驱逐管理上下文，在七个流上相对提升最高27.0%。

Comments Accepted as a spotlight oral (top 5%) at the 2nd ICML Workshop on Foundation Models for Structured Data (FMSD@ICML2026)

2608.22411 2026-08-25 cs.CL 新提交 81%

Don' t Box Me In: Dynamic Cultural Adaptation and Cognitive Tracking for Social Understanding

不要限制我：面向社会理解的动态文化适应与认知跟踪

Chongyuan Dai, Yaling Shen, Shengeng Tang, Hui Ma, Jinpeng Hu

机构 * Hefei University of Technology（合肥工业大学）； Monash University（莫纳什大学）

专题命中长上下文与记忆：large language model(abstract,abstract_cn)；language model(abstract,abstract_cn)；分类 cs.CL

AI总结本文针对现有LLMs将文化建模为静态属性的局限，提出无需训练的DyCAC框架，结合动态文化适应与心理理论驱动的认知跟踪，在多元文化互动基准上展现出更优社会智能与适应性。

Comments EMNLP 2026 Findings

2607.26075 2026-08-25 cs.IR cs.AI 版本更新 81%

IDP AutoOpt: Agent-Driven Optimization of Document Processing Pipeline Configurations

IDP AutoOpt：智能文档处理流水线配置的智能体驱动优化

David Kaleko, Sergey Ivanov, Md Mofijul Islam

专题命中长上下文与记忆：LLM(summary_cn,abstract)；分类 cs.AI

AI总结 IDP AutoOpt是自主LLM智能体，通过闭环流程优化IDP流水线配置，在多领域任务上性能优于人类专家且成本更低，还可扩展至RAG等其他企业AI系统。

1. 长上下文与记忆 4822 篇

Analysis and Optimized CXL-Attached Memory Allocation for Long-Context LLM Fine-Tuning

Modelling Real-Life Cycling Decisions in Real Urban Settings Through Psychophysiology and LLM-Derived Contextual Data

Pre-training Limited Memory Language Models with Internal and External Knowledge

Fresh in memory: Training-order recency is linearly encoded in language model activations

Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework

Bridging Classical and Quantum Computing for Next-Generation Language Models

LLM Agent-Based Simulation of Student Activities and Mental Health Using Smartphone Sensing Data

WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation

Revisiting In-Context Learning with Long Context Language Models

Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control

AR Secretary Agent: Real-time Memory Augmentation via LLM-powered Augmented Reality Glasses

Leveraging Memory Retrieval to Enhance LLM-based Generative Recommendation

MOM: Memory-Efficient Offloaded Mini-Sequence Inference for Long Context Language Models

When Attention Sink Emerges in Language Models: An Empirical View

Empirical Research on Utilizing LLM-based Agents for Automated Bug Fixing via LangGraph

TableRAG: Million-Token Table Understanding with Language Models

Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack

Code Linting using Language Models

Visual Language Model based Cross-modal Semantic Communication Systems

LongSSM: On the Length Extension of State-space Models in Language Modelling

"My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents

A Language Model with Limited Memory Capacity Captures Interference in Human Sentence Processing

CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization

Lexinvariant Language Models

Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models

Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language Modelling

Frustratingly Short Attention Spans in Neural Language Modeling

Bounded Context Management for Tabular Foundation Models on Stream Learning

Don' t Box Me In: Dynamic Cultural Adaptation and Cognitive Tracking for Social Understanding

IDP AutoOpt: Agent-Driven Optimization of Document Processing Pipeline Configurations