语言大模型 / LLM

Context-Aware Hierarchical Merging for Long Document Summarization

Litu Ou, Mirella Lapata

机构 * University of Edinburgh（爱丁堡大学） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments ACL 2025 Findings

LaMPE: Length-aware Multi-grained Positional Encoding for Adaptive Long-context Scaling Without Training

Sikui Zhang, Guangze Gao, Ziyun Gan, Chunfeng Yuan, Zefeng Lin, Houwen Peng, Bing Li, Weiming Hu

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments 13 pages, 9 figures

RecUserSim: A Realistic and Diverse User Simulator for Evaluating Conversational Recommender Systems

Luyu Chen, Quanyu Dai, Zeyu Zhang, Xueyang Feng, Mingyu Zhang, Pengcheng Tang, Xu Chen, Yue Zhu, Zhenhua Dong

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学光明学院） ； Huawei Noah's Ark Lab（华为诺亚实验室） ； Huawei Technologies Ltd.（华为技术有限公司） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted by TheWebConf'25 Industry Track

MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automation

Yi Kong, Dianxi Shi, Guoli Yang, Zhang ke-di, Chenlin Huang, Xiaopeng Li, Songchang Jin

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design

Darui Lu, Jordan M. Malof, Willie J. Padilla

机构 * Department of Electrical and Computer Engineering, Duke University, Durham, USA（电气与计算机工程系，杜克大学，达勒姆，美国） ； Department of Electrical Engineering and Computer Science, University of Missouri, Columbia, USA（电气工程与计算机科学系，密苏里大学，哥伦比亚，美国） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 22 pages, 6 figures

Graphs Meet AI Agents: Taxonomy, Progress, and Future Opportunities

Yuanchen Bei, Weizhi Zhang, Siwen Wang, Weizhi Chen, Sheng Zhou, Hao Chen, Yong Li, Jiajun Bu, Shirui Pan, Yizhou Yu, Irwin King, Fakhri Karray, Philip S. Yu

机构 * Zhejiang University（浙江大学） ； University of Illinois Chicago（伊利诺伊大学芝加哥分校） ； Mohamed Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； City University of Macau（澳门城市大学） ； Ant Group（蚂蚁集团） ； Griffith University（格里菲斯大学） ； The University of Hong Kong（香港大学） ； The Chinese University of Hong Kong（香港中文大学） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 20 pages, 7 figures

Can LLMs Replace Humans During Code Chunking?

Christopher Glasz, Emily Escamilla, Eric O. Scott, Anand Patel, Jacob Zimmer, Colin Diggs, Michael Doyle, Scott Rosen, Nitin Naik, Justin F. Brunelle, Samruddhi Thaker, Parthav Poudel, Arun Sridharan, Amit Madan, Doug Wendt, William Macke, Thomas Schill

机构 * The MITRE Corporation（MITRE公司） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Long-context Non-factoid Question Answering in Indic Languages

Ritwik Mishra, Rajiv Ratn Shah, Ponnurangam Kumaraguru

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Short version of this manuscript accepted at https://bda2025.iiitb.net/

Empowering Economic Simulation for Massively Multiplayer Online Games through Generative Agent-Based Modeling

Bihan Xu, Shiwei Zhao, Runze Wu, Zhenya Huang, Jiawei Wang, Zhipeng Hu, Kai Wang, Haoyu Liu, Tangjie Lv, Le Li, Changjie Fan, Xin Tong, Jiangze Han

机构 * State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China（认知智能国家重点实验室，中国科学技术大学） ； NetEase Fuxi AI Lab（网易伏羲人工智能实验室） ； Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences（杭州高等研究院，中国科学院大学） ； National University of Singapore（新加坡国立大学） ； University of British Columbia（不列颠哥伦比亚大学） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments KDD2025 Accepted

PC-MoE: Memory-Efficient and Privacy-Preserving Collaborative Training for Mixture-of-Experts LLMs

Ze Yu Zhang, Bolin Ding, Bryan Kian Hsiang Low

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 20 pages, 4 figures

lmgame-Bench: How Good are LLMs at Playing Games?

Lanxiang Hu, Mingjia Huo, Yuxuan Zhang, Haoyang Yu, Eric P. Xing, Ion Stoica, Tajana Rosing, Haojian Jin, Hao Zhang

机构 * UC San Diego（加州大学圣地亚哥分校） ； MBZUAI（穆桑贝斯人工智能研究院） ； UC Berkeley（加州大学伯克利分校） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

MINDSTORES: Memory-Informed Neural Decision Synthesis for Task-Oriented Reinforcement in Embodied Systems

Anirudh Chari, Suraj Reddy, Aditya Tiwari, Richard Lian, Brian Zhou

机构 * Massachusetts Institute of Technology（麻省理工学院） ； Illinois Mathematics and Science Academy（伊利诺伊数学与科学学院） ； Harvard University（哈佛大学） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Prompt-based Personality Profiling: Reinforcement Learning for Relevance Filtering

Jan Hofmann, Cornelia Sindermann, Roman Klinger

机构 * Institut für Maschinelle Sprachverarbeitung, University of Stuttgart, Germany（机械语言处理研究所，斯图加特大学） ； Computational Digital Psychology, Interchange Forum for Reflecting on Intelligent Systems, University of Stuttgart, Germany（计算数字心理学，智能系统反思交流论坛，斯图加特大学） ； Fundamentals of Natural Language Processing, University of Bamberg, Germany（自然语言处理基础，巴姆堡大学） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted to the REALM workshop at ACL 2025

TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization

Dingyu Yao, Bowen Shen, Zheng Lin, Wei Liu, Jian Luan, Bin Wang, Weiping Wang

机构 * Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所） ； School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络安全学院） ； MiLM Plus, Xiaomi Inc（小米公司MiLM Plus） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

MAPLE: Many-Shot Adaptive Pseudo-Labeling for In-Context Learning

Zihan Chen, Song Wang, Zhen Tan, Jundong Li, Cong Shen

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding

Mingyu Jin, Kai Mei, Wujiang Xu, Mingjie Sun, Ruixiang Tang, Mengnan Du, Zirui Liu, Yongfeng Zhang

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments International Conference on Machine Learning (ICML 2025)

SubGCache: Accelerating Graph-based RAG with Subgraph-level KV Cache

Qiuyu Zhu, Liang Zhang, Qianxiong Xu, Cheng Long, Jie Zhang

机构 * Nanyang Technological University（南洋理工大学） ； Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability

Han Peng, Jinhao Jiang, Zican Dong, Wayne Xin Zhao, Lei Fang

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学人工智能学院） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；SFT(abstract)；分类 cs.CL

Can Generative AI agents behave like humans? Evidence from laboratory market experiments

R. Maria del Rio-Chanona, Marco Pangallo, Cars Hommes

机构 * Computer Science Department, University College London（伦敦大学学院计算机科学系） ； Complexity Science Hub Bennett Institute for Public Policy, University of Cambridge（剑桥大学复杂科学枢纽贝内特公共政策研究所） ； CENTAI Institute（CENTAI研究所） ； Canadian Economic Analysis Department, Bank of Canada Faculty of Economics and Business, University of Amsterdam（荷兰阿姆斯特丹大学经济与商业学院加拿大经济分析部） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

What Is Next for LLMs? Next-Generation AI Computing Hardware Using Photonic Chips

Renjie Li, Wenjie Wei, Qi Xin, Xiaoli Liu, Sixuan Mao, Erik Ma, Zijian Chen, Malu Zhang, Haizhou Li, Zhaoyu Zhang

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； University of Electronic Science and Technology of China（电子科技大学） ； School of Data Science, The Chinese University of Hong Kong, Shenzhen（数据科学学院，香港中文大学（深圳）） ； National University of Singapore（新加坡国立大学） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 36 pages, 22 figures

Advancements and limitations of LLMs in replicating human color-word associations

Makoto Fukushima, Shusuke Eshita, Hiroshige Fukuhara

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 20 pages, 7 figures, 3 tables

LLMpatronous: Harnessing the Power of LLMs For Vulnerability Detection

Rajesh Yarra

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Can LLMs reason over extended multilingual contexts? Towards long-context evaluation beyond retrieval and haystacks

Amey Hengle, Prasoon Bajpai, Soham Dan, Tanmoy Chakraborty

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 33 Pages in Total - 23 (Main Manuscript) + 10 (Appendix)

MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory

Ali Modarressi, Abdullatif Köksal, Ayyoob Imani, Mohsen Fayyaz, Hinrich Schütze

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Published in Transactions on Machine Learning Research (TMLR)

AppAgentX: Evolving GUI Agents as Proficient Smartphone Users

Wenjia Jiang, Yangyang Zhuang, Chenxi Song, Xu Yang, Joey Tianyi Zhou, Chi Zhang

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility

Yonglin Tian, Fei Lin, Yiduo Li, Tengchao Zhang, Qiyao Zhang, Xuan Fu, Jun Huang, Xingyuan Dai, Yutong Wang, Chunwei Tian, Bai Li, Yisheng Lv, Levente Kovács, Fei-Yue Wang

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Journal ref Information Fusion, Volume 122, 2025, 103158

VidCtx: Context-aware Video Question Answering with Image Models

Andreas Goulas, Vasileios Mezaris, Ioannis Patras

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted in IEEE ICME 2025. This is the authors' accepted version

AdaCM$^2$: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction

Yuanbin Man, Ying Huang, Chengming Zhang, Bingzhe Li, Wei Niu, Miao Yin

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments CVPR 2025 Highlight

ToolGen: Unified Tool Retrieval and Calling via Generation

Renxi Wang, Xudong Han, Lei Ji, Shu Wang, Timothy Baldwin, Haonan Li

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments ICLR 2025

ReWind: Understanding Long Videos with Instructed Learnable Memory

Anxhelo Diko, Tinghuai Wang, Wassim Swaileh, Shiyan Sun, Ioannis Patras

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI