语言大模型 / LLM - arXivDaily 专题

2505.12423 2025-05-20 cs.CL cs.AI 88%

PSC: Extending Context Window of Large Language Models via Phase Shift Calibration

Wenqiao Zhu, Chao Xu, Lulu Wang, Jun Wu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2405.15523 2025-05-16 cs.CL cs.LG 88%

The Mosaic Memory of Large Language Models

Igor Shilov, Matthieu Meeus, Yves-Alexandre de Montjoye

机构 * Imperial College London（伦敦帝国学院）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2405.19846 2025-02-12 cs.CL cs.AI 88%

Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model

Chaochen Gao, Xing Wu, Qi Fu, Songlin Hu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025

2405.14831 2025-01-15 cs.CL cs.AI 88%

HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models

Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga, Yu Su

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2024. Code and data: https://github.com/OSU-NLP-Group/HippoRAG

2412.17339 2024-12-24 cs.AI cs.CL 88%

MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Models

Beibei Yu, Tao Shen, Hongbin Na, Ling Chen, Denqi Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2412.15501 2024-12-23 cs.CL cs.AI 88%

Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models

Zhisheng Tang, Mayank Kejriwal

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2409.08435 2024-11-22 cs.CL cs.AI 88%

When Context Leads but Parametric Memory Follows in Large Language Models

Yufei Tao, Adam Hiatt, Erik Haake, Antonie J. Jetter, Ameeta Agrawal

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024 Main Conference

2405.18009 2024-11-19 cs.CL cs.LG 88%

Exploring Context Window of Large Language Models via Decomposed Positional Vectors

Zican Dong, Junyi Li, Xin Men, Wayne Xin Zhao, Bingbing Wang, Zhen Tian, Weipeng Chen, Ji-Rong Wen

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by Neurips 2024 as a spotlight

2411.02674 2024-11-12 cs.CL cs.AI 88%

Wave Network: An Ultra-Small Language Model

Xin Zhang, Victor S. Sheng

专题命中长上下文与记忆：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI

2406.14550 2024-11-06 cs.CL cs.AI 88%

GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models

Shilong Li, Yancheng He, Hangyu Guo, Xingyuan Bu, Ge Bai, Jie Liu, Jiaheng Liu, Xingwei Qu, Yangguang Li, Wanli Ouyang, Wenbo Su, Bo Zheng

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments [EMNLP 2024] The first four authors contributed equally, 29 pages

2411.02036 2024-11-05 cs.CL cs.AI 88%

Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models

Francisco de Arriba-Pérez, Silvia García-Méndez, Javier Otero-Mosquera, Francisco J. González-Castaño

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref Applied Intelligence, 1-16 (2024)

2312.17257 2024-10-15 cs.CL cs.AI 88%

Personalized Large Language Model Assistant with Evolving Conditional Memory

Ruifeng Yuan, Shichao Sun, Yongqi Li, Zili Wang, Ziqiang Cao, Wenjie Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2410.00428 2024-10-10 cs.DC cs.AI cs.LG 88%

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management

Yi Xiong, Hao Wu, Changxu Shao, Ziqing Wang, Rui Zhang, Yuhong Guo, Junping Zhao, Ke Zhang, Zhenxuan Pan

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments 11 pages, 7 figures, 1 table

2403.08424 2024-10-01 cs.CR cs.AI cs.CL 88%

Distract Large Language Models for Automatic Jailbreak Attack

Zeguan Xiao, Yan Yang, Guanhua Chen, Yun Chen

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2024

2409.18454 2024-09-30 cs.CL cs.AI 88%

Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications

Aditi Godbole, Jabin Geevarghese George, Smita Shandilya

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2409.04164 2024-09-09 cs.CL cs.LG cs.SE 88%

Can OpenSource beat ChatGPT? -- A Comparative Study of Large Language Models for Text-to-Code Generation

Luis Mayer, Christian Heumann, Matthias Aßenmacher

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Conference Paper accepted at the 9th SwissText Conference (2024)

2408.13987 2024-08-27 cs.CL cs.AI 88%

Focused Large Language Models are Stable Many-Shot Learners

Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Heda Wang, Yao Hu, Kan Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages

2408.10151 2024-08-20 cs.CL cs.LG 88%

Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Models

Amey Hengle, Prasoon Bajpai, Soham Dan, Tanmoy Chakraborty

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2402.03009 2024-08-20 cs.CL cs.AI 88%

UniMem: Towards a Unified View of Long-Context Large Language Models

Junjie Fang, Likai Tang, Hongzhe Bi, Yujia Qin, Si Sun, Zhenyu Li, Haolun Li, Yongjian Li, Xin Cong, Yankai Lin, Yukun Yan, Xiaodong Shi, Sen Song, Zhiyuan Liu, Maosong Sun

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments COLM 2024

2408.00655 2024-08-15 cs.AI cs.CL 88%

SentenceVAE: Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context

Hongjun An, Yifan Chen, Zhe Sun, Xuelong Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments update the article

2401.02509 2024-07-09 q-bio.NC cs.AI cs.CL 88%

Memory, Consciousness and Large Language Model

Jitang Li, Jinzheng Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2308.16137 2024-06-26 cs.CL cs.AI 88%

LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models

Chi Han, Qifan Wang, Hao Peng, Wenhan Xiong, Yu Chen, Heng Ji, Sinong Wang

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2024 Outstanding paper, 9 pages, 6 figures

2406.15765 2024-06-25 cs.LG cs.CL 88%

Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

Zhongzhi Yu, Zheng Wang, Yonggan Fu, Huihong Shi, Khalid Shaikh, Yingyan Celine Lin

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2402.02244 2024-05-30 cs.CL cs.LG 88%

Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models

Xindi Wang, Mahsa Salmani, Parsa Omidi, Xiangyu Ren, Mehdi Rezagholizadeh, Armaghan Eshaghi

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to IJCAI 2024 Survey Track -- camera-ready version

2404.19234 2024-05-01 cs.AI cs.CL cs.DB 88%

Multi-hop Question Answering over Knowledge Graphs using Large Language Models

Abir Chakraborty

专题命中长上下文与记忆：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI

2401.18058 2024-02-01 cs.CL cs.LG 88%

LongAlign: A Recipe for Long Context Alignment of Large Language Models

Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, Juanzi Li

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2311.04661 2024-01-26 cs.CL cs.LG 88%

Massive Editing for Large Language Models via Meta Learning

Chenmien Tan, Ge Zhang, Jie Fu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2401.08683 2024-01-18 cs.AR cs.AI cs.LG cs.PL cs.SE 88%

Zero-Shot RTL Code Generation with Attention Sink Augmented Large Language Models

Selim Sandal, Ismail Akturk

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2307.02738 2023-10-04 cs.AI cs.CL cs.SC 88%

RecallM: An Adaptable Memory Mechanism with Temporal Understanding for Large Language Models

Brandon Kynoch, Hugo Latapie, Dwane van der Sluis

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 8 pages, 7 figures, 1 table, Our code is publicly available online at: https://github.com/cisco-open/DeepVision/tree/main/recallm

2509.18868 2025-09-24 cs.AI 88%

Memory in Large Language Models: Mechanisms, Evaluation and Evolution

Dianxing Zhang, Wendong Li, Kani Song, Jiaye Lu, Gang Li, Liuchun Yang, Sheng Li

专题命中长上下文与记忆：large language model(title)；language model(title)；LLM(abstract,comments)；pretraining(abstract)

Comments 50 pages, 1 figure, 8 tables This is a survey/framework paper on LLM memory mechanisms and evaluation

1. 长上下文与记忆 4797 篇

PSC: Extending Context Window of Large Language Models via Phase Shift Calibration

The Mosaic Memory of Large Language Models

Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model

HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models

MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Models

Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models

When Context Leads but Parametric Memory Follows in Large Language Models

Exploring Context Window of Large Language Models via Decomposed Positional Vectors

Wave Network: An Ultra-Small Language Model

GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models

Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained Large Language Models

Personalized Large Language Model Assistant with Evolving Conditional Memory

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management

Distract Large Language Models for Automatic Jailbreak Attack

Leveraging Long-Context Large Language Models for Multi-Document Understanding and Summarization in Enterprise Applications

Can OpenSource beat ChatGPT? -- A Comparative Study of Large Language Models for Text-to-Code Generation

Focused Large Language Models are Stable Many-Shot Learners

Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Models

UniMem: Towards a Unified View of Long-Context Large Language Models

SentenceVAE: Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context

Memory, Consciousness and Large Language Model

LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models

Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models

Multi-hop Question Answering over Knowledge Graphs using Large Language Models

LongAlign: A Recipe for Long Context Alignment of Large Language Models

Massive Editing for Large Language Models via Meta Learning

Zero-Shot RTL Code Generation with Attention Sink Augmented Large Language Models

RecallM: An Adaptable Memory Mechanism with Temporal Understanding for Large Language Models

Memory in Large Language Models: Mechanisms, Evaluation and Evolution