语言大模型 / LLM - arXivDaily 专题

2507.00453 2025-07-02 cs.LG 79%

Recurrent Memory-Augmented Transformers with Chunked Attention for Long-Context Language Modeling

Ankit Kashyap

机构 * Independent Researcher（独立研究者）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.LG

Comments 19 pages, 9 figures, 1 table; implemented entirely from scratch in PyTorch

2506.09591 2025-06-12 cs.CL 79%

Memorization in Language Models through the Lens of Intrinsic Dimension

Stefan Arnold

机构 * Friedrich-Alexander-Universität Erlangen-Nürnberg（埃朗根-纽伦堡弗里德里希-亚历山大大学）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2505.20718 2025-05-29 cs.CV cs.AI 79%

VLM Can Be a Good Assistant: Enhancing Embodied Visual Tracking with Self-Improving Vision-Language Models

Kui Wu, Shuhang Xu, Hao Chen, Churan Wang, Zhoujun Li, Yizhou Wang, Fangwei Zhong

机构 * State Key Laboratory of Complex & Critical Software Environment, Beihang University（北京航空航天大学复杂与关键软件环境国家重点实验室）； School of Artificial Intelligence, Beijing Normal University（北京师范大学人工智能学院）； City University of Macau（澳门城市大学）； Center on Frontiers of Computing Studies, School of Computer Science, Nat’l Eng. Research Center of Visual Technology, Peking University（北京大学计算机学院前沿计算研究中心、国家工程视觉技术研究中心）

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.AI

2502.04395 2025-05-27 cs.CV cs.LG 79%

Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting

Siru Zhong, Weilin Ruan, Ming Jin, Huan Li, Qingsong Wen, Yuxuan Liang

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.LG

Comments 20 pages

2502.13843 2025-04-21 cs.IR cs.AI 79%

AgentCF++: Memory-enhanced LLM-based Agents for Popularity-aware Cross-domain Recommendations

Jiahao Liu, Shengkang Gu, Dongsheng Li, Guangping Zhang, Mingzhe Han, Hansu Gu, Peng Zhang, Tun Lu, Li Shang, Ning Gu

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.AI

Comments Accepted by SIGIR 2025, 6 pages

2310.08948 2025-04-14 cs.CV cs.AI 79%

Federated Class-Incremental Learning with Prompting

Xin Luo, Fang-Yi Liang, Jiale Liu, Yu-Wei Zhan, Zhen-Duo Chen, Xin-Shun Xu

专题命中长上下文与记忆：prompting(title,abstract)；分类 cs.AI

2411.08909 2025-04-03 q-bio.BM cs.LG 79%

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers

Yingheng Wang, Zichen Wang, Gil Sadeh, Luca Zancato, Alessandro Achille, George Karypis, Huzefa Rangwala

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.LG

Comments model weights open-sourced at https://github.com/amazon-science/LC-PLM

2410.19732 2024-12-23 cs.CL cs.CV 79%

Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Models

Yucheng Zhou, Zhi Rao, Jun Wan, Jianbing Shen

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2404.04163 2024-10-29 cs.IR cs.CL 79%

Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrieval

João Coelho, Bruno Martins, João Magalhães, Jamie Callan, Chenyan Xiong

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2410.16775 2024-10-23 cs.CL 79%

Context-Aware LLM Translation System Using Conversation Summarization and Dialogue History

Mingi Sung, Seungmin Lee, Jiwon Kim, Sejoon Kim

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.CL

Comments Accepted to WMT 2024

2410.13510 2024-10-18 cs.CL cs.CV 79%

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Aditya Sharma, Aman Dalmia, Mehran Kazemi, Amal Zouaq, Christopher J. Pal

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2410.10469 2024-10-15 cs.LG stat.ML 79%

Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts

Xu Liu, Juncheng Liu, Gerald Woo, Taha Aksu, Yuxuan Liang, Roger Zimmermann, Chenghao Liu, Silvio Savarese, Caiming Xiong, Doyen Sahoo

专题命中长上下文与记忆：foundation model(title,abstract)；分类 cs.LG

2410.07192 2024-10-11 cs.DC cs.LG 79%

PipeFill: Using GPUs During Bubbles in Pipeline-parallel LLM Training

Daiyaan Arfeen, Zhen Zhang, Xinwei Fu, Gregory R. Ganger, Yida Wang

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.LG

2410.06519 2024-10-10 cs.CL 79%

SEGMENT+: Long Text Processing with Short-Context Language Models

Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2024

2410.05162 2024-10-08 cs.CL 79%

Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models

Mehrdad Farahani, Richard Johansson

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024

2409.13530 2024-09-23 cs.LG 79%

Towards Long-Context Time Series Foundation Models

Nina Żukowska, Mononito Goswami, Michał Wiliński, Willa Potosnak, Artur Dubrawski

专题命中长上下文与记忆：foundation model(title,abstract)；分类 cs.LG

2409.12264 2024-09-20 cs.LG stat.ML 79%

User-friendly Foundation Model Adapters for Multivariate Time Series Classification

Vasilii Feofanov, Romain Ilbert, Malik Tiomoko, Themis Palpanas, Ievgen Redko

专题命中长上下文与记忆：foundation model(title,abstract)；分类 cs.LG

Comments The first two authors contributed equally

2407.09498 2024-09-11 cs.CV cs.LG 79%

OT-VP: Optimal Transport-guided Visual Prompting for Test-Time Adaptation

Yunbei Zhang, Akshay Mehra, Jihun Hamm

专题命中长上下文与记忆：prompting(title,abstract)；分类 cs.LG

Comments WACV2025

2409.01666 2024-09-04 cs.CL 79%

In Defense of RAG in the Era of Long-Context Language Models

Tan Yu, Anbang Xu, Rama Akkiraju

专题命中长上下文与记忆：language model(title)；LLM(abstract)；分类 cs.CL

2404.04516 2024-08-09 cs.HC cs.CL cs.CY 79%

Language Models as Critical Thinking Tools: A Case Study of Philosophers

Andre Ye, Jared Moore, Rose Novick, Amy X. Zhang

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2404.06654 2024-08-08 cs.CL 79%

RULER: What's the Real Context Size of Your Long-Context Language Models?

Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, Yang Zhang, Boris Ginsburg

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments COLM 2024; Code is available at https://github.com/hsiehjackson/RULER

2408.03246 2024-08-07 cs.CL 79%

Making Long-Context Language Models Better Multi-Hop Reasoners

Yanyang Li, Shuo Liang, Michael R. Lyu, Liwei Wang

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments ACL 2024 Main Conference Camera Ready; Dataset, model, and code are available at https://github.com/LaVi-Lab/LongContextReasoner

2408.03062 2024-08-07 cs.CL 79%

Analysis of Argument Structure Constructions in a Deep Recurrent Language Model

Pegah Ramezani, Achim Schilling, Patrick Krauss

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2407.21778 2024-08-01 cs.AI cs.RO 79%

Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries

Felix Ocker, Daniel Tanneberg, Julian Eggert, Michael Gienger

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.AI

Comments 19 pages, 4 figures

2306.13421 2024-07-23 cs.CL 79%

Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval

Ohad Rubin, Jonathan Berant

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted to TACL 2024

2407.12784 2024-07-18 cs.LG cs.CR cs.IR 79%

AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases

Zhaorun Chen, Zhen Xiang, Chaowei Xiao, Dawn Song, Bo Li

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.LG

Comments 22 pages, 13 figures, 7 tables

2406.09444 2024-06-24 eess.AS cs.CL cs.SD 79%

GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model

Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2310.13418

2402.17682 2024-06-14 cs.CL 79%

NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

Tamara Czinczoll, Christoph Hönes, Maximilian Schall, Gerard de Melo

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments accepted at ACL 2024; camera-ready version; 9 pages

2402.12363 2024-06-11 cs.CL 79%

Emergent Word Order Universals from Cognitively-Motivated Language Models

Tatsuki Kuribayashi, Ryo Ueda, Ryo Yoshida, Yohei Oseki, Ted Briscoe, Timothy Baldwin

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2024 main conference, 22 pages

2310.15494 2023-12-21 cs.CL 79%

TRAMS: Training-free Memory Selection for Long-range Language Modeling

Haofei Yu, Cunxiang Wang, Yue Zhang, Wei Bi

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Findings of EMNLP 2023

1. 长上下文与记忆 4822 篇

Recurrent Memory-Augmented Transformers with Chunked Attention for Long-Context Language Modeling

Memorization in Language Models through the Lens of Intrinsic Dimension

VLM Can Be a Good Assistant: Enhancing Embodied Visual Tracking with Self-Improving Vision-Language Models

Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting

AgentCF++: Memory-enhanced LLM-based Agents for Popularity-aware Cross-domain Recommendations

Federated Class-Incremental Learning with Prompting

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers

Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Models

Dwell in the Beginning: How Language Models Embed Long Documents for Dense Retrieval

Context-Aware LLM Translation System Using Conversation Summarization and Dialogue History

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts

PipeFill: Using GPUs During Bubbles in Pipeline-parallel LLM Training

SEGMENT+: Long Text Processing with Short-Context Language Models

Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models

Towards Long-Context Time Series Foundation Models

User-friendly Foundation Model Adapters for Multivariate Time Series Classification

OT-VP: Optimal Transport-guided Visual Prompting for Test-Time Adaptation

In Defense of RAG in the Era of Long-Context Language Models

Language Models as Critical Thinking Tools: A Case Study of Philosophers

RULER: What's the Real Context Size of Your Long-Context Language Models?

Making Long-Context Language Models Better Multi-Hop Reasoners

Analysis of Argument Structure Constructions in a Deep Recurrent Language Model

Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries

Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval

AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases

GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model

NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

Emergent Word Order Universals from Cognitively-Motivated Language Models

TRAMS: Training-free Memory Selection for Long-range Language Modeling