语言大模型 / LLM - arXivDaily 专题

2408.16978 2025-05-14 cs.DC cs.AI cs.LG 86%

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Jinghan Yao, Sam Ade Jacobs, Masahiro Tanaka, Olatunji Ruwase, Hari Subramoni, Dhabaleswar K. Panda

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.AI、cs.LG

Comments The Eighth Annual Conference on Machine Learning and Systems (MLSys'25)

2502.09017 2025-04-09 cs.CL cs.LG 86%

Diversity Enhances an LLM's Performance in RAG and Long-context Task

Zhichao Wang, Bin Bi, Yanqi Luo, Sitaram Asur, Claire Na Cheng

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2503.17994 2025-03-25 cs.CL cs.AI 86%

Instructing the Architecture Search for Spatial-temporal Sequence Forecasting with LLM

Xin Xue, Haoyi Zhou, Tianyu Chen, Shuai Zhang, Yizhou Long, Jianxin Li

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2503.16071 2025-03-21 cs.CL cs.AI cs.IR 86%

Tuning LLMs by RAG Principles: Towards LLM-native Memory

Jiale Wei, Shuchi Wu, Ruochen Liu, Xiang Ying, Jingbo Shang, Fangbo Tao

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2503.07903 2025-03-12 cs.CL cs.LG 86%

Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?

Payel Das, Ching-Yun Ko, Sihui Dai, Georgios Kollias, Subhajit Chaudhury, Aurelie Lozano

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.LG

2503.04874 2025-03-10 cs.CL cs.LG 86%

Memory Is All You Need: Testing How Model Memory Affects LLM Performance in Annotation Tasks

Joan C. Timoneda, Sebastián Vallejo Vera

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2503.02628 2025-03-05 cs.CL cs.AI 86%

Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction

Wenxuan Liu, Zixuan Li, Long Bai, Yuxin Zuo, Daozhu Xu, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Work in progress

2502.15007 2025-02-24 cs.CL cs.AI 86%

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

Anton Razzhigaev, Matvey Mikhalchuk, Temurbek Rahmatullaev, Elizaveta Goncharova, Polina Druzhinina, Ivan Oseledets, Andrey Kuznetsov

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments accepted to NAACL 2025

2412.13148 2025-02-24 cs.LG cs.AI 86%

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training

Chao Ma, Wenbo Gong, Meyer Scetbon, Edward Meeds

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments In v2 we have revised the related work, added more comprehensive citations, and clarified our key contributions

2406.06773 2025-02-14 cs.CL cs.AI 86%

Evaluating Zero-Shot Long-Context LLM Compression

Chenyu Wang, Yihan Wang, Kai Li

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2406.05925 2025-02-14 cs.CL cs.AI 86%

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

Hao Li, Chenghao Yang, An Zhang, Yang Deng, Xiang Wang, Tat-Seng Chua

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL 2025

2502.08910 2025-02-14 cs.CL cs.LG 86%

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Heejun Lee, Geon Park, Jaduk Suh, Sung Ju Hwang

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments 21 pages

2502.08586 2025-02-13 cs.LG cs.AI 86%

Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks

Ang Li, Yin Zhou, Vethavikashini Chithrra Raghuram, Tom Goldstein, Micah Goldblum

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2412.15266 2024-12-23 cs.CL cs.AI 86%

On the Structural Memory of LLM Agents

Ruihong Zeng, Jinyuan Fang, Siwei Liu, Zaiqiao Meng

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2412.05896 2024-12-10 cs.LG cs.CL 86%

XKV: Personalized KV Cache Memory Reduction for Long-Context LLM Inference

Weizhuo Li, Zhigang Wang, Yu Gu, Ge Yu

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2410.18533 2024-10-25 cs.CL cs.AI 86%

LOGO -- Long cOntext aliGnment via efficient preference Optimization

Zecheng Tang, Zechen Sun, Juntao Li, Qiaoming Zhu, Min Zhang

专题命中长上下文与记忆：preference optimization(title,abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

2312.03003 2024-10-17 cs.HC cs.AI cs.CL 86%

Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automation

Sunjae Lee, Junyoung Choi, Jungjae Lee, Munim Hasan Wasi, Hojun Choi, Steven Y. Ko, Sangeun Oh, Insik Shin

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2409.11844 2024-09-19 cs.CL cs.AI 86%

MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts

Tianle Gu, Kexin Huang, Ruilin Luo, Yuanqi Yao, Yujiu Yang, Yan Teng, Yingchun Wang

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2409.04774 2024-09-10 cs.CL cs.AI 86%

Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models

Junfeng Tian, Da Zheng, Yang Cheng, Rui Wang, Colin Zhang, Debing Zhang

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2405.04324 2024-05-08 cs.AI cs.CL cs.SE 86%

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Mayank Mishra, Matt Stallone, Gaoyuan Zhang, Yikang Shen, Aditya Prasad, Adriana Meza Soria, Michele Merler, Parameswaran Selvam, Saptha Surendran, Shivdeep Singh, Manish Sethi, Xuan-Hong Dang, Pengyuan Li, Kun-Lung Wu, Syed Zawad, Andrew Coleman, Matthew White, Mark Lewis, Raju Pavuluri, Yan Koyfman, Boris Lublinsky, Maximilien de Bayser, Ibrahim Abdelaziz, Kinjal Basu, Mayank Agarwal, Yi Zhou, Chris Johnson, Aanchal Goyal, Hima Patel, Yousaf Shah, Petros Zerfos, Heiko Ludwig, Asim Munawar, Maxwell Crouse, Pavan Kapanipathi, Shweta Salaria, Bob Calio, Sophia Wen, Seetharami Seelam, Brian Belgodere, Carlos Fonseca, Amith Singhee, Nirmit Desai, David D. Cox, Ruchir Puri, Rameswar Panda

专题命中长上下文与记忆：foundation model(title)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Corresponding Authors: Rameswar Panda, Ruchir Puri; Equal Contributors: Mayank Mishra, Matt Stallone, Gaoyuan Zhang

2309.17453 2024-04-09 cs.CL cs.AI 86%

Efficient Streaming Language Models with Attention Sinks

Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments ICLR 2024

2401.15463 2024-01-30 cs.CL cs.AI 86%

DataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure

Junyi Ye, Mengnan Du, Guiling Wang

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2305.11554 2024-01-17 cs.CL cs.LG 86%

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings

Shibo Hao, Tianyang Liu, Zhen Wang, Zhiting Hu

专题命中长上下文与记忆：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments NeurIPS 2023 (oral). Code: https://github.com/Ber666/ToolkenGPT

2311.13743 2023-12-05 q-fin.CP cs.AI cs.CE cs.LG 86%

FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design

Yangyang Yu, Haohang Li, Zhi Chen, Yuechen Jiang, Yang Li, Denghui Zhang, Rong Liu, Jordan W. Suchow, Khaldoun Khashanah

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2602.22402 2026-02-27 cs.SE cs.AI cs.HC cs.OS 86%

Contextual Memory Virtualisation: DAG-Based State Management and Structurally Lossless Trimming for LLM Agents

上下文记忆虚拟化：基于DAG的状态管理和结构无损修剪用于LLM代理

Cosmo Santoni

机构 * Imperial College London（伦敦帝国学院）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

AI总结上下文记忆虚拟化通过DAG结构管理和无损修剪技术，提升LLM代理在长期推理任务中的上下文重用效率和经济性。

Comments 11 pages. 6 figures. Introduces a DAG-based state management system for LLM agents. Evaluation on 76 coding sessions shows up to 86% token reduction (mean 20%) while remaining economically viable under prompt caching. Includes reference implementation for Claude Code

2503.12511 2025-12-24 cs.SE cs.AI cs.PL 86%

SACTOR: LLM-Driven Correct and Idiomatic C to Rust Translation with Static Analysis and FFI-Based Verification

SACTOR：基于大语言模型的C到Rust翻译工具，结合静态分析和FFI验证

Tianyang Zhou, Ziyi Zhang, Haowen Lin, Somesh Jha, Mihai Christodorescu, Kirill Levchenko, Varun Chandrasekaran

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）； University of Wisconsin–Madison（威斯康星大学麦迪逊分校）； Google（谷歌）

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

AI总结 SACTOR通过结合静态分析和FFI验证，利用大语言模型实现C到Rust的正确且习惯性翻译，提升了代码安全性和效率

Comments 35 pages, 15 figures Previously named as "LLM-Driven Multi-step Translation from C to Rust using Static Analysis"

2508.08322 2025-08-13 cs.SE cs.AI 86%

Context Engineering for Multi-Agent LLM Code Assistants Using Elicit, NotebookLM, ChatGPT, and Claude Code

Muhammad Haseeb

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 15 pages, 5 figures, research paper on multi-agent LLM systems for code generation

2407.06567 2024-11-08 cs.CL 86%

FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making

Yangyang Yu, Zhiyuan Yao, Haohang Li, Zhiyang Deng, Yupeng Cao, Zhi Chen, Jordan W. Suchow, Rong Liu, Zhenyu Cui, Zhaozhuo Xu, Denghui Zhang, Koduvayur Subbalakshmi, Guojun Xiong, Yueru He, Jimin Huang, Dong Li, Qianqian Xie

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments LLM Applications, LLM Agents, Financial Technology, Quantitative Finance, Algorithmic Trading, Cognitive Science

2308.15272 2024-03-12 cs.AI cs.SE 86%

AutoDroid: LLM-powered Task Automation in Android

Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu

专题命中长上下文与记忆：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Published in MobiCom 2024; Original title: "Empowering LLM to use Smartphone for Intelligent Task Automation"

2506.01952 2026-08-11 cs.CL cs.AI cs.LG 版本更新 86%

WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks

WebChoreArena：在现实繁琐网页任务上评估网页浏览智能体

Atsuyuki Miyai, Zaiying Zhao, Kazuki Egashira, Atsuki Sato, Tatsumi Sunada, Shota Onohara, Hiromasa Yamanishi, Mashiro Toyooka, Kunato Nishina, Ryoma Maeda, Kiyoharu Aizawa, Toshihiko Yamasaki

专题命中长上下文与记忆：LLM(summary_cn,abstract_cn)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

AI总结本文提出WebChoreArena，作为WebArena的扩展，包含532个耗时300多小时开发的繁琐网页任务，从大规模记忆、计算、长期记忆三维度评估网页浏览智能体，实验显示其能清晰衡量LLM进展且难度高于WebArena。

Comments COLM2026. Project Page: https://webchorearena.github.io/

1. 长上下文与记忆 4797 篇

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Diversity Enhances an LLM's Performance in RAG and Long-context Task

Instructing the Architecture Search for Spatial-temporal Sequence Forecasting with LLM

Tuning LLMs by RAG Principles: Towards LLM-native Memory

Can Memory-Augmented Language Models Generalize on Reasoning-in-a-Haystack Tasks?

Memory Is All You Need: Testing How Model Memory Affects LLM Performance in Annotation Tasks

Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction

LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training

Evaluating Zero-Shot Long-Context LLM Compression

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks

On the Structural Memory of LLM Agents

XKV: Personalized KV Cache Memory Reduction for Long-Context LLM Inference

LOGO -- Long cOntext aliGnment via efficient preference Optimization

Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automation

MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts

Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Efficient Streaming Language Models with Attention Sinks

DataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings

FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design

Contextual Memory Virtualisation: DAG-Based State Management and Structurally Lossless Trimming for LLM Agents

SACTOR: LLM-Driven Correct and Idiomatic C to Rust Translation with Static Analysis and FFI-Based Verification

Context Engineering for Multi-Agent LLM Code Assistants Using Elicit, NotebookLM, ChatGPT, and Claude Code

FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making

AutoDroid: LLM-powered Task Automation in Android

WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks