语言大模型 / LLM

EmBARDiment: an Embodied AI Agent for Productivity in XR

Riccardo Bovo, Steven Abreu, Karan Ahuja, Eric J Gonzalez, Li-Te Cheng, Mar Gonzalez-Franco

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Journal ref IEEE Virtual Reality Conference 2025

EliteKV: Scalable KV Cache Compression via RoPE Frequency Selection and Joint Low-Rank Projection

Yuhao Zhou, Sirui Song, Boyang Liu, Zhiheng Xi, Senjie Jin, Xiaoran Fan, Zhihao Zhang, Wei Li, Xuanjing Huang

专题命中 长上下文与记忆 ：foundation model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 13 pages, 8 figures

GPT4Image: Large Pre-trained Models Help Vision Models Learn Better on Perception Task

Ning Ding, Yehui Tang, Zhongqian Fu, Chao Xu, Kai Han, Yunhe Wang

专题命中 长上下文与记忆 ：LLM(abstract)；prompting(abstract)

Comments GitHub: https://github.com/huawei-noah/Efficient-Computing/tree/master/GPT4Image/

Be CIM or Be Memory: A Dual-mode-aware DNN Compiler for CIM Accelerators

Shixin Zhao, Yuming Li, Bing Li, Yintao He, Mengdi Wang, Yinhe Han, Ying Wang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 16 pages, 18 figures, accepted to ASPLOS 2025

Memory Helps, but Confabulation Misleads: Understanding Streaming Events in Videos with MLLMs

Gengyuan Zhang, Mingcong Ding, Tong Liu, Yao Zhang, Volker Tresp

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Short paper (5 pages)

AQUA: Network-Accelerated Memory Offloading for LLMs in Scale-Up GPU Domains

Abhishek Vijaya Kumar, Gianni Antichi, Rachee Singh

专题命中 长上下文与记忆 ：LLM(abstract)；language model(abstract)

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs

Kan Zhu, Tian Tang, Qinyu Xu, Yile Gu, Zhichen Zeng, Rohan Kadekodi, Liangyu Zhao, Ang Li, Arvind Krishnamurthy, Baris Kasikci

专题命中 长上下文与记忆 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities

Peng Xu, Wei Ping, Xianchao Wu, Chejian Xu, Zihan Liu, Mohammad Shoeybi, Bryan Catanzaro

专题命中 长上下文与记忆 ：instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at ICLR 2025

Open-Source AI-Powered Optimization in Scalene: Advancing Python Performance Profiling with DeepSeek-R1 and LLaMA 3.2

Saem Hasan, Sanju Basak

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

An Evolved Universal Transformer Memory

Edoardo Cetin, Qi Sun, Tianyu Zhao, Yujin Tang

专题命中 长上下文与记忆 ：foundation model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at ICLR 2025. Source code available at https://github.com/SakanaAI/evo-memory

Distributed Approach to Haskell Based Applications Refactoring with LLMs Based Multi-Agent Systems

Shahbaz Siddeeq, Zeeshan Rasheed, Malik Abdul Sami, Mahade Hasan, Muhammad Waseem, Jussi Rasku, Mika Saari, Kai-Kristian Kemell, Pekka Abrahamsson

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

DINT Transformer

Yueyang Cang, Yuhang Liu, Xiaoteng Zhang, Erlu Zhao, Li Shi

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2410.05258 by other authors

MicroPython Testbed for Federated Learning Algorithms

Miroslav Popovic, Marko Popovic, Ivan Kastelan, Miodrag Djukic, Ilija Basicevic

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 20 pages, 6 figures, 12 tables, the extended paper preprint

LongKey: Keyphrase Extraction for Long Documents

Jeovane Honorio Alves, Radu State, Cinthia Obladen de Almendra Freitas, Jean Paul Barddal

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for presentation at the 2024 IEEE International Conference on Big Data (IEEE BigData 2024). Code available at https://github.com/jeohalves/longkey

Titans: Learning to Memorize at Test Time

Ali Behrouz, Peilin Zhong, Vahab Mirrokni

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

HiCM$^2$: Hierarchical Compact Memory Modeling for Dense Video Captioning

Minkuk Kim, Hyeon Bae Kim, Jinyoung Moon, Jinwoo Choi, Seong Tae Kim

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments AAAI2025

MarketGPT: Developing a Pre-trained transformer (GPT) for Modeling Financial Time Series

Aaron Wheeler, Jeffrey D. Varner

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 13 pages, 8 figures

Empowering Agile-Based Generative Software Development through Human-AI Teamwork

Sai Zhang, Zhenchang Xing, Ronghui Guo, Fangzhou Xu, Lei Chen, Zhaoyuan Zhang, Xiaowang Zhang, Zhiyong Feng, Zhiqiang Zhuang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments This paper is accepted by ACM TOSEM

Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks

Mathis Pink, Vy A. Vo, Qinyuan Wu, Jianing Mu, Javier S. Turek, Uri Hasson, Kenneth A. Norman, Sebastian Michelmann, Alexander Huth, Mariya Toneva

专题命中 长上下文与记忆 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Visual Context Window Extension: A New Perspective for Long Video Understanding

Hongchen Wei, Zhenzhong Chen

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 14 pages, 4 figures

Benchmarking ChatGPT, Codeium, and GitHub Copilot: A Comparative Study of AI-Driven Programming and Debugging Assistants

Md Sultanul Islam Ovi, Nafisa Anjum, Tasmina Haque Bithe, Md. Mahabubur Rahman, Mst. Shahnaj Akter Smrity

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position

Kechi Zhang, Ge Li, Huangzhao Zhang, Zhi Jin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Camera Ready version for ACL 2024 (main)

MEIA: Multimodal Embodied Perception and Interaction in Unknown Environments

Yang Liu, Xinshuai Song, Kaixuan Jiang, Weixing Chen, Jingzhou Luo, Guanbin Li, Liang Lin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Codes will be available at https://github.com/HCPLab-SYSU/Embodied_AI_Paper_List

Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams

Haoji Zhang, Yiqin Wang, Yansong Tang, Yong Liu, Jiashi Feng, Jifeng Dai, Xiaojie Jin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization

Shida Wang, Qianxiao Li

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 28 pages, 7 figures, ICML 2024

Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

Alex Jinpeng Wang, Linjie Li, Yiqi Lin, Min Li, Lijuan Wang, Mike Zheng Shou

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 12 pages. The website is \url{https://fingerrec.github.io/visincontext}

PostDoc: Generating Poster from a Long Multimodal Document Using Deep Submodular Optimization

Vijay Jaisankar, Sambaran Bandyopadhyay, Kalp Vyas, Varre Chaitanya, Shwetha Somasundaram

专题命中 长上下文与记忆 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation

Jennifer A Bishop, Qianqian Xie, Sophia Ananiadou

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments This paper has been published in LREC-COLING 2024, Pages 10777-10789 and was presented as an oral presentation during the conference held in Turin, Italy. The published version is available at https://aclanthology.org/2024.lrec-main.941. 13 pages, 5 figures

Journal ref Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

A Framework for Inference Inspired by Human Memory Mechanisms

Xiangyu Zeng, Jie Lin, Piao Hu, Ruizheng Huang, Zhicheng Zhang

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents

Bolun "Namir" Xia, Vipula D. Rawte, Mohammed J. Zaki, Aparna Gupta

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 9 figures, 7 tables