语言大模型 / LLM - arXivDaily 专题

2505.06297 2025-05-13 cs.LG cs.CL 90%

Lossless Compression of Large Language Model-Generated Text via Next-Token Prediction

Yu Mao, Holger Pirk, Chun Jason Xue

机构 * MBZUAI（穆扎布伊人工智能研究院）； Imperial College London（伦敦帝国理工学院）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2505.06267 2025-05-13 cs.SE cs.AI cs.LG 90%

AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks

Ilyas Oulkadda, Julien Perez

机构 * Laboratoire de Recherche de l'EPITA (LRE)（EPITA研究实验室）； Department of XXX, University of YYY（YYY大学XXX系）； School of ZZZ, Institute of WWW（WWW研究所ZZZ学院）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2410.09982 2025-05-13 cs.LG cs.CL 90%

Self-Data Distillation for Recovering Quality in Pruned Large Language Models

Vithursan Thangarasa, Ganesh Venkatesh, Mike Lasby, Nish Sinnadurai, Sean Lie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.LG

Comments Accepted to MLSys 2025. Main paper: 14 pp., 4 figs., 6 tabs.; Supplementary: 5 pp

2505.03804 2025-05-08 cs.LG cs.AI 90%

MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance

Xing Hu, Zhixuan Chen, Dawei Yang, Zukang Xu, Chen Xu, Zhihang Yuan, Sifan Zhou, Jiangyong Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.AI、cs.LG

2505.03756 2025-05-08 cs.AR cs.AI cs.LG cs.PF 90%

Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management

Hang Zhang, Jiuchen Shi, Yixiao Wang, Quan Chen, Yizhou Shan, Minyi Guo

机构 * Shanghai Jiao Tong University（上海交通大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2504.20500 2025-04-30 cs.CL cs.LG 90%

UniDetox: Universal Detoxification of Large Language Models via Dataset Distillation

Huimin Lu, Masaru Isonuma, Junichiro Mori, Ichiro Sakata

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ICLR 2025 (poster)

2408.16073 2025-04-28 cs.CL cs.AI 90%

Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings

Leo Yeykelis, Kaavya Pichai, James J. Cummings, Byron Reeves

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 40 pages, 13 figures, 3 tables

2310.13561 2025-04-28 cs.CL cs.LG 90%

Cache & Distil: Optimising API Calls to Large Language Models

Guillem Ramírez, Matthias Lindemann, Alexandra Birch, Ivan Titov

机构 * ILCC, University of Edinburgh（ILCC、爱丁堡大学）； ILLC, University of Amsterdam（ILLC、阿姆斯特丹大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Journal ref Findings of the Association for Computational Linguistics: ACL 2024

2504.17674 2025-04-25 cs.CL cs.LG 90%

Energy Considerations of Large Language Model Inference and Efficiency Optimizations

Jared Fernandez, Clara Na, Vashisth Tiwari, Yonatan Bisk, Sasha Luccioni, Emma Strubell

机构 * Carnegie Mellon University（卡内基梅隆大学）； Hugging Face

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 16 pages

2504.09223 2025-04-15 cs.CV cs.AI cs.LG 90%

DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models

Wenjin Ke, Zhe Li, Dong Li, Lu Tian, Emad Barsoum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.AI、cs.LG

Journal ref https://aclanthology.org/2024.emnlp-industry.10/

2502.17189 2025-04-15 cs.LG cs.AI 90%

IGDA: Interactive Graph Discovery through Large Language Model Agents

Alex Havrilla, David Alvarez-Melis, Nicolo Fusi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2504.07624 2025-04-11 cs.CL cs.AI cs.IR 90%

ConceptFormer: Towards Efficient Use of Knowledge-Graph Embeddings in Large Language Models

Joel Barmettler, Abraham Bernstein, Luca Rossetto

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2407.04752 2025-04-11 cs.LG cs.CL cs.NE 90%

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking

Xingrun Xing, Boyan Gao, Zheng Zhang, David A. Clifton, Shitao Xiao, Li Du, Guoqi Li, Jiajun Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2504.04514 2025-04-10 cs.CL cs.AI 90%

Saliency-driven Dynamic Token Pruning for Large Language Models

Yao Tao, Yehui Tang, Yun Wang, Mingjian Zhu, Hailin Hu, Yunhe Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2504.02858 2025-04-07 cs.CL cs.LG 90%

Optimizing Humor Generation in Large Language Models: Temperature Configurations and Architectural Trade-offs

Evgenii Evstafev

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 10 pages, 4 figures

2503.24377 2025-04-01 cs.CL cs.AI 90%

Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

Rui Wang, Hongru Wang, Boyang Xue, Jianhui Pang, Shudong Liu, Yi Chen, Jiahao Qiu, Derek Fai Wong, Heng Ji, Kam-Fai Wong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI

Comments In Progress; Paper list Repo: https://github.com/DevoAllen/Awesome-Reasoning-Economy-Papers

2503.24000 2025-04-01 cs.LG cs.AI 90%

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving

Wei Gao, Xinyu Zhou, Peng Sun, Tianwei Zhang, Yonggang Wen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 21 pages, 18 figures, published to MLSys2025

2503.23924 2025-04-01 cs.CL cs.LG 90%

Model Hemorrhage and the Robustness Limits of Large Language Models

Ziyang Ma, Zuchao Li, Lefei Zhang, Gui-Song Xia, Bo Du, Liangpei Zhang, Dacheng Tao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 33 pages, 18 figures

2503.19455 2025-03-26 cs.LG cs.AI 90%

Data-centric Federated Graph Learning with Large Language Models

Bo Yan, Zhongjian Zhang, Huabin Sun, Mengmei Zhang, Yang Cao, Chuan Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ongoing work

2503.11989 2025-03-21 cs.CL cs.AI 90%

Applications of Large Language Model Reasoning in Feature Generation

Dharani Chandra

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments I just updated the format of the references in the paper

2407.18921 2025-03-21 cs.NI cs.AI cs.LG 90%

Mobile Edge Intelligence for Large Language Models: A Contemporary Survey

Guanqiao Qu, Qiyuan Chen, Wei Wei, Zheng Lin, Xianhao Chen, Kaibin Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 42 pages, 17 figures. This paper has been accepted by IEEE Communications Surveys & Tutorials

2409.17870 2025-03-14 cs.LG cs.AI cs.AR 90%

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

Shaobo Ma, Chao Fang, Haikuo Shao, Zhongfeng Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments This paper is accepted by ASP-DAC 2025

2503.08045 2025-03-12 cs.LG cs.CL 90%

Adapting Large Language Models for Parameter-Efficient Log Anomaly Detection

Ying Fu Lim, Jiawen Zhu, Guansong Pang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 5 figures, accepted by PAKDD 2025 special session

2503.06808 2025-03-11 cs.CR cs.AI cs.LG 90%

Privacy Auditing of Large Language Models

Ashwinee Panda, Xinyu Tang, Milad Nasr, Christopher A. Choquette-Choo, Prateek Mittal

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2025

2312.05657 2025-03-11 cs.LG cs.AI cs.PL cs.SE 90%

PerfRL: A Small Language Model Framework for Efficient Code Optimization

Shukai Duan, Nikos Kanakaris, Xiongye Xiao, Heng Ping, Chenyu Zhou, Nesreen K. Ahmed, Guixiang Ma, Mihai Capota, Theodore L. Willke, Shahin Nazarian, Paul Bogdan

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

2410.21083 2025-03-07 cs.CL cs.AI 90%

Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring

Honglin Mu, Han He, Yuxin Zhou, Yunlong Feng, Yang Xu, Libo Qin, Xiaoming Shi, Zeming Liu, Xudong Han, Qi Shi, Qingfu Zhu, Wanxiang Che

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by NAACL 2025

2409.13744 2025-03-06 cs.CL cs.AI cs.IR 90%

A Simplified Retriever to Improve Accuracy of Phenotype Normalizations by Large Language Models

Daniel B. Hier, Thanh Son Do, Tayo Obafemi-Ajayi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Published by Frontiers in Digital Health

Journal ref Frontiers in Digital Health 7, (2025): 1495040. Accessed March 4, 2025

2402.10767 2025-03-04 cs.CL cs.AI 90%

Inference to the Best Explanation in Large Language Models

Dhairya Dalal, Marco Valentino, André Freitas, Paul Buitelaar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Journal ref ACL.1(2024)217-235

2503.00177 2025-03-04 cs.LG cs.AI 90%

Steering Large Language Model Activations in Sparse Spaces

Reza Bayat, Ali Rahimi-Kalahroudi, Mohammad Pezeshki, Sarath Chandar, Pascal Vincent

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2409.06666 2025-03-04 cs.CL cs.AI cs.SD eess.AS 90%

LLaMA-Omni: Seamless Speech Interaction with Large Language Models

Qingkai Fang, Shoutao Guo, Yan Zhou, Zhengrui Ma, Shaolei Zhang, Yang Feng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025

1. 效率与部署 22368 篇

Lossless Compression of Large Language Model-Generated Text via Next-Token Prediction

AKD : Adversarial Knowledge Distillation For Large Language Models Alignment on Coding tasks

Self-Data Distillation for Recovering Quality in Pruned Large Language Models

MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance

Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management

UniDetox: Universal Detoxification of Large Language Models via Dataset Distillation

Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings

Cache & Distil: Optimising API Calls to Large Language Models

Energy Considerations of Large Language Model Inference and Efficiency Optimizations

DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models

IGDA: Interactive Graph Discovery through Large Language Model Agents

ConceptFormer: Towards Efficient Use of Knowledge-Graph Embeddings in Large Language Models

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking

Saliency-driven Dynamic Token Pruning for Large Language Models

Optimizing Humor Generation in Large Language Models: Temperature Configurations and Architectural Trade-offs

Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

Rethinking Key-Value Cache Compression Techniques for Large Language Model Serving

Model Hemorrhage and the Robustness Limits of Large Language Models

Data-centric Federated Graph Learning with Large Language Models

Applications of Large Language Model Reasoning in Feature Generation

Mobile Edge Intelligence for Large Language Models: A Contemporary Survey

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

Adapting Large Language Models for Parameter-Efficient Log Anomaly Detection

Privacy Auditing of Large Language Models

PerfRL: A Small Language Model Framework for Efficient Code Optimization

Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring

A Simplified Retriever to Improve Accuracy of Phenotype Normalizations by Large Language Models

Inference to the Best Explanation in Large Language Models

Steering Large Language Model Activations in Sparse Spaces

LLaMA-Omni: Seamless Speech Interaction with Large Language Models