语言大模型 / LLM

The Quantum LLM: Modeling Semantic Spaces with Quantum Principles

Timo Aukusti Laine

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 6 figures. Some corrections

Journal ref OA J Applied Sci Technol, 3(2), 01-13 (2025)

Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Models

Junda Zhao, Yuliang Song, Eldan Cohen

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted by the Journal of Systems and Software

FastVLM: Efficient Vision Encoding for Vision Language Models

Pavan Kumar Anasosalu Vasu, Fartash Faghri, Chun-Liang Li, Cem Koc, Nate True, Albert Antony, Gokul Santhanam, James Gabriel, Peter Grasch, Oncel Tuzel, Hadi Pouransari

机构 * Apple（苹果公司） 纠错

专题命中 效率与部署 ：language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments CVPR 2025

Parallel Scaling Law for Language Models

Mouxiang Chen, Binyuan Hui, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Jianling Sun, Junyang Lin, Zhongxin Liu

专题命中 效率与部署 ：language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.LG

Improving Block-Wise LLM Quantization by 4-bit Block-Wise Optimal Float (BOF4): Analysis and Variations

Patrick Blumenberg, Thomas Graave, Tim Fingscheidt

机构 * Insitute for Communications Technology, Technische Universität Braunschweig, Germany（通信技术研究所， Braunschweig技术大学） 纠错

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

A Simple Ensemble Strategy for LLM Inference: Towards More Stable Text Classification

Junichiro Niimi

机构 * Meijo University（明治大学） ； RIKEN（日本研究机构） ； AIP（Advanced Institute for Photonics） 纠错

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments This manuscript has been accepted for the 30th International Conference on Natural Language \& Information Systems (NLDB 2025) and will appear in Springer Lecture Notes in Computer Science (LNCS)

Faster MoE LLM Inference for Extremely Large Models

Haoqi Yang, Luohe Shi, Qiwei Li, Zuchao Li, Ping Wang, Bo Du, Mengjia Shen, Hai Zhao

机构 * Wuhan University（武汉大学） ； Wuhan Second Ship Design And Research Institute（武汉第二船舶设计研究所） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

GLaMoR: Consistency Checking of OWL Ontologies using Graph Language Models

Justin Mücke, Ansgar Scherp

机构 * Ulm University（乌尔姆大学） 纠错

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

VocalNet: Speech LLM with Multi-Token Prediction for Faster and High-Quality Generation

Yuhao Wang, Heyang Liu, Ziyang Cheng, Ronghua Wu, Qunshan Gu, Yanfeng Wang, Yu Wang

机构 * Shanghai Jiao Tong University（上海交通大学） ； Ant Group（蚂蚁集团） ； Wuhan University（武汉大学） 纠错

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Models

Xingguang Ji, Jiakang Wang, Hongzhi Zhang, Jingyuan Zhang, Haonan Zhou, Chenxi Sun, Yahui Liu, Qi Wang, Fuzheng Zhang

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Optimized Multi-Token Joint Decoding with Auxiliary Model for LLM Inference

Zongyue Qin, Ziniu Hu, Zifan He, Neha Prakriya, Jason Cong, Yizhou Sun

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Journal ref ICLR 2025

Geo-OLM: Enabling Sustainable Earth Observation Studies with Cost-Efficient Open Language Models & State-Driven Workflows

Dimitrios Stamoulis, Diana Marculescu

专题命中 效率与部署 ：language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals

Jaden Fiotto-Kaufman, Alexander R. Loftus, Eric Todd, Jannik Brinkmann, Koyena Pal, Dmitrii Troitskii, Michael Ripa, Adam Belfki, Can Rager, Caden Juang, Aaron Mueller, Samuel Marks, Arnab Sen Sharma, Francesca Lucchetti, Nikhil Prakash, Carla Brodley, Arjun Guha, Jonathan Bell, Byron C. Wallace, David Bau

专题命中 效率与部署 ：foundation model(title)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Code at https://nnsight.net

QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition

Yuxuan Hu, Xiaodong Chen, Cuiping Li, Hong Chen, Jing Zhang

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments 18 pages, 8 figures, 8 tables

AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration

Zhexuan Wang, Yutong Wang, Xuebo Liu, Liang Ding, Miao Zhang, Jie Liu, Min Zhang

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Catastrophic Failure of LLM Unlearning via Quantization

Zhiwei Zhang, Fali Wang, Xiaomin Li, Zongyu Wu, Xianfeng Tang, Hui Liu, Qi He, Wenpeng Yin, Suhang Wang

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025

KunlunBaize: LLM with Multi-Scale Convolution and Multi-Token Prediction Under TransformerX Framework

Cheng Li, Jiexiong Liu, Yixuan Chen, Yanqin Jia, Zhepeng Li

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 21 pages

Examples as the Prompt: A Scalable Approach for Efficient LLM Adaptation in E-Commerce

Jingying Zeng, Zhenwei Dai, Hui Liu, Samarth Varshney, Zhiji Liu, Chen Luo, Zhen Li, Qi He, Xianfeng Tang

专题命中 效率与部署 ：LLM(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

LVLM-Compress-Bench: Benchmarking the Broader Impact of Large Vision-Language Model Compression

Souvik Kundu, Anahita Bhiwandiwalla, Sungduk Yu, Phillip Howard, Tiep Le, Sharath Nittur Sridhar, David Cobbley, Hao Kang, Vasudev Lal

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments This work has been accepted to NAACL 2025

Energy-Based Diffusion Language Models for Text Generation

Minkai Xu, Tomas Geffner, Karsten Kreis, Weili Nie, Yilun Xu, Jure Leskovec, Stefano Ermon, Arash Vahdat

专题命中 效率与部署 ：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Journal ref ICLR 2025

EPEE: Towards Efficient and Effective Foundation Models in Biomedicine

Zaifu Zhan, Shuang Zhou, Huixue Zhou, Zirui Liu, Rui Zhang

专题命中 效率与部署 ：foundation model(title,abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Submitted to npj Digital Medicine

IOHunter: Graph Foundation Model to Uncover Online Information Operations

Marco Minici, Luca Luceri, Francesco Fabbri, Emilio Ferrara

专题命中 效率与部署 ：foundation model(title,abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted at AAAI 2025

LLM Inference Acceleration via Efficient Operation Fusion

Mahsa Salmani, Ilya Soloveychik

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Towards Efficient Optimizer Design for LLM via Structured Fisher Approximation with a Low-Rank Extension

Wenbo Gong, Meyer Scetbon, Chao Ma, Edward Meeds

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading

Cheng Luo, Zefan Cai, Hanshi Sun, Jinqi Xiao, Bo Yuan, Wen Xiao, Junjie Hu, Jiawei Zhao, Beidi Chen, Anima Anandkumar

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Gradient Multi-Normalization for Stateless and Scalable LLM Training

Meyer Scetbon, Chao Ma, Wenbo Gong, Edward Meeds

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Language Models as Zero-shot Lossless Gradient Compressors: Towards General Neural Parameter Prior Models

Hui-Po Wang, Mario Fritz

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

Comments camera-ready in NeurIPS 2024

Toward Automated Simulation Research Workflow through LLM Prompt Engineering Design

Zhihan Liu, Yubo Chai, Jianfeng Li

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments The source code and example results of ASA can be found at https://github.com/zokaraa/autonomous_simulation_agent

Chunk-Distilled Language Modeling

Yanhong Li, Karen Livescu, Jiawei Zhou

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

LLM-based Translation Inference with Iterative Bilingual Understanding

Andong Chen, Kehai Chen, Yang Xiang, Xuefeng Bai, Muyun Yang, Yang Feng, Tiejun Zhao, Min zhang

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Work in progress