语言大模型 / LLM

Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism

Xinyuan Lin, Chenlu Li, Zongle Huang, Chunyu Wang, Bo Xiao, Huazhong Yang, Shishi Duan, Yongpan Liu

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

Routing Distilled Knowledge via Mixture of LoRA Experts for Large Language Model based Bundle Generation

Kaidong Feng, Zhu Sun, Hui Fang, Jie Yang, Wenyuan Liu, Yew-Soon Ong

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning

Yebo Wu, Jingguang Li, Chunlin Tian, Zhijiang Guo, Li Li

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Cognitive Agents Powered by Large Language Models for Agile Software Project Management

Konrad Cinkusz, Jarosław A. Chudziak, Ewa Niewiadomska-Szynkiewicz

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

AdLoCo: adaptive batching significantly improves communications efficiency and convergence for Large Language Models

Nikolay Kutuzov, Makar Baderko, Stepan Kulibaba, Artem Dzhalilov, Daniel Bobrov, Maxim Mashtaler, Alexander Gasnikov

机构 * Moscow Institute of Physics and Technology（莫斯科物理技术学院） ； The School of the Center for Teacher Excellence（教师卓越中心学校） ； Research Center of the Artificial Intelligence Institute（人工智能研究所研究部） ； Innopolis University（因诺波利斯大学） ； Sirius University of Science and Technology（西里乌斯科学技术大学） ； Steklov Institute（斯捷克洛夫研究所） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

AVAM: Universal Training-free Adaptive Visual Anchoring Embedded into Multimodal Large Language Model for Multi-image Question Answering

Kang Zeng, Guojin Zhong, Jintao Cheng, Jin Yuan, Zhiyong Li

机构 * Hunan University（湖南大学） ； South China Normal University（华南师范大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 14 pages, 5 figures

Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation

Xin Yi, Yue Li, Shunfan Zheng, Linlin Wang, Xiaoling Wang, Liang He

机构 * Lab of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China（教育人工智能实验室，华东师范大学，上海200062，中国） ； Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China（教育人工智能研究所，华东师范大学，上海200062，中国） ； School of Computer Science and Technology, East China Normal University, Shanghai 200062, China（计算机科学与技术学院，华东师范大学，上海200062，中国） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference

Zhuo Chen, Xinyu Wang, Yong Jiang, Zhen Zhang, Xinyu Geng, Pengjun Xie, Fei Huang, Kewei Tu

机构 * School of Information Science and Technology, ShanghaiTech University（信息科学与技术学院，上海科技大学） ； Shanghai Engineering Research Center of Intelligent Vision and Imaging（智能视觉与成像上海工程研究中心） ； Institute for Intelligent Computing, Alibaba Group（智能计算研究院，阿里巴巴集团） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments EMNLP2025 Main Conference

CelloAI: Leveraging Large Language Models for HPC Software Development in High Energy Physics

Mohammad Atif, Kriti Chopra, Ozgur Kilic, Tianle Wang, Zhihua Dong, Charles Leggett, Meifeng Lin, Paolo Calafiura, Salman Habib

机构 * Brookhaven National Laboratory（布鲁克海文国家实验室） ； Lawrence Berkeley National Laboratory（伯克利国家实验室） ； Argonne National Laboratory（阿贡国家实验室） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 12 pages, 2 figures

Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective

Tianyao Shi, Yi Ding

机构 * Purdue University（普渡大学） 纠错

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments 14 pages, 10 figures, 4 tables

Equinox: Holistic Fair Scheduling in Serving Large Language Models

Zhixiang Wei, James Yen, Jingyi Chen, Ziyang Zhang, Zhibai Huang, Chen Chen, Xingzi Yu, Yicheng Gu, Chenggang Wu, Yun Wang, Mingyuan Xia, Jie Wu, Hao Wang, Zhengwei Qi

机构 * Shanghai Jiao Tong University（上海交通大学） ； Cloud Computing Research Institute, China Telecom（云计算研究所，中国电信） ； Stevens Institute of Technology（史蒂文斯理工学院） 纠错

专题命中 效率与部署 ：large language model(title)；language model(title)；LLM(abstract)；分类 cs.AI

ICQuant: Index Coding enables Low-bit LLM Quantization

Xinlin Li, Osama Hanna, Christina Fragouli, Suhas Diggavi

机构 * University of California, Los Angeles（加州大学洛杉矶分校） ； Meta, GenAI（Meta） 纠错

专题命中 效率与部署 ：LLM(title)；large language model(abstract)；language model(abstract)；post-training(abstract)

Bridging Foundation Models and Efficient Architectures: A Modular Brain Imaging Framework with Local Masking and Pretrained Representation Learning

Yanwen Wang, Xinglin Zhao, Yijin Song, Xiaobo Liu, Yanrong Hao, Rui Cao, Xin Wen

机构 * AAAI Press（AAAI 压力） 纠错

专题命中 效率与部署 ：foundation model(title,abstract)；LLM(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Scalable Engine and the Performance of Different LLM Models in a SLURM based HPC architecture

Anderson de Lima Luiz, Shubham Vijay Kurlekar, Munir Georges

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted in ESSV 2025 - https://www.essv.de/paper.php?id=1265

How Do LLM-Generated Texts Impact Term-Based Retrieval Models?

Wei Huang, Keping Bi, Yinqiong Cai, Wei Chen, Jiafeng Guo, Xueqi Cheng

机构 * State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences University of Chinese Academy of Sciences（人工智能安全国家重点实验室，计算技术研究所，中国科学院大学） ； Baidu Inc.（百度公司） 纠错

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

LLM-based Human-like Traffic Simulation for Self-driving Tests

Wendi Li, Hao Wu, Han Gao, Bing Mao, Fengyuan Xu, Sheng Zhong

机构 * National Key Lab for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室） 纠错

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

An Inquiry into Datacenter TCO for LLM Inference with FP8

Jiwoo Kim, Joonhyung Lee, Gunho Park, Byeongwook Kim, Se Jung Kwon, Dongsoo Lee, Youngjoo Lee

机构 * POSTECH ； NAVER Cloud（NAVER云） ； KAIST（韩国科学技术院） 纠错

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

LLM-Guided Genetic Improvement: Envisioning Semantic Aware Automated Software Evolution

Karine Even-Mendoza, Alexander Brownlee, Alina Geiger, Carol Hanna, Justyna Petke, Federica Sarro, Dominik Sobania

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

RepoTransAgent: Multi-Agent LLM Framework for Repository-Aware Code Translation

Ziqi Guan, Xin Yin, Zhiyuan Peng, Chao Ni

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Democratizing AI Development: Local LLM Deployment for India's Developer Ecosystem in the Era of Tokenized APIs

Vikranth Udandarao, Nipun Misra

专题命中 效率与部署 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments for survey results, check https://docs.google.com/spreadsheets/d/1t0eV9oURaiu2HfARWo6sriBO0eC8bHUyZNN7CgK2NAk/edit?usp=sharing

DPad: Efficient Diffusion Language Models with Suffix Dropout

Xinhua Chen, Sitao Huang, Cong Guo, Chiyue Wei, Yintao He, Jianyi Zhang, Hai "Helen" Li, Yiran Chen

机构 * Duke University（杜克大学） 纠错

专题命中 效率与部署 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

HLLM-Creator: Hierarchical LLM-based Personalized Creative Generation

Junyi Chen, Lu Chi, Siliang Xu, Shiwei Ran, Bingyue Peng, Zehuan Yuan

机构 * ByteDance（字节跳动） 纠错

专题命中 效率与部署 ：LLM(title,abstract)；分类 cs.CL

A Mixture of Exemplars Approach for Efficient Out-of-Distribution Detection with Foundation Models

Evelyn Mannix, Howard Bondell

机构 * School of Mathematics and Statistics（数学与统计学学院） ； University of Melbourne（墨尔本大学） 纠错

专题命中 效率与部署 ：foundation model(title,abstract)；分类 cs.LG

TaDiCodec: Text-aware Diffusion Speech Tokenizer for Speech Language Modeling

Yuancheng Wang, Dekun Chen, Xueyao Zhang, Junan Zhang, Jiaqi Li, Zhizheng Wu

专题命中 效率与部署 ：language model(title,abstract)；分类 cs.LG

TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modeling

Yizhi Li, Qingshui Gu, Zhoufutu Wen, Ziniu Li, Tianshun Xing, Shuyue Guo, Tianyu Zheng, Xin Zhou, Xingwei Qu, Wangchunshu Zhou, Zheng Zhang, Wei Shen, Qian Liu, Chenghua Lin, Jian Yang, Ge Zhang, Wenhao Huang

专题命中 效率与部署 ：large language model(abstract)；language model(abstract)；post-training(abstract)；分类 cs.CL、cs.LG

DSADF: Thinking Fast and Slow for Decision Making

Zhihao Dou, Dongfei Cui, Jun Yan, Weida Wang, Benteng Chen, Haoming Wang, Zeke Xie, Shufei Zhang

机构 * Pratt School of Engineering（普拉特工程学院） ； Duke University（杜克大学） ； School of Computer Science（计算机科学学院） ； Northeast Electric Power University（东北电力大学） ； Department of Information and Communication Engineering（信息与通信工程系） ； Tongji University（同济大学） ； School of Computer Science and Technology（计算机科学与技术学院） ； School of International Education（国际教育学院） ； Beijing University of Chemical Technology（北京化工大学） ； East China Normal University（华东师范大学） ； Information Hub（信息枢纽） ； Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； Chinese Academy of Science（中国科学院） 纠错

专题命中 效率与部署 ：large language model(abstract)；language model(abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

GM-Skip: Metric-Guided Transformer Block Skipping for Efficient Vision-Language Models

Lianming Huang, Haibo Hu, Qiao Li, Xin He, Nan Guan, Chun Jason Xue

机构 * City University of Hong Kong（香港城市大学） ； MBZUAI ； A*STAR 纠错

专题命中 效率与部署 ：language model(title,abstract)

Comments 7 pages

Speech Discrete Tokens or Continuous Features? A Comparative Analysis for Spoken Language Understanding in SpeechLLMs

Dingdong Wang, Junan Li, Mingyu Cui, Dongchao Yang, Xueyuan Chen, Helen Meng

机构 * The Chinese University of Hong Kong（香港中文大学） 纠错

专题命中 效率与部署 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 Main Conference

TextOnly: A Unified Function Portal for Text-Related Functions on Smartphones

Minghao Tu, Chun Yu, Xiyuan Shen, Zhi Zheng, Li Chen, Yuanchun Shi

机构 * Tsinghua University（清华大学） ； University of Washington（华盛顿大学） 纠错

专题命中 效率与部署 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 27 pages, 9 figures

AdapSNE: Adaptive Fireworks-Optimized and Entropy-Guided Dataset Sampling for Edge DNN Training

Boran Zhao, Hetian Liu, Zihang Yuan, Li Zhu, Fan Yang, Lina Xie Tian Xia, Wenzhe Zhao, Pengju Ren

机构 * School of Software Engineering（软件工程学院） ； School of Computer Science and Technology（计算机科学与技术学院） ； the First Affiliated Hospital of Xi’an Jiaotong University（西安交通大学第一附属医院） ； National Key Laboratory of Human-Machine Hybrid Augmented Intelligence（人机混合增强智能国家重点实验室） ； National Engineering Research Center for Visual Information and Applications（视觉信息与应用国家工程研究中心） ； Institute of Artificial Intelligence and Robotics（人工智能与机器人研究院） 纠错

专题命中 效率与部署 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG