语言大模型 / LLM - arXivDaily 专题

2505.17260 2025-11-24 cs.CL 88%

The Rise of Parameter Specialization for Knowledge Storage in Large Language Models

大语言模型中用于知识存储的参数专业化趋势的兴起

Yihuai Hong, Yiran Zhao, Wei Tang, Yang Deng, Yu Rong, Wenxuan Zhang

机构 * Alibaba Group（阿里巴巴集团）； New York University（纽约大学）； National University of Singapore（新加坡国立大学）； Singapore Management University（新加坡管理大学）； Singapore University of Technology and Design（新加坡科技设计大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

AI总结本研究分析了大语言模型中MLP参数的知识存储方式，发现参数专业化提高了知识利用效率，并通过实验验证了其重要性。

Comments Accepted in NeurIPS 2025

2511.16229 2025-11-21 cs.CR cs.AI 88%

Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security

Q-MLLM：向量量化用于鲁棒多模态大语言模型安全

Wei Zhao, Zhe Li, Yige Li, Jun Sun

机构 * Singapore Management University（新加坡管理大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

AI总结 Q-MLLM通过两级向量量化提升多模态大语言模型的安全性，有效防御对抗性攻击并保持模型实用性。

Comments Accepted by NDSS 2026

2509.17425 2025-11-21 cs.AI 88%

Evaluating Multimodal Large Language Models with Daily Composite Tasks in Home Environments

在家庭环境中评估多模态大语言模型的日常复合任务

Zhenliang Zhang, Yuxi Wang, Hongzhao Xie, Shiyun Zhao, Mingyuan Liu, Yujie Lu, Xinyi He, Zhenku Cheng, Yujia Peng

机构 * State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence（通用人工智能国家重点实验室、北京通用人工智能研究院）； School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Key Laboratory of Machine Perception (Ministry of Education), Peking University（心理与认知科学学院及北京行为与心理健康重点实验室、机器感知重点实验室（教育部））； School of Intelligence Science and Technology, Peking University（智能科学与技术学院）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

AI总结本研究在家庭环境中评估了多模态大语言模型在日常复合任务中的表现，发现其在物体理解、空间智能和社会活动领域存在显著差距，为具身MLLMs的发展提供了初步评估框架。

2511.14662 2025-11-19 cs.CL 88%

Bias in, Bias out: Annotation Bias in Multilingual Large Language Models

Xia Cui, Ziyi Huang, Naeemeh Adel

机构 * Manchester Metropolitan University（曼彻斯特 Metropolitan 大学）； Hubei University（湖北大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2509.04508 2025-11-12 cs.CL 88%

ProST: Progressive Sub-task Training for Pareto-Optimal Multi-agent Systems Using Small Language Models

Biddut Sarker Bijoy, Mohammad Saqib Hasan, Pegah Alipoormolabashi, Avirup Sil, Aruna Balasubramanian, Niranjan Balasubramanian

机构 * Stony Brook University（石溪大学）； Oracle Applied Science（Oracle应用科学）

专题命中效率与部署：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.CL

2511.06979 2025-11-11 cs.LG cs.GT 88%

Breaking the Gradient Barrier: Unveiling Large Language Models for Strategic Classification

Xinpeng Lv, Yunxin Mao, Haoxuan Li, Ke Liang, Jinxuan Yang, Wanrong Huang, Haoang Chi, Huan Chen, Long Lan, Yuanlong Chen, Wenjing Yang, Haotian Wang

机构 * College of Computer Science and Technology, National University of Defense Technology（国防科技大学计算机科学与技术学院）； Center for Data Science, Peking University（北京大学数据科学中心）； Faculty of Engineering, the University of Sydney（悉尼大学工程学院）； Faculty of Computing, Harbin Institute of Technology（哈尔滨工业大学计算机学院）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted by NeurIPS 2025

2511.06512 2025-11-11 cs.CR cs.LG 88%

EASE: Practical and Efficient Safety Alignment for Small Language Models

Haonan Shi, Guoli Wang, Tu Ouyang, An Wang

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.LG

Comments Accepted to AAAI 2026

2410.15052 2025-11-11 cs.AI 88%

GlitchMiner: Mining Glitch Tokens in Large Language Models via Gradient-based Discrete Optimization

Zihui Wu, Haichang Gao, Ping Wang, Shudong Zhang, Zhaoxiang Liu, Shiguo Lian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2509.16328 2025-11-11 q-bio.TO cs.CL eess.IV physics.med-ph 88%

The Role of High-Performance GPU Resources in Large Language Model Based Radiology Imaging Diagnosis

Jyun-Ping Kao

机构 * Graduate Institute of Biomedical Electronics and Bioinformatics（生物医学电子与生物信息学研究生院）； National Taiwan University（台湾大学）

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL

2502.01717 2025-11-11 cs.LG 88%

Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation

Martin Genzel, Patrick Putzky, Pengfei Zhao, Sebastian Schulze, Mattes Mollenhauer, Robert Seidel, Stefan Dietzel, Thomas Wollmann

机构 * Merantix Momentum（梅兰特克斯动力）

专题命中效率与部署：large language model(title)；language model(title)；foundation model(abstract)；post-training(abstract)

Comments Code available under https://github.com/merantix-momentum/acip

Journal ref Transactions on Machine Learning Research, November 2025

2511.04952 2025-11-10 cs.CL 88%

LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model

Wei Shao, Lingchao Zheng, Pengyu Wang, Peizhen Zheng, Jun Li, Yuwei Fan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2511.02534 2025-11-05 cs.AI 88%

Knowledge Graph-enhanced Large Language Model for Incremental Game PlayTesting

Enhong Mu, Jinyu Cai, Yijun Lu, Mingyue Zhang, Kenji Tei, Jialong Li

机构 * Southwest University（西南大学）； Waseda University（早稻田大学）； Institute of Science Tokyo（东京科学研究院）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2511.02213 2025-11-05 cs.CL 88%

IG-Pruning: Input-Guided Block Pruning for Large Language Models

Kangyu Qiao, Shaolei Zhang, Yang Feng

机构 * Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences (ICT/CAS)（智能信息处理重点实验室，计算技术研究所，中国科学院）； Key Laboratory of AI Safety, Chinese Academy of Sciences（人工智能安全重点实验室，中国科学院）； University of Chinese Academy of Sciences, Beijing, China（中国科学院大学，北京，中国）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025. Code is available at https://github.com/ictnlp/IG-Pruning

Journal ref https://aclanthology.org/2025.emnlp-main.537/

2504.00502 2025-11-04 cs.CV cs.CL 88%

ShortV: Efficient Multimodal Large Language Models by Freezing Visual Tokens in Ineffective Layers

Qianhao Yuan, Qingyu Zhang, Yanjiang Liu, Jiawei Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Xianpei Han, Le Sun

机构 * Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）； University of Chinese Academy of Sciences（中国科学院大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Published as a conference paper at ICCV 2025. Project page: https://github.com/icip-cas/ShortV

2511.01149 2025-11-04 cs.AI 88%

Modular Task Decomposition and Dynamic Collaboration in Multi-Agent Systems Driven by Large Language Models

Shuaidong Pan, Di Wu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.01141 2025-11-04 cs.AR cs.LG 88%

Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching

Sungmin Yun, Kwanhee Kyung, Juhwan Cho, Jaewan Choi, Jongmin Kim, Byeongho Kim, Sukhan Lee, Kyomin Sohn, Jung Ho Ahn

机构 * Seoul National University（首尔国立大学）； Samsung Electronics（三星电子）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 15 pages, 16 figures, accepted at MICRO 2024

2505.24680 2025-10-28 cs.CL 88%

A Simple Linear Patch Revives Layer-Pruned Large Language Models

Xinrui Chen, Haoli Bai, Tao Yuan, Ruikang Liu, Kang Zhao, Xianzhi Yu, Lu Hou, Tian Guan, Yonghong He, Chun Yuan

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）； Huawei Technologies（华为技术）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 26 pages, accepted to NeurIPS 2025

2510.21844 2025-10-28 cs.LG quant-ph 88%

KARIPAP: Quantum-Inspired Tensor Network Compression of Large Language Models Using Infinite Projected Entangled Pair States and Tensor Renormalization Group

Azree Nazri

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 28 pages

2510.21834 2025-10-28 cs.LG 88%

Restoring Pruned Large Language Models via Lost Component Compensation

Zijian Feng, Hanzhang Zhou, Zixiao Zhu, Tianjiao Li, Jia Jim Deryl Chua, Lee Onn Mak, Gee Wah Ng, Kezhi Mao

机构 * School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore（电子与电气工程学院，南洋理工大学，新加坡）； Home Team Science and Technology Agency (HTX), Singapore（科技局（HTX），新加坡）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments NeurIPS 2025 Spotlight

2510.21604 2025-10-27 cs.CL 88%

RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models

Xueyuan Lin, Cehao Yang, Ye Ma, Ming Li, Rongjunchen Zhang, Yang Ni, Xiaojun Wu, Chengjin Xu, Jian Guo, Hui Xiong

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））； IDEA Research（IDEA研究院）； Hithink RoyalFlush Information Network Co., Ltd（慧思皇家Flush信息网络有限公司）； DataArc Tech Ltd（DataArc科技有限公司）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2510.19979 2025-10-24 cs.CR cs.LG cs.SE 88%

SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment

Tushar Nayan, Ziqi Zhang, Ruimin Sun

机构 * Florida International University（佛罗里达国际大学）； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted at IEEE Intelligent Computing and Systems at the Edge (ICEdge) 2025

2510.19183 2025-10-23 cs.CV cs.AI 88%

PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning

Fengyuan Sun, Hui Chen, Xinhao Xu, Dandan Zheng, Jingdong Chen, Jun Zhou, Jungong Han, Guiguang Ding

机构 * School of Software, Tsinghua University（清华大学软件学院）； Ant Group（蚂蚁集团）； Department of Automation, Tsinghua University（清华大学自动化系）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2506.19505 2025-10-21 cs.CL 88%

AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models

Zeyu Li, Chuanfu Xiao, Yang Wang, Xiang Liu, Zhenheng Tang, Baotong Lu, Mao Yang, Xinyu Chen, Xiaowen Chu

机构 * DSA Thrust, The Hong Kong University of Science and Technology (Guangzhou)（DSA团队，香港科学与技术大学（广州））； School of Mathematics and Computational Science, Xiangtan University（数学与计算科学学院，湘潭大学）； Microsoft（微软）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2501.04762 2025-10-21 cs.IR cs.LG 88%

Efficient and Responsible Adaptation of Large Language Models for Robust and Equitable Top-k Recommendations

Kirandeep Kaur, Vinayak Gupta, Manya Chadha, Chirag Shah

机构 * University of Washington（华盛顿大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments arXiv admin note: text overlap with arXiv:2405.00824

2503.00059 2025-10-20 cs.CV cs.LG 88%

Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models

Rui Hu, Delai Qiu, Shuyu Wei, Jiaming Zhang, Yining Wang, Shengping Liu, Jitao Sang

机构 * Beijing Key Lab of Traffic Data Analysis and Mining（北京交通数据挖掘重点实验室）； Beijing Jiaotong University（北京交通大学）； Unisound AI Technology Co., Ltd.（Unisound人工智能技术有限公司）； Peng Cheng Lab（鹏城实验室）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted to ACL 2025 Findings

Journal ref Findings of the Association for Computational Linguistics: ACL 2025

2408.01890 2025-10-20 cs.CL 88%

Cross-layer Attention Sharing for Pre-trained Large Language Models

Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments A version accepted by TACL, prior to its publication by MIT Press

2506.12450 2025-10-14 cs.CL 88%

Language Surgery in Multilingual Large Language Models

Joanito Agili Lopo, Muhammad Ravi Shulthan Habibi, Tack Hwa Wong, Muhammad Ilham Ghozali, Fajri Koto, Genta Indra Winata, Peerat Limkonchotiwat, Alham Fikri Aji, Samuel Cahyawijaya

机构 * SEACrowd ； Kreasof AI ； Universitas Indonesia（印度尼西亚大学）； MBZUAI ； Capital One ； AI Singapore（AI新加坡）； Cohere

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2506.15556 2025-10-09 cs.CL cs.SD eess.AS 88%

PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interaction

Shufan Li, Aditya Grover

机构 * University of California, Los Angeles（加州大学洛杉矶分校）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 16 pages,4 figures

2510.05142 2025-10-08 cs.CL cond-mat.mtrl-sci 88%

Reliable End-to-End Material Information Extraction from the Literature with Source-Tracked Multi-Stage Large Language Models

Xin Wang, Anshu Raj, Matthew Luebbe, Haiming Wen, Shuozhi Xu, Kun Lu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 27 pages, 4 figures, 7 tables

2510.04147 2025-10-07 cs.CL 88%

Self Speculative Decoding for Diffusion Large Language Models

Yifeng Gao, Ziang Ji, Yuxuan Wang, Biqing Qi, Hanlin Xu, Linfeng Zhang

机构 * School of AI, Shanghai Jiao Tong University（上海交通大学人工智能学院）； University of Science and Technology of China（中国科学技术大学）； Xidian University（西安电子科技大学）； Shanghai AI Laboratory（上海人工智能实验室）； Huawei Technologies Ltd.（华为技术有限公司）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

1. 效率与部署 22313 篇

The Rise of Parameter Specialization for Knowledge Storage in Large Language Models

Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security

Evaluating Multimodal Large Language Models with Daily Composite Tasks in Home Environments

Bias in, Bias out: Annotation Bias in Multilingual Large Language Models

ProST: Progressive Sub-task Training for Pareto-Optimal Multi-agent Systems Using Small Language Models

Breaking the Gradient Barrier: Unveiling Large Language Models for Strategic Classification

EASE: Practical and Efficient Safety Alignment for Small Language Models

GlitchMiner: Mining Glitch Tokens in Large Language Models via Gradient-based Discrete Optimization

The Role of High-Performance GPU Resources in Large Language Model Based Radiology Imaging Diagnosis

Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation

LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model

Knowledge Graph-enhanced Large Language Model for Incremental Game PlayTesting

IG-Pruning: Input-Guided Block Pruning for Large Language Models

ShortV: Efficient Multimodal Large Language Models by Freezing Visual Tokens in Ineffective Layers

Modular Task Decomposition and Dynamic Collaboration in Multi-Agent Systems Driven by Large Language Models

Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching

A Simple Linear Patch Revives Layer-Pruned Large Language Models

KARIPAP: Quantum-Inspired Tensor Network Compression of Large Language Models Using Infinite Projected Entangled Pair States and Tensor Renormalization Group

Restoring Pruned Large Language Models via Lost Component Compensation

RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models

SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment

PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning

AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models

Efficient and Responsible Adaptation of Large Language Models for Robust and Equitable Top-k Recommendations

Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models

Cross-layer Attention Sharing for Pre-trained Large Language Models

Language Surgery in Multilingual Large Language Models

PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interaction

Reliable End-to-End Material Information Extraction from the Literature with Source-Tracked Multi-Stage Large Language Models

Self Speculative Decoding for Diffusion Large Language Models