语言大模型 / LLM

Fine-Tuning and Deploying Large Language Models Over Edges: Issues and Approaches

Yanjie Dong, Haijun Zhang, Chengming Li, Song Guo, Victor C. M. Leung, Xiping Hu

机构 * Shenzhen MSU-BIT University（深圳MSU-BIT大学） ； University of Science and Technology Beijing（北京科技大学） ； The Hong Kong University of Science and Technology（香港科技大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.AI

Win-k: Improved Membership Inference Attacks on Small Language Models

Roya Arkhmammadova, Hosein Madadi Tamar, M. Emre Gursoy

机构 * Department of Computer Engineering, Koç University（计算机工程系，科奇大学） 纠错

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.AI

DERMARK: A Dynamic, Efficient and Robust Multi-bit Watermark for Large Language Models

Qihao Lin, Chen Tang, Lan zhang, Junyang zhang, Xiangyang Li

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 8 pages, 7 figures

Comparison of Large Language Models for Deployment Requirements

Alper Yaman, Jannik Schwab, Christof Nitsche, Abhirup Sinha, Marco Huber

机构 * Fraunhofer Institute for Manufacturing Engineering and Automation IPA（弗劳恩霍夫智能制造与自动化研究所） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Journal ref Proceedings of the First International Conference on Generative Pre-trained Transformer Models and Beyond (GPTMB 2024), Porto, Portugal, Jun. 2024, pp. 41-44, ISBN: 978-1-68558-182-4

OFCnetLLM: Large Language Model for Network Monitoring and Alertness

Hong-Jun Yoon, Mariam Kiran, Danial Ebling, Joe Breen

机构 * Oak Ridge National Laboratory（奥克兰国家实验室） ； Utah Education Network（犹他州教育网络） ； University of Utah（犹他大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

A Survey on Large Language Model Acceleration based on KV Cache Management

Haoyang Li, Yiming Li, Anxin Tian, Tianhao Tang, Zhanchao Xu, Xuejia Chen, Nicole Hu, Wei Dong, Qing Li, Lei Chen

机构 * Department of Computing, The Hong Kong Polytechnic University（计算系，香港理工大学） ； Department of Computer Science and Engineering（计算机科学与工程系） ； Department of Computer Science and Technology（计算机科学与技术系） ； Department of Computing and Data Science（计算与数据科学系） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted to TMLR 2025. The revised version incorporates more papers and has been further polished

Automating Thematic Review of Prevention of Future Deaths Reports: Replicating the ONS Child Suicide Study using Large Language Models

Sam Osian, Arpan Dutta, Sahil Bhandari, Iain E. Buchan, Dan W. Joyce

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 8 pages, 1 figure

Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study

Yiran Huang, Lukas Thede, Massimiliano Mancini, Wenjia Xu, Zeynep Akata

机构 * Technical University of Munich, Germany（慕尼黑技术大学，德国） ； Helmholtz Munich, Munich Center for Machine Learning, Germany（海德堡慕尼黑，慕尼黑机器学习中心，德国） ； University of Tübingen, Tübingen AI Center, Germany（图宾根大学，图宾根人工智能中心，德国） ； University of Trento, Italy（特伦托大学，意大利） ； Beijing University of Posts and Telecommunications, China（北京邮电大学，中国） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；small language model(abstract)；分类 cs.CL

Comments Accepted at GCPR 2025

Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks

Israt Jahan, Md Tahmid Rahman Laskar, Chun Peng, Jimmy Huang

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at Canadian AI 2025

Enhancing Cross-task Transfer of Large Language Models via Activation Steering

Xinyu Tang, Zhihao Lv, Xiaoxue Cheng, Junyi Li, Wayne Xin Zhao, Zujie Wen, Zhiqiang Zhang, Jun Zhou

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学耿丽人工智能学院） ； Department of Computer Science, National University of Singapore（新加坡国立大学计算机科学系） ； Ant Group（蚂蚁集团） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Models

Gen Luo, Wenhan Dou, Wenhao Li, Zhaokai Wang, Xue Yang, Changyao Tian, Hao Li, Weiyun Wang, Wenhai Wang, Xizhou Zhu, Yu Qiao, Jifeng Dai

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Tsinghua University（清华大学） ； The Chinese University of Hong Kong（香港中文大学） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

SoK: Semantic Privacy in Large Language Models

Baihe Ma, Yanna Jiang, Xu Wang, Guangsheng Yu, Qin Wang, Caijun Sun, Chen Li, Xuelei Qi, Ying He, Wei Ni, Ren Ping Liu

机构 * University of Technology Sydney, Australia（悉尼技术大学） ； Zhejiang Lab, China（浙江实验室） ； Northeastern University, China（东北大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.AI

Graph Representations for Reading Comprehension Analysis using Large Language Model and Eye-Tracking Biomarker

Yuhong Zhang, Jialu Li, Shilai Yang, Yuchen Xu, Gert Cauwenberghs, Tzyy-Ping Jung

机构 * University of California, San Diego (UCSD)（加州大学圣地亚哥分校） ； Hong Kong University of Science and Technology（香港科学与技术大学） ； Brown University（布朗大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

ContextCache: Context-Aware Semantic Cache for Multi-Turn Queries in Large Language Models

Jianxin Yan, Wangze Ni, Lei Chen, Xuemin Lin, Peng Cheng, Zhan Qin, Kui Ren

机构 * Zhejiang University（浙江大学） ； Shanghai Jiaotong University（上海交通大学） ； Tongji University（同济大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Hybrid Systolic Array Accelerator with Optimized Dataflow for Edge Large Language Model Inference

Chun-Ting Chen, HanGyeol Mun, Jian Meng, Mohamed S. Abdelfattah, Jae-sun Seo

机构 * School of Electrical and Computer Engineering, Cornell University（电气与计算机工程学院，康奈尔大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted as a conference paper at the 2025 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED)

Tiny-Align: Bridging Automatic Speech Recognition and Large Language Model on the Edge

Ruiyang Qin, Dancheng Liu, Gelei Xu, Zheyu Yan, Chenhui Xu, Yuting Hu, Shaocong Wang, X. Sharon Hu, Jinjun Xiong, Yiyu Shi

机构 * Villanova University（维拉诺瓦大学） ； University of Notre Dame（诺特尔大学） ； University at Buffalo–SUNY（布法罗大学–SUNY） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by ICCAD'25

SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model

Xinghao Wang, Feng Liu, Rui Su, Zhihui Wang, Lihua Fang, Lianqing Zhou, Lei Bai, Wanli Ouyang

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； International School of Information Science and Engineering（国际信息科学与工程学院） ； School of Electronic Information and Electrical Engineering（电子信息与电气工程学院） ； Shanghai Jiao Tong University（上海交通大学） ； Dalian University of Technology（大连理工大学） ； Institute of Earthquake Forecasting（地震预测研究所） ； China Earthquake Administration（中国地震局） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.LG

Comments Code is available at https://github.com/StarMoonWang/SeisMoLLM. v2 fixed errors in the location figures

GAF-Guard: An Agentic Framework for Risk Management and Governance in Large Language Models

Seshu Tirupathi, Dhaval Salwala, Elizabeth Daly, Inge Vejsbjerg

机构 * IBM Research Europe（IBM欧洲研究院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

LLM4Hint: Leveraging Large Language Models for Hint Recommendation in Offline Query Optimization

Suchen Liu, Jun Gao, Yinjun Han, Yang Lin

机构 * Key Laboratory of High Confidence Software Technologies, CS, Peking University, China（高性能软件技术重点实验室，计算机科学，北京大学，中国） ； ZTE Corporation（中兴通讯） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Large Language Model-Driven Surrogate-Assisted Evolutionary Algorithm for Expensive Optimization

Lindong Xie, Genghui Li, Zhenkun Wang, Edward Chung, Maoguo Gong

机构 * Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University（香港理工大学电子与电气工程系） ； College of Computer Science and Software Engineering, Shenzhen University（深圳大学计算机科学与软件工程学院） ； School of Automation and Intelligent Manufacturing, Southern University of Science and Technology（南方科技大学自动化与智能制造学院） ； Academy of Artificial Intelligence, College of Mathematics Science, Inner Mongolia Normal University（内蒙古师范大学数学科学学院人工智能学院） ； Key Laboratory of Collaborative Intelligence Systems, Ministry of Education, Xidian University（西安电子科技大学教育部协同智能系统重点实验室） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

GenSim: A General Social Simulation Platform with Large Language Model based Agents

Jiakai Tang, Heyang Gao, Xuchen Pan, Lei Wang, Haoran Tan, Dawei Gao, Yushuo Chen, Xu Chen, Yankai Lin, Yaliang Li, Bolin Ding, Jingren Zhou, Jun Wang, Ji-Rong Wen

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学全球化人工智能学院） ； University College London（伦敦大学学院） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments NAACL 2025 Demo Track

Towards Building Private LLMs: Exploring Multi-Node Expert Parallelism on Apple Silicon for Mixture-of-Experts Large Language Model

Mu-Chi Chen, Po-Hsuan Huang, Xiangrui Ke, Chia-Heng Tu, Chun Jason Xue, Shih-Hao Hung

机构 * National Taiwan University（国立台湾大学） ； National Cheng Kung University（国立成功大学） ； Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments International Conference on Research in Adaptive and Convergent Systems (RACS '24), November 5--8, 2024, Pompei, Italy

Distillation and Refinement of Reasoning in Small Language Models for Document Re-ranking

Chris Samarinas, Hamed Zamani

机构 * University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） 纠错

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；LLM(abstract)；分类 cs.CL

Investigating the Impact of Quantization Methods on the Safety and Reliability of Large Language Models

Artyom Kharinaev, Viktor Moskvoretskii, Egor Shvetsov, Kseniia Studenikina, Bykov Mikhail, Evgeny Burnaev

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.AI

Demystifying Singular Defects in Large Language Models

Haoqi Wang, Tong Zhang, Mathieu Salzmann

机构 * EPFL（苏黎世联邦理工学院） ； School of Computer and Communication Sciences（计算机与通信科学学院） ； Swiss Data Science Center（瑞士数据科学中心） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICML 2025

KunLunBaizeRAG: Reinforcement Learning Driven Inference Performance Leap for Large Language Models

Cheng Li, Jiexiong Liu, Yixuan Chen, Qihang Zhou, KunLun Meta

机构 * KunLun Meta（昆仑元） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

GPTailor: Large Language Model Pruning Through Layer Cutting and Stitching

Guinan Su, Li Shen, Lu Yin, Shiwei Liu, Yanwu Yang, Jonas Geiping

机构 * Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所） ； ELLIS Institute Tübingen（图宾根ELLIS研究所） ； Tübingen AI Center（图宾根人工智能中心） ； University of Tübingen（图宾根大学） ； Sun Yat-sen University（中山大学） ； University of Surrey（萨里大学） ； University of Oxford（牛津大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

A Multi-Pass Large Language Model Framework for Precise and Efficient Radiology Report Error Detection

Songsoo Kim, Seungtae Lee, See Young Lee, Joonho Kim, Keechan Kan, Dukyong Yoon

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 29 pages, 5 figures, 4 tables. Code available at https://github.com/radssk/mp-rred

Retrieval-Confused Generation is a Good Defender for Privacy Violation Attack of Large Language Models

Wanli Peng, Xin Chen, Hang Fu, XinYu He, Xue Yiming, Juan Wen

机构 * China Agricultural University（中国农业大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

A Large Language Model-based Multi-Agent Framework for Analog Circuits' Sizing Relationships Extraction

Chengjie Liu, Weiyu Chen, Huiyao Xu, Yuan Du, Jun Yang, Li Du

机构 * School of Electronic Science（电子科学学院） ； Nanjing University（南京大学） ； National Center of Technology Innovation for EDA（EDA技术创新中心） ； Nanjing Tech University（南京理工大学） ； School of Integrated Circuits（集成电路学院） ； Southeast University（东南大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by ISEDA 2025