语言大模型 / LLM - arXivDaily 专题

2412.19449 2024-12-30 cs.CL 88%

Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models

Shuo Wang, Chihang Wang, Jia Gao, Zhen Qi, Hongye Zheng, Xiaoxuan Liao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 4 pages

2409.10197 2024-12-30 cs.CV cs.CL cs.MM 88%

Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models

Weihao Ye, Qiong Wu, Wenhao Lin, Yiyi Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2412.18110 2024-12-25 cs.AI 88%

SlimGPT: Layer-wise Structured Pruning for Large Language Models

Gui Ling, Ziyang Wang, Yuliang Yan, Qingwen Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2412.16262 2024-12-25 q-bio.QM cs.AI 88%

VirusT5: Harnessing Large Language Models to Predicting SARS-CoV-2 Evolution

Vishwajeet Marathe, Deewan Bajracharya, Changhui Yan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments This is a preprint of a paper submitted to IEEE for consideration

2412.16943 2024-12-24 cs.CL 88%

A Career Interview Dialogue System using Large Language Model-based Dynamic Slot Generation

Ekai Hashimoto, Mikio Nakano, Takayoshi Sakurai, Shun Shiramatsu, Toshitake Komazaki, Shiho Tsuchiya

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 9 pages, 9 tables, 2 figures; 14 pages of appendix. Accepted to COLING 2025

2409.12545 2024-12-19 cs.CL 88%

Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment

Tianyu Peng, Jiajun Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by COLING 2025, 19 pages

2412.11629 2024-12-17 cs.LG 88%

QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models

Changhai Zhou, Yuhua Zhou, Shijie Han, Qian Qiao, Hongguang Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2412.11494 2024-12-17 cs.CL 88%

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing

Zekai Li, Jintu Zheng, Ji Liu, Han Liu, Haowei Zhu, Zeping Li, Fuwei Yang, Haiduo Huang, Jinzhang Peng, Dong Li, Lu Tian, Emad Barsoum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.15268 2024-12-17 cs.CL 88%

Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering

Huanxuan Liao, Shizhu He, Yao Xu, Yuanzhe Zhang, Kang Liu, Shengping Liu, Jun Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2025

2311.08883 2024-12-17 cs.CL 88%

Distilling Rule-based Knowledge into Large Language Models

Wenkai Yang, Yankai Lin, Jie Zhou, Ji-Rong Wen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at COLING 2025, camera-ready version. Code and data are available at https://github.com/RUCBM/rule-distillation

2409.19454 2024-12-16 cs.HC cs.AI cs.CV 88%

See Where You Read with Eye Gaze Tracking and Large Language Model

Sikai Yang, Gang Yan, Wan Du

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 9 pages

2412.04964 2024-12-12 cs.AI 88%

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference

Qingyuan Li, Bo Zhang, Liang Ye, Yifan Zhang, Wei Wu, Yerui Sun, Lin Ma, Yuchen Xie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.18222 2024-12-09 cs.AI 88%

Trustworthy AI: Securing Sensitive Data in Large Language Models

Georgios Feretzakis, Vassilios S. Verykios

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 40 pages, 1 figure

Journal ref AI 5(4), 2773-2800 (2024)

2410.19456 2024-12-03 cs.LG 88%

Computational Bottlenecks of Training Small-scale Large Language Models

Saleh Ashkboos, Iman Mirzadeh, Keivan Alizadeh, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar, Fartash Faghri

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 8 pages, 4 figures

2404.02837 2024-12-02 cs.CL 88%

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Wanyun Cui, Qianle Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.10527 2024-12-02 cs.CL cs.CR stat.AP 88%

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

R. Patrick Xian, Alex J. Lee, Satvik Lolla, Vincent Wang, Qiming Cui, Russell Ro, Reza Abbasi-Asl

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 31 pages incl. appendix, accepted by TMLR

2311.03191 2024-12-02 cs.LG cs.CR 88%

DeepInception: Hypnotize Large Language Model to Be Jailbreaker

Xuan Li, Zhanke Zhou, Jianing Zhu, Jiangchao Yao, Tongliang Liu, Bo Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2406.13659 2024-11-27 cs.AI 88%

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

Bo Wen, Raquel Norel, Julia Liu, Thaddeus Stappenbeck, Farhana Zulkernine, Huamin Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 10 pages, 6 figures, ICDH 2024 invited paper

2404.02827 2024-11-18 cs.LG 88%

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Qijun Luo, Hengxu Yu, Xiao Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted for Publication in Conference on Neural Information Processing Systems, 2024

2402.09579 2024-11-18 cs.HC cs.AI 88%

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies

Liang Zhang, Zhelun Chen, Vitaly Ford

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.08728 2024-11-14 cs.AI 88%

Polymetis:Large Language Modeling for Multiple Material Domains

Chao Huang, Huichen Xiao, Chen Chen, Chunyan Chen, Yi Zhao, Shiyu Du, Yiming Zhang, He Sha, Ruixin Gu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.15586 2024-11-14 cs.LG cs.DC 88%

DAGER: Exact Gradient Inversion for Large Language Models

Ivo Petrov, Dimitar I. Dimitrov, Maximilian Baader, Mark Niklas Müller, Martin Vechev

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2402.10705 2024-11-14 cs.AI 88%

AutoSAT: Automatically Optimize SAT Solvers via Large Language Models

Yiwen Sun, Furong Ye, Xianyin Zhang, Shiyu Huang, Bingzhen Zhang, Ke Wei, Shaowei Cai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.05966 2024-11-12 q-bio.BM cs.LG 88%

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation

Aayush Shah, Shankar Jayaratnam

专题命中效率与部署：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.LG

2401.07013 2024-11-12 cs.CL 88%

Knowledge Distillation of Black-Box Large Language Models

Hongzhan Chen, Ruijun Chen, Yuqi Yi, Xiaojun Quan, Chenliang Li, Ming Yan, Ji Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.17235 2024-11-08 eess.IV cs.CL cs.CV 88%

Automated Spinal MRI Labelling from Reports Using a Large Language Model

Robin Y. Park, Rhydian Windsor, Amir Jamaludin, Andrew Zisserman

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to Medical Image Computing and Computer Assisted Intervention (MICCAI 2024, Spotlight). 11 pages plus appendix

Journal ref vol 15005, 2024, pp 101-111

2405.04304 2024-11-08 cs.CL 88%

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models

Jonathan Mamou, Oren Pereg, Daniel Korat, Moshe Berchansky, Nadav Timor, Moshe Wasserblat, Roy Schwartz

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2411.00414 2024-11-04 cs.CY cs.AI 88%

On the Opportunities of Large Language Models for Programming Process Data

John Edwards, Arto Hellas, Juho Leinonen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 14 pages

2411.00406 2024-11-04 cs.LG 88%

MoD: A Distribution-Based Approach for Merging Large Language Models

Quy-Anh Dang, Chris Ngo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2406.12311 2024-10-31 cs.LG 88%

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models

Dongwon Jo, Taesu Kim, Yulhwa Kim, Jae-Joon Kim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

1. 效率与部署 22313 篇

Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models

Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models

SlimGPT: Layer-wise Structured Pruning for Large Language Models

VirusT5: Harnessing Large Language Models to Predicting SARS-CoV-2 Evolution

A Career Interview Dialogue System using Large Language Model-based Dynamic Slot Generation

Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment

QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing

Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering

Distilling Rule-based Knowledge into Large Language Models

See Where You Read with Eye Gaze Tracking and Large Language Model

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference

Trustworthy AI: Securing Sensitive Data in Large Language Models

Computational Bottlenecks of Training Small-scale Large Language Models

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

DeepInception: Hypnotize Large Language Model to Be Jailbreaker

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies

Polymetis:Large Language Modeling for Multiple Material Domains

DAGER: Exact Gradient Inversion for Large Language Models

AutoSAT: Automatically Optimize SAT Solvers via Large Language Models

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation

Knowledge Distillation of Black-Box Large Language Models

Automated Spinal MRI Labelling from Reports Using a Large Language Model

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models

On the Opportunities of Large Language Models for Programming Process Data

MoD: A Distribution-Based Approach for Merging Large Language Models

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models