语言大模型 / LLM - arXivDaily 专题

2407.19409 2024-07-30 cs.CL cs.CV 88%

LLAVADI: What Matters For Multimodal Large Language Models Distillation

Shilin Xu, Xiangtai Li, Haobo Yuan, Lu Qi, Yunhai Tong, Ming-Hsuan Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2407.15904 2024-07-24 cs.LG 88%

Comprehensive Study on Performance Evaluation and Optimization of Model Compression: Bridging Traditional Deep Learning and Large Language Models

Aayush Saxena, Arit Kumar Bishwas, Ayush Ashok Mishra, Ryan Armstrong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2405.03425 2024-07-23 cs.CL 88%

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models

Emre Onal, Klemens Flöge, Emma Caldwell, Arsen Sheverdin, Vincent Fortuin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 14 pages, 1 figure, 2 tables

2403.19094 2024-07-19 cs.CL 88%

Learning From Correctness Without Prompting Makes LLM Efficient Reasoner

Yuxuan Yao, Han Wu, Zhijiang Guo, Biyan Zhou, Jiahui Gao, Sichun Luo, Hanxu Hou, Xiaojin Fu, Linqi Song

专题命中效率与部署：LLM(title)；prompting(title)；large language model(abstract)；language model(abstract)

Comments Accepted to COLM 2024

2407.01824 2024-07-03 cs.HC cs.CL cs.RO 88%

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents

Mehdi Arjmand, Farnaz Nouraei, Ian Steenstra, Timothy Bickmore

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.09773 2024-06-28 cs.CL 88%

NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models

Shengrui Li, Junzhe Chen, Xueting Han, Jing Bai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2312.16862 2024-06-24 cs.CV cs.CL 88%

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Zhengqing Yuan, Zhaoxu Li, Weiran Huang, Yanfang Ye, Lichao Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by ICML workshop 2024

2404.16906 2024-06-14 cs.NE cs.AI 88%

Evolve Cost-aware Acquisition Functions Using Large Language Models

Yiming Yao, Fei Liu, Ji Cheng, Qingfu Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.20773 2024-06-13 cs.CR cs.AI 88%

Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Character

Siyuan Ma, Weidi Luo, Yu Wang, Xiaogeng Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2406.07553 2024-06-13 cs.DC cs.CL 88%

Inference Acceleration for Large Language Models on CPUs

Ditto PS, Jithin VG, Adarsh MS

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2406.07084 2024-06-12 cs.LG 88%

Leveraging Large Language Models for Efficient Failure Analysis in Game Development

Leonardo Marini, Linus Gisslén, Alessandro Sestini

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Published at CoG 2024

2402.11597 2024-06-07 cs.CL 88%

Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?

Guijin Son, Sangwon Baek, Sangdae Nam, Ilgyun Jeong, Seungone Kim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments acl 2024 (main)

2401.08295 2024-06-07 cs.CL 88%

SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models

Weixiang Zhao, Shilong Wang, Yulin Hu, Yanyan Zhao, Bing Qin, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments To appear at ACL 2024

2406.01983 2024-06-05 cs.CL 88%

RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models

Bichen Wang, Yuzhe Zi, Yixin Sun, Yanyan Zhao, Bing Qin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Work is in progress

2405.10637 2024-06-05 cs.CL 88%

Layer-Condensed KV Cache for Efficient Inference of Large Language Models

Haoyi Wu, Kewei Tu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL2024 main conference

2401.02051 2024-06-04 cs.NE cs.AI 88%

Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model

Fei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin, Fu Luo, Zhenkun Wang, Zhichao Lu, Qingfu Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2310.12945 2024-05-30 cs.CV cs.GR cs.LG 88%

3D-GPT: Procedural 3D Modeling with Large Language Models

Chunyi Sun, Junlin Han, Weijian Deng, Xinlong Wang, Zishan Qin, Stephen Gould

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Project page: https://chuny1.github.io/3DGPT/3dgpt.html

2308.15030 2024-05-30 cs.AI 88%

SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget

Rui Kong, Yuanchun Li, Qingtian Feng, Weijun Wang, Xiaozhou Ye, Ye Ouyang, Linghe Kong, Yunxin Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted at ACL 2024

2405.18377 2024-05-29 cs.AI 88%

LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models

Anthony Sarah, Sharath Nittur Sridhar, Maciej Szankin, Sairam Sundaresan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.17637 2024-05-29 cs.AI cs.CE 88%

The Economic Implications of Large Language Model Selection on Earnings and Return on Investment: A Decision Theoretic Model

Geraldo Xexéo, Filipe Braida, Marcus Parreiras, Paulo Xavier

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.AI

Comments 27 pages, 13 figures

2311.02851 2024-05-28 cs.CL 88%

Improving Machine Translation with Large Language Models: A Preliminary Study with Cooperative Decoding

Jiali Zeng, Fandong Meng, Yongjing Yin, Jie Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ACL2024 findings

2307.16230 2024-05-28 cs.CL 88%

An Unforgeable Publicly Verifiable Watermark for Large Language Models

Aiwei Liu, Leyi Pan, Xuming Hu, Shu'ang Li, Lijie Wen, Irwin King, Philip S. Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ICLR2024, 17 pages, 5 figures, 8 tables

2405.08037 2024-05-15 cs.HC cs.AI 88%

Layout Generation Agents with Large Language Models

Yuichi Sasazawa, Yasuhiro Sogawa

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.03917 2024-05-08 cs.LG 88%

KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization

Tianyi Zhang, Jonah Yi, Zhaozhuo Xu, Anshumali Shrivastava

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2404.19737 2024-05-01 cs.CL 88%

Better & Faster Large Language Models via Multi-token Prediction

Fabian Gloeckle, Badr Youbi Idrissi, Baptiste Rozière, David Lopez-Paz, Gabriel Synnaeve

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.19221 2024-05-01 cs.CV cs.CL 88%

Transcrib3D: 3D Referring Expression Resolution through Large Language Models

Jiading Fang, Xiangshan Tan, Shengjie Lin, Igor Vasiljevic, Vitor Guizilini, Hongyuan Mei, Rares Ambrus, Gregory Shakhnarovich, Matthew R Walter

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments CORLW 2023

2404.16557 2024-04-26 cs.CV cs.AI 88%

Energy-Latency Manipulation of Multi-modal Large Language Models via Verbose Samples

Kuofeng Gao, Jindong Gu, Yang Bai, Shu-Tao Xia, Philip Torr, Wei Liu, Zhifeng Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments arXiv admin note: substantial text overlap with arXiv:2401.11170

2404.16109 2024-04-26 cs.LG cs.CR 88%

zkLLM: Zero Knowledge Proofs for Large Language Models

Haochen Sun, Jason Li, Hongyang Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted to ACM CCS 2024, camera-ready version under preparation. This is the author's version of the work. It is posted here for your personal use. Not for redistribution

2404.14914 2024-04-24 cs.CL 88%

Pillars of Grammatical Error Correction: Comprehensive Inspection Of Contemporary Approaches In The Era of Large Language Models

Kostiantyn Omelianchuk, Andrii Liubonko, Oleksandr Skurzhanskyi, Artem Chernodub, Oleksandr Korniienko, Igor Samokhin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.12022 2024-04-19 cs.CL 88%

Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration

Pengfei Wu, Jiahao Liu, Zhuocheng Gong, Qifan Wang, Jinpeng Li, Jingang Wang, Xunliang Cai, Dongyan Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

1. 效率与部署 22313 篇

LLAVADI: What Matters For Multimodal Large Language Models Distillation

Comprehensive Study on Performance Evaluation and Optimization of Model Compression: Bridging Traditional Deep Learning and Large Language Models

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models

Learning From Correctness Without Prompting Makes LLM Efficient Reasoner

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents

NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Evolve Cost-aware Acquisition Functions Using Large Language Models

Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Character

Inference Acceleration for Large Language Models on CPUs

Leveraging Large Language Models for Efficient Failure Analysis in Game Development

Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?

SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models

RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models

Layer-Condensed KV Cache for Efficient Inference of Large Language Models

Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model

3D-GPT: Procedural 3D Modeling with Large Language Models

SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget

LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models

The Economic Implications of Large Language Model Selection on Earnings and Return on Investment: A Decision Theoretic Model

Improving Machine Translation with Large Language Models: A Preliminary Study with Cooperative Decoding

An Unforgeable Publicly Verifiable Watermark for Large Language Models

Layout Generation Agents with Large Language Models

KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization

Better & Faster Large Language Models via Multi-token Prediction

Transcrib3D: 3D Referring Expression Resolution through Large Language Models

Energy-Latency Manipulation of Multi-modal Large Language Models via Verbose Samples

zkLLM: Zero Knowledge Proofs for Large Language Models

Pillars of Grammatical Error Correction: Comprehensive Inspection Of Contemporary Approaches In The Era of Large Language Models

Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration