语言大模型 / LLM - arXivDaily 专题

2408.14467 2024-08-27 cs.CL 89%

Explicit Inductive Inference using Large Language Models

Tianyang Liu, Tianyi Li, Liang Cheng, Mark Steedman

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2408.12616 2024-08-27 cs.CV cs.AI 89%

Semantic Communication based on Large Language Model for Underwater Image Transmission

Weilong Chen, Wenxuan Xu, Haoran Chen, Xinran Zhang, Zhijin Qin, Yanru Zhang, Zhu Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2408.12080 2024-08-23 eess.SP cs.AI cs.NI 89%

Exploring the Feasibility of Automated Data Standardization using Large Language Models for Seamless Positioning

Max J. L. Lee, Ju Lin, Li-Ta Hsu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted at IPIN 2024. To be published in IEEE Xplore

2406.07528 2024-08-23 cs.LG 89%

QuickLLaMA: Query-aware Inference Acceleration for Large Language Models

Jingyao Li, Han Shi, Xin Jiang, Zhenguo Li, Hong Xu, Jiaya Jia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2408.11743 2024-08-22 cs.LG 89%

MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

Elias Frantar, Roberto L. Castro, Jiale Chen, Torsten Hoefler, Dan Alistarh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2408.10764 2024-08-21 cs.CL 89%

Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model

Chenhan Yuan, Fei Huang, Ru Peng, Keming Lu, Bowen Yu, Chang Zhou, Jingren Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages

2408.07505 2024-08-21 cs.CL 89%

Large Language Models Know What Makes Exemplary Contexts

Quanyu Long, Jianda Chen, Wenya Wang, Sinno Jialin Pan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 12 pages, 3 figures

2402.07867 2024-08-14 cs.CR cs.LG 89%

PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models

Wei Zou, Runpeng Geng, Binghui Wang, Jinyuan Jia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments To appear in USENIX Security Symposium 2025. The code is available at https://github.com/sleeepeer/PoisonedRAG

2408.03130 2024-08-07 cs.CL 89%

Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations

Leo Donisch, Sigurd Schacht, Carsten Lanquillon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2408.03094 2024-08-07 cs.CL 89%

500xCompressor: Generalized Prompt Compression for Large Language Models

Zongqian Li, Yixuan Su, Nigel Collier

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2408.00948 2024-08-05 cs.CL cs.CY 89%

Leveraging Large Language Models (LLMs) for Traffic Management at Urban Intersections: The Case of Mixed Traffic Scenarios

Sari Masri, Huthaifa I. Ashqar, Mohammed Elhenawy

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.09904 2024-08-01 cs.LG 89%

QQQ: Quality Quattuor-Bit Quantization for Large Language Models

Ying Zhang, Peng Zhang, Mincong Huang, Jingyang Xiang, Yujie Wang, Chao Wang, Yineng Zhang, Lei Yu, Chuan Liu, Wei Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2401.14351 2024-07-26 cs.LG cs.DC 89%

ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 18th USENIX Symposium on Operating Systems Design and Implementation

2407.17211 2024-07-25 cs.AI cs.NI cs.RO 89%

Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles

Zuoyin Tang, Jianhua He, Dashuai Pei, Kezhong Liu, Tao Gao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.16521 2024-07-25 cs.CL 89%

AMONGAGENTS: Evaluating Large Language Models in the Interactive Text-Based Social Deduction Game

Yizhou Chi, Lingjun Mao, Zineng Tang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；language agent(abstract)；分类 cs.CL

Comments Wordplay @ ACL 2024

2401.15569 2024-07-25 cs.CL 89%

Efficient Tuning and Inference for Large Language Models on Textual Graphs

Yun Zhu, Yaoke Wang, Haizhou Shi, Siliang Tang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by IJCAI2024

2407.16154 2024-07-24 cs.CL 89%

DDK: Distilling Domain Knowledge for Efficient Large Language Models

Jiaheng Liu, Chenchen Zhang, Jinyang Guo, Yuanxing Zhang, Haoran Que, Ken Deng, Zhiqi Bai, Jie Liu, Ge Zhang, Jiakai Wang, Yanan Wu, Congnan Liu, Wenbo Su, Jiamang Wang, Lin Qu, Bo Zheng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2407.14996 2024-07-23 cs.LG 89%

All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks

Ajay Jaiswal, Nurendra Choudhary, Ravinarayana Adkathimar, Muthu P. Alagappan, Gaurush Hiranandani, Ying Ding, Zhangyang Wang, Edward W Huang, Karthik Subbian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2407.14645 2024-07-23 cs.AR cs.DC cs.LG 89%

Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference

Joyjit Kundu, Wenzhe Guo, Ali BanaGozar, Udari De Alwis, Sourav Sengupta, Puneet Gupta, Arindam Mallik

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 12 pages, 9 figures

2407.10114 2024-07-23 cs.CL 89%

TokenSHAP: Interpreting Large Language Models with Monte Carlo Shapley Value Estimation

Roni Goldshmidt, Miriam Horovicz

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2404.14527 2024-07-23 cs.DC cs.LG 89%

Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity

Tyler Griggs, Xiaoxuan Liu, Jiaxiang Yu, Doyoung Kim, Wei-Lin Chiang, Alvin Cheung, Ion Stoica

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2310.07240 2024-07-23 cs.NI cs.LG 89%

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

Yuhan Liu, Hanchen Li, Yihua Cheng, Siddhant Ray, Yuyang Huang, Qizheng Zhang, Kuntai Du, Jiayi Yao, Shan Lu, Ganesh Ananthanarayanan, Michael Maire, Henry Hoffmann, Ari Holtzman, Junchen Jiang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments SIGCOMM'24

2406.11187 2024-07-22 cs.LG 89%

Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent

Lin Wang, Zhichao Wang, Xiaoying Tang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2311.05161 2024-07-19 cs.CL 89%

Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization

Janghwan Lee, Minsoo Kim, Seungcheol Baek, Seok Joong Hwang, Wonyong Sung, Jungwook Choi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments EMNLP 2023 Main Conference. Corrected an error in the first author name

2407.10068 2024-07-16 cs.CL 89%

Multi-Granularity Semantic Revision for Large Language Model Distillation

Xiaoyu Liu, Yun Zhang, Wei Li, Simiao Li, Xudong Huang, Hanting Chen, Yehui Tang, Jie Hu, Zhiwei Xiong, Yunhe Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2407.04581 2024-07-08 cs.LG cs.ET 89%

Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions

Shumaila Javaid, Ruhul Amin Khalil, Nasir Saeed, Bin He, Mohamed-Slim Alouini

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2403.20041 2024-07-08 cs.CL 89%

Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

Luchang Li, Sheng Qian, Jie Lu, Lunxi Yuan, Rui Wang, Qin Xie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 21 pages, 6 figures, fix "E0M4" spell mistake, fix FLOPS to TFLOPS

2407.01955 2024-07-03 cs.CL 89%

S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models

Parsa Kavehzadeh, Mohammadreza Pourreza, Mojtaba Valipour, Tinashu Zhu, Haoli Bai, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.07588 2024-07-02 cs.MM cs.CL 89%

AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning

Jun Gao, Qian Qiao, Ziqiang Cao, Zili Wang, Wenjie Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.19707 2024-07-01 cs.LG cs.DC 89%

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

Wonbeom Lee, Jungi Lee, Junghwan Seo, Jaewoong Sim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments OSDI 2024

1. 效率与部署 22405 篇

Explicit Inductive Inference using Large Language Models

Semantic Communication based on Large Language Model for Underwater Image Transmission

Exploring the Feasibility of Automated Data Standardization using Large Language Models for Seamless Positioning

QuickLLaMA: Query-aware Inference Acceleration for Large Language Models

MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

Predicting Rewards Alongside Tokens: Non-disruptive Parameter Insertion for Efficient Inference Intervention in Large Language Model

Large Language Models Know What Makes Exemplary Contexts

PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models

Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations

500xCompressor: Generalized Prompt Compression for Large Language Models

Leveraging Large Language Models (LLMs) for Traffic Management at Urban Intersections: The Case of Mixed Traffic Scenarios

QQQ: Quality Quattuor-Bit Quantization for Large Language Models

ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles

AMONGAGENTS: Evaluating Large Language Models in the Interactive Text-Based Social Deduction Game

Efficient Tuning and Inference for Large Language Models on Textual Graphs

DDK: Distilling Domain Knowledge for Efficient Large Language Models

All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks

Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference

TokenSHAP: Interpreting Large Language Models with Monte Carlo Shapley Value Estimation

Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent

Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization

Multi-Granularity Semantic Revision for Large Language Model Distillation

Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions

Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models

AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management