语言大模型 / LLM - arXivDaily 专题

2403.03432 2024-03-07 cs.CL cs.AI 90%

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models

Wenfeng Feng, Chuzhan Hao, Yuewei Zhang, Yu Han, Hao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, COLING24 Accepted

2402.00421 2024-03-06 cs.CL cs.HC cs.IR cs.LG 90%

From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models

Jung-Mei Chu, Hao-Cheng Lo, Jieh Hsiang, Chun-Chieh Cho

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 28 pages, 5 figures, typos corrected, references added, under review

2403.00830 2024-03-05 cs.AI cs.CL 90%

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

Abdul Basit, Khizar Hussain, Muhammad Abdullah Hanif, Muhammad Shafique

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 11 figures, ACM conference paper, 33 references

2402.17764 2024-02-28 cs.CL cs.LG 90%

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Work in progress

2310.14403 2024-02-27 cs.AI cs.CL 90%

O3D: Offline Data-driven Discovery and Distillation for Sequential Decision-Making with Large Language Models

Yuchen Xiao, Yanchao Sun, Mengda Xu, Udari Madhushani, Jared Vann, Deepeka Garg, Sumitra Ganesh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2310.09266 2024-02-27 cs.CR cs.CL cs.LG 90%

User Inference Attacks on Large Language Models

Nikhil Kandpal, Krishna Pillutla, Alina Oprea, Peter Kairouz, Christopher A. Choquette-Choo, Zheng Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments v2 contains experiments on additional datasets and differential privacy

2308.06013 2024-02-27 cs.IT cs.AI cs.LG math.IT 90%

Large Language Models for Telecom: Forthcoming Impact on the Industry

Ali Maatouk, Nicola Piovesan, Fadhel Ayed, Antonio De Domenico, Merouane Debbah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2402.14714 2024-02-23 cs.CL cs.AI 90%

Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

Seungduk Kim, Seungtaek Choi, Myeongho Jeong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.09588 2024-02-20 cs.AI cs.CL 90%

Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications

David Oniani, Jordan Hilsman, Chengxi Zang, Junmei Wang, Lianjin Cai, Jan Zawala, Yanshan Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.06696 2024-02-13 cs.LG cs.AI 90%

FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models

Ruiyang Qin, Yuting Hu, Zheyu Yan, Jinjun Xiong, Ahmed Abbasi, Yiyu Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ASP-DAC 2024

2310.15080 2024-02-13 cs.LG cs.CL cs.DC 90%

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Tianshi Che, Ji Liu, Yang Zhou, Jiaxiang Ren, Jiwen Zhou, Victor S. Sheng, Huaiyu Dai, Dejing Dou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 18 pages, accepted by EMNLP 2023

2309.08968 2024-02-12 cs.CL cs.LG 90%

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

Parsa Kavehzadeh, Mojtaba Valipour, Marzieh Tahaei, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.LG

Comments Accepted to EACL 2024 - Findings

2402.02309 2024-02-07 cs.LG cs.CL cs.CR cs.CV 90%

Jailbreaking Attack against Multimodal Large Language Model

Zhenxing Niu, Haodong Ren, Xinbo Gao, Gang Hua, Rong Jin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2402.01750 2024-02-06 cs.CL cs.AI 90%

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models

Jiaxuan Li, Minxi Yang, Dahua Gao, Wenlong Xu, Guangming Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages,11 figures, submitted to IJCAI 2024

2402.01725 2024-02-06 cs.CL cs.AI 90%

Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models

Yunhong He, Jianling Qiu, Wei Zhang, Zhengqing Yuan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.01706 2024-02-06 cs.CL cs.LG 90%

MULTIVERSE: Exposing Large Language Model Alignment Problems in Diverse Worlds

Xiaolong Jin, Zhuo Zhang, Xiangyu Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2401.16960 2024-01-31 cs.CL cs.AI 90%

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Linyao Yang, Hongyang Chen, Xiao Wang, Jing Yang, Fei-Yue Wang, Han Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2311.17227 2024-01-31 cs.AI cs.CL cs.CY 90%

War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars

Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, Yongfeng Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 47 pages, 9 figures, 5 tables

2401.15123 2024-01-30 cs.LG cs.AI 90%

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection

Chen Liu, Shibo He, Qihang Zhou, Shizhong Li, Wenchao Meng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 12 pages, 5 figures

2311.01282 2024-01-08 cs.LG cs.CL 90%

FlashDecoding++: Faster Large Language Model Inference on GPUs

Ke Hong, Guohao Dai, Jiaming Xu, Qiuli Mao, Xiuhong Li, Jun Liu, Kangdi Chen, Yuhan Dong, Yu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2312.11983 2023-12-20 cs.CL cs.AI 90%

Fluctuation-based Adaptive Structured Pruning for Large Language Models

Yongqi An, Xu Zhao, Tao Yu, Ming Tang, Jinqiao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to AAAI 2024

2312.03788 2023-12-08 cs.LG cs.CL 90%

SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

Jiayi Pan, Chengcan Wang, Kaifu Zheng, Yangguang Li, Zhenyu Wang, Bin Feng

专题命中效率与部署：post-training(title,abstract)；LLM(title)；large language model(abstract)；language model(abstract)

2312.00843 2023-12-05 cs.LG cs.AI cs.CR 90%

Exploring the Robustness of Decentralized Training for Large Language Models

Lin Lu, Chenxi Dai, Wangcheng Tao, Binhang Yuan, Yanan Sun, Pan Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 3 figures

2311.03687 2023-12-04 cs.PF cs.CL cs.LG 90%

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

Longteng Zhang, Xiang Liu, Zeyu Li, Xinglin Pan, Peijie Dong, Ruibo Fan, Rui Guo, Xin Wang, Qiong Luo, Shaohuai Shi, Xiaowen Chu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2311.15566 2023-11-28 cs.DC cs.CL cs.LG 90%

SpotServe: Serving Generative Large Language Models on Preemptible Instances

Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ASPLOS 2024

2311.08692 2023-11-16 cs.CL cs.LG 90%

Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models

Keming Lu, Hongyi Yuan, Runji Lin, Junyang Lin, Zheng Yuan, Chang Zhou, Jingren Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2311.01786 2023-11-06 cs.CL cs.AI 90%

TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine

Guoxing Yang, Jianyu Shi, Zan Wang, Xiaohong Liu, Guangyu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2305.14152 2023-10-31 cs.LG cs.AI 90%

Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

Jeonghoon Kim, Jung Hyun Lee, Sungdong Kim, Joonsuk Park, Kang Min Yoo, Se Jung Kwon, Dongsoo Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments Published at NeurIPS 2023. Camera-ready version

2310.13012 2023-10-24 cs.CL cs.AI 90%

H2O Open Ecosystem for State-of-the-art Large Language Models

Arno Candel, Jon McKinney, Philipp Singer, Pascal Pfeiffer, Maximilian Jeblick, Chun Ming Lee, Marcos V. Conde

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023 Demo - ACL Empirical Methods in Natural Language Processing

2310.04564 2023-10-10 cs.LG cs.AI 90%

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models

Iman Mirzadeh, Keivan Alizadeh, Sachin Mehta, Carlo C Del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments preprint

1. 效率与部署 22368 篇

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models

From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

O3D: Offline Data-driven Discovery and Distillation for Sequential Decision-Making with Large Language Models

User Inference Attacks on Large Language Models

Large Language Models for Telecom: Forthcoming Impact on the Industry

Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications

FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

Jailbreaking Attack against Multimodal Large Language Model

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models

Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models

MULTIVERSE: Exposing Large Language Model Alignment Problems in Diverse Worlds

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection

FlashDecoding++: Faster Large Language Model Inference on GPUs

Fluctuation-based Adaptive Structured Pruning for Large Language Models

SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

Exploring the Robustness of Decentralized Training for Large Language Models

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

SpotServe: Serving Generative Large Language Models on Preemptible Instances

Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models

TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine

Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

H2O Open Ecosystem for State-of-the-art Large Language Models

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models