语言大模型 / LLM - arXivDaily 专题

2310.12558 2024-04-03 cs.CL cs.HC 89%

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong

Chenglei Si, Navita Goyal, Sherry Tongshuang Wu, Chen Zhao, Shi Feng, Hal Daumé, Jordan Boyd-Graber

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2024

2403.09522 2024-04-02 cs.CL 89%

MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

Jiahuan Li, Shanbo Cheng, Shujian Huang, Jiajun Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to NAACL-2024 main conference

2403.18152 2024-03-28 cs.CL 89%

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency

Toyin Aguda, Suchetha Siddagangappa, Elena Kochkina, Simerjot Kaur, Dongsheng Wang, Charese Smiley, Sameena Shah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to LREC-COLING 2024

2403.06199 2024-03-26 cs.CV cs.CL 89%

Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models

Minjie Zhu, Yichen Zhu, Xin Liu, Ning Liu, Zhiyuan Xu, Chaomin Shen, Yaxin Peng, Zhicai Ou, Feifei Feng, Jian Tang

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL

2402.09282 2024-03-26 cs.CL 89%

Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

Yining Huang, Keke Tang, Meilian Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages, 3 figures

2403.06664 2024-03-12 cs.AR cs.LG 89%

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

Hongsun Jang, Jaeyong Song, Jaewon Jung, Jaeyoung Park, Youngsok Kim, Jinho Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Published at HPCA 2024 (Best Paper Award Honorable Mention)

2403.00277 2024-03-04 cs.CL 89%

Gender Bias in Large Language Models across Multiple Languages

Jinman Zhao, Yitian Ding, Chen Jia, Yining Wang, Zifan Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 20 pages, 27 tables, 7 figures, submitted to ACL2024

2402.18169 2024-03-01 cs.CL 89%

MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery

Feihong Lu, Weiqi Wang, Yangyifei Luo, Ziqin Zhu, Qingyun Sun, Baixuan Xu, Haochen Shi, Shiqi Gao, Qian Li, Yangqiu Song, Jianxin Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 11 pages, 5 figures

2402.15627 2024-02-27 cs.LG cs.DC 89%

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2402.13667 2024-02-22 cs.CL 89%

GCOF: Self-iterative Text Generation for Copywriting Using Large Language Model

Jianghui Zhou, Ya Gao, Jie Liu, Xuemin Zhao, Zhaohua Yang, Yue Wu, Lirong Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 8 pages, 5 figures, 1 table

2401.07764 2024-02-20 cs.AI cs.NI 89%

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Minrui Xu, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shiwen Mao, Zhu Han, Dong In Kim, Khaled B. Letaief

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2402.01994 2024-02-06 cs.HC cs.AI cs.CR 89%

Human-Centered Privacy Research in the Age of Large Language Models

Tianshi Li, Sauvik Das, Hao-Ping Lee, Dakuo Wang, Bingsheng Yao, Zhiping Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 4 pages, CHI EA'24

2401.16212 2024-01-30 cs.CY cs.CL 89%

Better Call GPT, Comparing Large Language Models Against Lawyers

Lauren Martin, Nick Whitehouse, Stephanie Yiu, Lizzie Catterson, Rivindu Perera

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages

2306.02272 2024-01-25 cs.CL 89%

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models

Changhun Lee, Jungyu Jin, Taesu Kim, Hyungjun Kim, Eunhyeok Park

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at AAAI 2024 (oral presentation)

2308.03279 2024-01-22 cs.CL 89%

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted at ICLR 2024. Project page: https://universal-ner.github.io/

2307.14995 2024-01-22 cs.CL 89%

TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Xiao Luo, Yu Qiao, Yiran Zhong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Technical Report. Yiran Zhong is the corresponding author. Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen contribute equally to this paper. Code is released at: https://github.com/OpenNLPLab/TransnormerLLM

2401.03868 2024-01-10 cs.AR cs.AI 89%

FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs

Shulin Zeng, Jun Liu, Guohao Dai, Xinhao Yang, Tianyu Fu, Hongyi Wang, Wenheng Ma, Hanbo Sun, Shiyao Li, Zixiao Huang, Yadong Dai, Jintao Li, Zehao Wang, Ruoyu Zhang, Kairui Wen, Xuefei Ning, Yu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted to FPGA'24

2312.15661 2024-01-04 cs.IR cs.AI 89%

Unlocking the Potential of Large Language Models for Explainable Recommendations

Yucong Luo, Mingyue Cheng, Hao Zhang, Junyu Lu, Qi Liu, Enhong Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2312.08361 2023-12-14 cs.LG cs.DC 89%

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, Tim Dettmers, Younes Belkada, Pavel Samygin, Colin Raffel

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Accepted to Conference on Neural Information Processing Systems (NeurIPS) 2023. 20 pages, 3 figures

2312.05662 2023-12-13 cs.CL 89%

Understanding the Effect of Model Compression on Social Bias in Large Language Models

Gustavo Gonçalves, Emma Strubell

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments EMNLP 2023 Main

2312.06099 2023-12-12 cs.CL 89%

Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need

Cheng Peng, Xi Yang, Aokun Chen, Zehao Yu, Kaleb E Smith, Anthony B Costa, Mona G Flores, Jiang Bian, Yonghui Wu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2312.03134 2023-12-07 cs.AR cs.DC cs.LG 89%

A Hardware Evaluation Framework for Large Language Model Inference

Hengrui Zhang, August Ning, Rohan Prabhakar, David Wentzlaff

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2312.02443 2023-12-06 cs.IR cs.AI 89%

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

Xinhang Li, Chong Chen, Xiangyu Zhao, Yong Zhang, Chunxiao Xing

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2312.00388 2023-12-04 cs.LG cs.DC cs.NI 89%

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

Junchen Zhao, Yurun Song, Simeng Liu, Ian G. Harris, Sangeetha Abdu Jyothi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 16 pages, 8 figures

2311.08213 2023-11-15 cs.CV cs.CL 89%

Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models

Xinwei Li, Li Lin, Shuai Wang, Chen Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

2311.01555 2023-11-06 cs.IR cs.CL 89%

Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers

Weiwei Sun, Zheng Chen, Xinyu Ma, Lingyong Yan, Shuaiqiang Wang, Pengjie Ren, Zhumin Chen, Dawei Yin, Zhaochun Ren

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2305.15004 2023-11-06 cs.CL 89%

LLMDet: A Third Party Large Language Models Generated Text Detection Tool

Kangxi Wu, Liang Pang, Huawei Shen, Xueqi Cheng, Tat-Seng Chua

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to the Findings of EMNLP 2023

2310.18813 2023-10-31 cs.LG cs.DC 89%

The Synergy of Speculative Decoding and Batching in Serving Large Language Models

Qidong Su, Christina Giannoula, Gennady Pekhimenko

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2304.09145 2023-10-24 cs.CL 89%

Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling

Xiuying Wei, Yunchen Zhang, Yuhang Li, Xiangguo Zhang, Ruihao Gong, Jinyang Guo, Xianglong Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments Accepted to EMNLP23 (main)

2310.14092 2023-10-24 cs.RO cs.AI 89%

Learning Reward for Physical Skills using Large Language Model

Yuwei Zeng, Yiqing Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments CoRL 2023, LangRob workshop

1. 效率与部署 22405 篇

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong

MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency

Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models

Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

Gender Bias in Large Language Models across Multiple Languages

MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

GCOF: Self-iterative Text Generation for Copywriting Using Large Language Model

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Human-Centered Privacy Research in the Age of Large Language Models

Better Call GPT, Comparing Large Language Models Against Lawyers

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer

FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs

Unlocking the Potential of Large Language Models for Explainable Recommendations

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Understanding the Effect of Model Compression on Social Bias in Large Language Models

Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need

A Hardware Evaluation Framework for Large Language Model Inference

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models

Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers

LLMDet: A Third Party Large Language Models Generated Text Detection Tool

The Synergy of Speculative Decoding and Batching in Serving Large Language Models

Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling

Learning Reward for Physical Skills using Large Language Model