语言大模型 / LLM - arXivDaily 专题

2402.11809 2024-05-21 cs.CL cs.AI cs.LG 89%

Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding

Hanling Yi, Feng Lin, Hongbin Li, Peiyang Ning, Xiaotian Yu, Rong Xiao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ACL 2024 Findings

2405.05767 2024-05-10 cs.NE 89%

Large Language Model-Aided Evolutionary Search for Constrained Multiobjective Optimization

Zeyi Wang, Songbai Liu, Jianyong Chen, Kay Chen Tan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 15 pages, 6 figures, 2024 International Conference on Intelligent Computing

2405.04674 2024-05-09 cs.DB 89%

Towards Accurate and Efficient Document Analytics with Large Language Models

Yiming Lin, Madelon Hulsebos, Ruiying Ma, Shreya Shankar, Sepanta Zeigham, Aditya G. Parameswaran, Eugene Wu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2405.00824 2024-05-03 cs.IR cs.HC 89%

Efficient and Responsible Adaptation of Large Language Models for Robust Top-k Recommendations

Kirandeep Kaur, Chirag Shah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2404.15851 2024-04-25 cs.CV 89%

Porting Large Language Models to Mobile Devices for Question Answering

Hannes Fassold

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted for ASPAI 2024 Conference

2404.10327 2024-04-19 cs.IR 89%

Exact and Efficient Unlearning for Large Language Model-based Recommendation

Zhiyu Hu, Yang Zhang, Minghao Xiao, Wenjie Wang, Fuli Feng, Xiangnan He

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2403.18679 2024-04-18 cs.SE cs.HC 89%

An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project

Ben Arie Tanay, Lexy Arinze, Siddhant S. Joshi, Kirsten A. Davis, James C. Davis

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted to the 2024 General Conference of the American Society for Engineering Education (ASEE)

2404.09695 2024-04-16 cs.LG cs.AI cs.CL 89%

LoRAP: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models

Guangyan Li, Yongqiang Tang, Wensheng Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages,4 figures

2404.08856 2024-04-16 cs.CL cs.AI cs.LG 89%

On Speculative Decoding for Multimodal Large Language Models

Mukul Gagrani, Raghavv Goel, Wonseok Jeon, Junyoung Park, Mingu Lee, Christopher Lott

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted as a spotlight paper to ELVM workshop at CVPR 2024

2404.05741 2024-04-10 cs.LG cs.AI cs.CL cs.PF 89%

Enhancing Inference Efficiency of Large Language Models: Investigating Optimization Strategies and Architectural Innovations

Georgy Tyukin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2311.04902 2024-04-10 cs.CL cs.AI cs.LG 89%

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models

Rocktim Jyoti Das, Mingjie Sun, Liqun Ma, Zhiqiang Shen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Code and models at https://github.com/VILA-Lab/GBLM-Pruner

2311.08721 2024-04-02 cs.CR 89%

A Robust Semantics-based Watermark for Large Language Model against Paraphrasing

Jie Ren, Han Xu, Yiding Liu, Yingqian Cui, Shuaiqiang Wang, Dawei Yin, Jiliang Tang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted to NAACL findings 2024

2401.03038 2024-04-02 cs.DB cs.SE 89%

SPADE: Synthesizing Data Quality Assertions for Large Language Model Pipelines

Shreya Shankar, Haotian Li, Parth Asawa, Madelon Hulsebos, Yiming Lin, J. D. Zamfirescu-Pereira, Harrison Chase, Will Fu-Hinthorn, Aditya G. Parameswaran, Eugene Wu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 17 pages, 6 figures

2312.09238 2024-04-02 cs.AI cs.CL cs.CV cs.LG 89%

Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft

Hao Li, Xue Yang, Zhaokai Wang, Xizhou Zhu, Jie Zhou, Yu Qiao, Xiaogang Wang, Hongsheng Li, Lewei Lu, Jifeng Dai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by CVPR2024

2403.19016 2024-03-29 cs.DC cs.SY eess.SP eess.SY math.OC 89%

Resource Allocation in Large Language Model Integrated 6G Vehicular Networks

Chang Liu, Jun Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments This paper appears in the 2024 IEEE 99th Vehicular Technology Conference (VTC)

2403.18159 2024-03-29 cs.LG cs.AI cs.CL 89%

Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models

Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Kyunggeun Lee, Jun Ma, Harris Teague

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at Practical ML for Low Resource Settings Workshop at ICLR 2024

2403.16378 2024-03-26 cs.IR 89%

Play to Your Strengths: Collaborative Intelligence of Conventional Recommender Models and Large Language Models

Yunjia Xi, Weiwen Liu, Jianghao Lin, Chuhan Wu, Bo Chen, Ruiming Tang, Weinan Zhang, Yong Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2403.15886 2024-03-26 cs.CL cs.AI cs.LG 89%

Leveraging Zero-Shot Prompting for Efficient Language Model Distillation

Lukas Vöge, Vincent Gurgul, Stefan Lessmann

专题命中效率与部署：prompting(title,abstract)；language model(title)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.15475 2024-03-26 cs.CY 89%

Large language models can help boost food production, but be mindful of their risks

Djavan De Clercq, Elias Nehring, Harry Mayne, Adam Mahdi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2310.17872 2024-03-11 cs.IT eess.SP math.IT 89%

User Association and Resource Allocation in Large Language Model Based Mobile Edge Computing System over 6G Wireless Communications

Liangxin Qian, Jun Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments This paper appears in the 2024 IEEE 99th Vehicular Technology Conference (VTC)

2310.00163 2024-03-08 cs.RO 89%

Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models

Angelos Mavrogiannis, Christoforos Mavrogiannis, Yiannis Aloimonos

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments ICRA 2024 final version

2403.01008 2024-03-05 cs.CR cs.IR 89%

BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

Sean Wellington

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2402.17985 2024-02-29 cs.LG cs.AI cs.CL 89%

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

Yi Zhang, Fei Yang, Shuang Peng, Fangyu Wang, Aimin Pan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2402.11323 2024-02-20 cs.DL 89%

Towards Development of Automated Knowledge Maps and Databases for Materials Engineering using Large Language Models

Deepak Prasad, Mayur Pimpude, Alankar Alankar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2402.09748 2024-02-16 cs.CL cs.AI cs.LG cs.PF 89%

Model Compression and Efficient Inference for Large Language Models: A Survey

Wenxiao Wang, Wei Chen, Yicong Luo, Yongliu Long, Zhengkai Lin, Liye Zhang, Binbin Lin, Deng Cai, Xiaofei He

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 47 pages, review 380 papers. The work is ongoing

2402.00251 2024-02-02 cs.LG cs.AI cs.CL 89%

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

Yao-Hung Hubert Tsai, Walter Talbott, Jian Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2309.15223 2024-01-29 cs.CL cs.AI cs.LG cs.NE cs.SD eess.AS 89%

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

Yu Yu, Chao-Han Huck Yang, Jari Kolehmainen, Prashanth G. Shivakumar, Yile Gu, Sungho Ryu, Roger Ren, Qi Luo, Aditya Gourav, I-Fan Chen, Yi-Chieh Liu, Tuan Dinh, Ankur Gandhe, Denis Filimonov, Shalini Ghosh, Andreas Stolcke, Ariya Rastow, Ivan Bulyko

专题命中效率与部署：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to IEEE ASRU 2023. Internal Review Approved. Revised 2nd version with Andreas and Huck. The first version is in Sep 29th. 8 pages

Journal ref Proc. IEEE ASRU Workshop, Dec. 2023

2401.09149 2024-01-23 cs.DC 89%

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding

Qiaoling Chen, Diandian Gu, Guoteng Wang, Xun Chen, YingTong Xiong, Ting Huang, Qinghao Hu, Xin Jin, Yonggang Wen, Tianwei Zhang, Peng Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2310.16984 2024-01-09 cs.CY 89%

Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant

Brad Sheese, Mark Liffiton, Jaromir Savelka, Paul Denny

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2312.17449 2024-01-04 cs.DB 89%

DB-GPT: Empowering Database Interactions with Private Large Language Models

Siqiao Xue, Caigao Jiang, Wenhui Shi, Fangyin Cheng, Keting Chen, Hongjun Yang, Zhiping Zhang, Jianshan He, Hongyang Zhang, Ganglin Wei, Wang Zhao, Fan Zhou, Danrui Qi, Hong Yi, Shaodong Liu, Faqiang Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

1. 效率与部署 22405 篇

Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding

Large Language Model-Aided Evolutionary Search for Constrained Multiobjective Optimization

Towards Accurate and Efficient Document Analytics with Large Language Models

Efficient and Responsible Adaptation of Large Language Models for Robust Top-k Recommendations

Porting Large Language Models to Mobile Devices for Question Answering

Exact and Efficient Unlearning for Large Language Model-based Recommendation

An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project

LoRAP: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models

On Speculative Decoding for Multimodal Large Language Models

Enhancing Inference Efficiency of Large Language Models: Investigating Optimization Strategies and Architectural Innovations

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models

A Robust Semantics-based Watermark for Large Language Model against Paraphrasing

SPADE: Synthesizing Data Quality Assertions for Large Language Model Pipelines

Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft

Resource Allocation in Large Language Model Integrated 6G Vehicular Networks

Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models

Play to Your Strengths: Collaborative Intelligence of Conventional Recommender Models and Large Language Models

Leveraging Zero-Shot Prompting for Efficient Language Model Distillation

Large language models can help boost food production, but be mindful of their risks

User Association and Resource Allocation in Large Language Model Based Mobile Edge Computing System over 6G Wireless Communications

Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models

BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

Towards Development of Automated Knowledge Maps and Databases for Materials Engineering using Large Language Models

Model Compression and Efficient Inference for Large Language Models: A Survey

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding

Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant

DB-GPT: Empowering Database Interactions with Private Large Language Models