语言大模型 / LLM - arXivDaily 专题

2406.16635 2024-10-18 cs.LG cs.AI cs.CL 90%

ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

Yash Akhauri, Ahmed F AbouElhamayed, Jordan Dotzel, Zhiru Zhang, Alexander M Rush, Safeen Huda, Mohamed S Abdelfattah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024 (Main, Long Paper)

2410.12013 2024-10-17 cs.CL cs.AI cs.LG 90%

MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router

Yanyue Xie, Zhi Zhang, Ding Zhou, Cong Xie, Ziang Song, Xin Liu, Yanzhi Wang, Xue Lin, An Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2405.06001 2024-10-10 cs.LG cs.AI cs.CL 90%

LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit

Ruihao Gong, Yang Yong, Shiqiao Gu, Yushi Huang, Chengtao Lv, Yunchen Zhang, Xianglong Liu, Dacheng Tao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by EMNLP 2024 Industry Track

2409.04464 2024-09-19 cs.CL cs.AI cs.LG math.OC 90%

Leveraging Large Language Models for Solving Rare MIP Challenges

Teng Wang, Wing-Yin Yu, Ruifeng She, Wenhan Yang, Taijie Chen, Jianping Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2405.14366 2024-09-10 cs.CL cs.AI cs.LG 90%

MiniCache: KV Cache Compression in Depth Dimension for Large Language Models

Akide Liu, Jing Liu, Zizheng Pan, Yefei He, Gholamreza Haffari, Bohan Zhuang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project is available at https://minicache.vmv.re

2402.14846 2024-08-29 cs.CL cs.AI cs.LG 90%

Stick to your Role! Stability of Personal Values Expressed in Large Language Models

Grgur Kovač, Rémy Portelas, Masataka Sawayama, Peter Ford Dominey, Pierre-Yves Oudeyer

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The project website and code are available at https://sites.google.com/view/llmvaluestability Published in PLOS ONE ( https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0309114 ), and a shorter version at CogSci 24 ( https://escholarship.org/uc/item/7w4823c6 )

Journal ref PLOS ONE, August 2024

2403.13000 2024-08-09 cs.LG cs.AI cs.CL cs.CR 90%

Duwak: Dual Watermarks in Large Language Models

Chaoyi Zhu, Jeroen Galjaard, Pin-Yu Chen, Lydia Y. Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.07368 2024-07-26 cs.CL cs.AI cs.LG 90%

When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models

Haoran You, Yichao Fu, Zheng Wang, Amir Yazdanbakhsh, Yingyan Celine Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ICML 2024; 17 pages; 10 figures; 16 tables

2407.15351 2024-07-24 cs.LG cs.AI cs.CL 90%

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

Jiaxing Zhang, Jiayi Liu, Dongsheng Luo, Jennifer Neville, Hua Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Preprint Paper with 13 pages

2401.06692 2024-07-09 cs.CL cs.AI cs.LG 90%

An Experimental Design Framework for Label-Efficient Supervised Finetuning of Large Language Models

Gantavya Bhatt, Yifang Chen, Arnav M. Das, Jifan Zhang, Sang T. Truong, Stephen Mussmann, Yinglun Zhu, Jeffrey Bilmes, Simon S. Du, Kevin Jamieson, Jordan T. Ash, Robert D. Nowak

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to Findings of the Association for Computational Linguistics: ACL 2024

2407.03759 2024-07-08 cs.CL cs.AI cs.LG cs.NI 90%

Convolutional vs Large Language Models for Software Log Classification in Edge-Deployable Cellular Network Testing

Achintha Ihalage, Sayed M. Taheri, Faris Muhammad, Hamed Al-Raweshidy

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.07541 2024-07-01 cs.SE cs.DB 90%

Process Modeling With Large Language Models

Humam Kourani, Alessandro Berti, Daniel Schuster, Wil M. P. van der Aalst

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2403.05826 2024-06-03 cs.NI eess.SP 90%

Cached Model-as-a-Resource: Provisioning Large Language Model Agents for Edge Intelligence in Space-air-ground Integrated Networks

Minrui Xu, Dusit Niyato, Hongliang Zhang, Jiawen Kang, Zehui Xiong, Shiwen Mao, Zhu Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2401.13920 2024-05-24 cs.LG cs.AI cs.CL 90%

LocMoE: A Low-Overhead MoE for Large Language Model Training

Jing Li, Zhijie Sun, Xuan He, Li Zeng, Yi Lin, Entong Li, Binfan Zheng, Rongqian Zhao, Xin Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 1. Update the font size of all figures. 2. Update the name of the proposed layer Grouped Average Pooling (GrAP). 3. Change the order of the Section Contribution Statement

2405.08888 2024-05-16 cs.CL cs.AI cs.LG physics.acc-ph 90%

Large Language Models for Human-Machine Collaborative Particle Accelerator Tuning through Natural Language

Jan Kaiser, Annika Eichler, Anne Lauscher

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages, 5 figures

2307.06945 2024-05-10 cs.CL cs.AI cs.LG 90%

In-context Autoencoder for Context Compression in a Large Language Model

Tao Ge, Jing Hu, Lei Wang, Xun Wang, Si-Qing Chen, Furu Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments v4: Final camera ready for ICLR'24

2403.01384 2024-05-07 cs.LG cs.AI cs.CL 90%

On the Compressibility of Quantized Large Language Models

Yu Mao, Weilan Wang, Hongchao Du, Nan Guan, Chun Jason Xue

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2405.00449 2024-05-02 cs.LG cs.AI cs.CL cs.IR cs.NE 90%

RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models

Mohamed Manzour Hussien, Angie Nataly Melo, Augusto Luis Ballardini, Carlota Salinas Maldonado, Rubén Izquierdo, Miguel Ángel Sotelo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.18185 2024-04-30 cs.IR cs.AI cs.CL cs.LG 90%

Ranked List Truncation for Large Language Model-based Re-Ranking

Chuan Meng, Negar Arabzadeh, Arian Askari, Mohammad Aliannejadi, Maarten de Rijke

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for publication as a long paper at SIGIR 2024

2402.16880 2024-04-22 cs.LG cs.AI cs.CL 90%

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation

Peng Xu, Wenqi Shao, Mengzhao Chen, Shitao Tang, Kaipeng Zhang, Peng Gao, Fengwei An, Yu Qiao, Ping Luo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.11782 2024-04-19 cs.CL cs.AI cs.CY cs.LG 90%

REQUAL-LM: Reliability and Equity through Aggregation in Large Language Models

Sana Ebrahimi, Nima Shahbazi, Abolfazl Asudeh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.09529 2024-04-16 cs.LG cs.AI cs.CL 90%

Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models

Siyan Zhao, Daniel Israel, Guy Van den Broeck, Aditya Grover

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 18 pages, code in https://github.com/siyan-zhao/prepacking

2312.15159 2024-04-09 cs.LG cs.AI cs.AR cs.CL 90%

Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inference

Hongzheng Chen, Jiahao Zhang, Yixiao Du, Shaojie Xiang, Zichao Yue, Niansong Zhang, Yaohui Cai, Zhiru Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for publication in the FCCM'24 Journal Track and will appear in ACM Transactions on Reconfigurable Technology and Systems (TRETS)

2310.08041 2024-04-09 cs.CL cs.AI cs.LG 90%

QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models

Jing Liu, Ruihao Gong, Xiuying Wei, Zhiwei Dong, Jianfei Cai, Bohan Zhuang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2024 camera ready; Code is available at https://github.com/ziplab/QLLM and https://github.com/ModelTC/QLLM

2404.01014 2024-04-02 cs.CV 90%

Harnessing Large Language Models for Training-free Video Anomaly Detection

Luca Zanella, Willi Menapace, Massimiliano Mancini, Yiming Wang, Elisa Ricci

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments CVPR 2024. Project website at https://lucazanella.github.io/lavad/

2404.00914 2024-04-02 cs.CL cs.AI cs.LG 90%

Token-Efficient Leverage Learning in Large Language Models

Yuanhao Zeng, Min Wang, Yihang Wang, Yingxia Shao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 15 pages, 16 figures

2310.15929 2024-03-25 cs.LG cs.AI cs.CL 90%

E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity

Yun Li, Lin Niu, Xipeng Zhang, Kai Liu, Jianchen Zhu, Zhanhui Kang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2309.15943 2024-03-25 cs.RO 90%

Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?

Yongchao Chen, Jacob Arkin, Yang Zhang, Nicholas Roy, Chuchu Fan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 7 pages, 8 figures

Journal ref The 2024 International Conference on Robotics and Automation

2403.12900 2024-03-20 cs.DC cs.AI cs.CL cs.LG 90%

Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference

Baolin Li, Yankai Jiang, Vijay Gadepally, Devesh Tiwari

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.09743 2024-03-18 cs.CL cs.AI cs.LG 90%

The Human Factor in Detecting Errors of Large Language Models: A Systematic Literature Review and Future Research Directions

Christian A. Schiller

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 papers analysed and synthesized in detail from a total search result size of 594 (raw results) / 61 (scanned) / 28 (selected)

1. 效率与部署 22313 篇

ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router

LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit

Leveraging Large Language Models for Solving Rare MIP Challenges

MiniCache: KV Cache Compression in Depth Dimension for Large Language Models

Stick to your Role! Stability of Personal Values Expressed in Large Language Models

Duwak: Dual Watermarks in Large Language Models

When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

An Experimental Design Framework for Label-Efficient Supervised Finetuning of Large Language Models

Convolutional vs Large Language Models for Software Log Classification in Edge-Deployable Cellular Network Testing

Process Modeling With Large Language Models

Cached Model-as-a-Resource: Provisioning Large Language Model Agents for Edge Intelligence in Space-air-ground Integrated Networks

LocMoE: A Low-Overhead MoE for Large Language Model Training

Large Language Models for Human-Machine Collaborative Particle Accelerator Tuning through Natural Language

In-context Autoencoder for Context Compression in a Large Language Model

On the Compressibility of Quantized Large Language Models

RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models

Ranked List Truncation for Large Language Model-based Re-Ranking

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation

REQUAL-LM: Reliability and Equity through Aggregation in Large Language Models

Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models

Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inference

QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models

Harnessing Large Language Models for Training-free Video Anomaly Detection

Token-Efficient Leverage Learning in Large Language Models

E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity

Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?

Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference

The Human Factor in Detecting Errors of Large Language Models: A Systematic Literature Review and Future Research Directions