语言大模型 / LLM - arXivDaily 专题

2306.04746 2024-01-17 stat.ME cs.CL cs.LG stat.ML 88%

Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Models

Naoki Egami, Musashi Hinck, Brandon M. Stewart, Hanying Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

2308.02053 2024-01-10 cs.CL cs.AI cs.CY 88%

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Abel Salinas, Parth Vipul Shah, Yuzhong Huang, Robert McCormack, Fred Morstatter

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to EAAMO 2023

2312.17295 2024-01-01 cs.CR cs.AI cs.CL 88%

Optimizing watermarks for large language models

Bram Wouters

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages; preprint

2312.16211 2023-12-29 cs.AI cs.HC cs.LG 88%

An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Development

Yanming Zhang, Brette Fitzgibbon, Dino Garofolo, Akshith Kota, Eric Papenhausen, Klaus Mueller

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2312.12682 2023-12-21 cs.CL cs.AI 88%

Mini-GPTs: Efficient Large Language Models through Contextual Pruning

Tim Valicenti, Justice Vidal, Ritik Patnaik

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 4 figures, Neurips 2023 styling

2311.04879 2023-11-10 cs.CL cs.AI 88%

LongQLoRA: Efficient and Effective Method to Extend Context Length of Large Language Models

Jianxin Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2311.02956 2023-11-07 cs.CL cs.AI 88%

In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models

Yunlong Chen, Yaming Zhang, Jianfei Yu, Li Yang, Rui Xia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Runner up of the CCKS 2023 question answering with knowledge graph inference for unmanned systems evaluation task, accepted as an evaluation paper

2310.20105 2023-11-01 cs.CY cs.AI cs.CL 88%

Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models

Jaromir Savelka, Paul Denny, Mark Liffiton, Brad Sheese

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2310.19624 2023-10-31 cs.LG cs.AI q-bio.QM 88%

Exploring Post-Training Quantization of Protein Language Models

Shuang Peng, Fei Yang, Ning Sun, Sheng Chen, Yanfeng Jiang, Aimin Pan

专题命中效率与部署：language model(title,abstract)；post-training(title,abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 4 figures

2310.06003 2023-10-31 cs.LG cs.AI 88%

Rethinking Memory and Communication Cost for Efficient Large Language Model Training

Chan Wu, Hanxiao Zhang, Lin Ju, Jinjing Huang, Youshao Xiao, Zhaoxin Huan, Siyuan Li, Fanzhuang Meng, Lei Liang, Xiaolu Zhang, Jun Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2310.06927 2023-10-16 cs.CL cs.AI 88%

Sparse Fine-tuning for Inference Acceleration of Large Language Models

Eldar Kurtic, Denis Kuznedelev, Elias Frantar, Michael Goin, Dan Alistarh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2310.03951 2023-10-11 cs.CL cs.AI 88%

Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations

Deren Lei, Yaxi Li, Mengya Hu, Mingyu Wang, Vincent Yun, Emily Ching, Eslam Kamal

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments The source code is available at https://github.com/microsoft/CoNLI_hallucination

2309.09507 2023-10-11 cs.AI cs.CL 88%

Pruning Large Language Models via Accuracy Predictor

Yupeng Ji, Yibo Cao, Jiucai Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 4 figs, submitted to IEEE ICASSP 2024

2309.17224 2023-10-02 cs.LG cs.AR cs.CL cs.ET cs.PF 88%

Training and inference of large language models using 8-bit floating point

Sergio P. Perez, Yan Zhang, James Briggs, Charlie Blake, Josh Levy-Kramer, Paul Balanca, Carlo Luschi, Stephen Barlow, Andrew William Fitzgibbon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2309.06589 2023-09-14 cs.CL cs.AI 88%

Do Generative Large Language Models need billions of parameters?

Sia Gholami, Marwan Omar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2308.04014 2023-09-08 cs.CL cs.LG 88%

Continual Pre-Training of Large Language Models: How to (re)warm your model?

Kshitij Gupta, Benjamin Thérien, Adam Ibrahim, Mats L. Richter, Quentin Anthony, Eugene Belilovsky, Irina Rish, Timothée Lesort

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2307.08621 2023-08-10 cs.CL cs.LG 88%

Retentive Network: A Successor to Transformer for Large Language Models

Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2307.06439 2023-07-14 cs.CL cs.AI 88%

Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events

Yu Gu, Sheng Zhang, Naoto Usuyama, Yonas Woldesenbet, Cliff Wong, Praneeth Sanapathi, Mu Wei, Naveen Valluri, Erika Strandberg, Tristan Naumann, Hoifung Poon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2305.18404 2023-07-11 cs.CL cs.LG stat.ML 88%

Conformal Prediction with Large Language Models for Multi-Choice Question Answering

Bhawesh Kumar, Charlie Lu, Gauri Gupta, Anil Palepu, David Bellamy, Ramesh Raskar, Andrew Beam

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Updated sections on prompt engineering. Expanded sections 4.1 and 4.2 and appendix. Included additional references. Work published at the ICML 2023 (Neural Conversational AI TEACH) workshop

2307.03027 2023-07-07 cs.LG cs.CL cs.IR 88%

Improving Retrieval-Augmented Large Language Models via Data Importance Learning

Xiaozhong Lyu, Stefan Grafberger, Samantha Biegel, Shaopeng Wei, Meng Cao, Sebastian Schelter, Ce Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2306.04050 2023-06-28 cs.IT cs.CL cs.LG math.IT 88%

LLMZip: Lossless Text Compression using Large Language Models

Chandra Shekhara Kaushik Valmeekam, Krishna Narayanan, Dileep Kalathil, Jean-Francois Chamberland, Srinivas Shakkottai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 4 figures, 4 tables, preprint, added results on using LLMs with arithmetic coding

2301.04761 2023-06-07 cs.CL cs.LG 88%

NarrowBERT: Accelerating Masked Language Model Pretraining and Inference

Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, Noah A. Smith

专题命中效率与部署：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments To appear in ACL 2023 (main conference)

2212.05339 2023-06-01 cs.DC cs.AI cs.LG 88%

Elixir: Train a Large Language Model on a Small GPU Cluster

Haichen Huang, Jiarui Fang, Hongxin Liu, Shenggui Li, Yang You

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2305.13917 2023-05-24 cs.CL cs.AI 88%

Generating Data for Symbolic Language with Large Language Models

Jiacheng Ye, Chengzu Li, Lingpeng Kong, Tao Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2304.05524 2023-04-13 cs.LG cs.CL 88%

Understanding Causality with Large Language Models: Feasibility and Opportunities

Cheng Zhang, Stefan Bauer, Paul Bennett, Jiangfeng Gao, Wenbo Gong, Agrin Hilmkil, Joel Jennings, Chao Ma, Tom Minka, Nick Pawlowski, James Vaughan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2303.04381 2023-03-09 cs.LG cs.CL 88%

Automatically Auditing Large Language Models via Discrete Optimization

Erik Jones, Anca Dragan, Aditi Raghunathan, Jacob Steinhardt

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2107.02027 2022-10-07 cs.CL cs.CC cs.IT cs.LG math.IT 88%

Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance

Mario Michael Krell, Matej Kosec, Sergio P. Perez, Andrew Fitzgibbon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Significantly new version with different authors and much more content. Much larger variety in experiments and exhaustive SOTA analysis

2208.07852 2022-08-17 cs.CL cs.HC cs.LG 88%

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models

Hendrik Strobelt, Albert Webson, Victor Sanh, Benjamin Hoover, Johanna Beyer, Hanspeter Pfister, Alexander M. Rush

专题命中效率与部署：language model(title,abstract)；large language model(title)；prompting(abstract)；分类 cs.CL、cs.LG

Comments 9 pages content, 2 pages references

1910.04732 2021-03-30 cs.CL cs.LG stat.ML 88%

Structured Pruning of Large Language Models

Ziheng Wang, Jeremy Wohlwend, Tao Lei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2607.19768 2026-07-23 cs.LG cs.AR 新提交 88%

AlphaRoute: Large Language Models as Semantic Optimizers for Multi-Objective Routing

AlphaRoute：将大语言模型用作多目标路由的语义优化器

Kabir Murjani, Mishri Bhavsar, Manish I. Patel, Jonti Talukdar

机构 * Institute of Technology, Nirma University（尼玛大学理工学院）； Arizona State University（亚利桑那州立大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG；LLM(comments)

AI总结针对VLSI全局路由这一NP难组合优化问题，传统方法失效。AlphaRoute将拆线重布重构为动态优化系统，引入基于SHAP的溢出分解等技术，用大语言模型作语义策略优化器，在基准测试中大幅减少溢出，证明优越算法可克服Python实现的延迟。

Comments 7 pages, 5 figures. Accepted for publication in the IEEE International Conference on LLM-Aided Design, 2026, Stanford University, Stanford, CA, USA. Code available at https://github.com/Kcbir/AlphaRoute

1. 效率与部署 22368 篇

Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Models

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Optimizing watermarks for large language models

An Explainable AI Approach to Large Language Model Assisted Causal Model Auditing and Development

Mini-GPTs: Efficient Large Language Models through Contextual Pruning

LongQLoRA: Efficient and Effective Method to Extend Context Length of Large Language Models

In-Context Learning for Knowledge Base Question Answering for Unmanned Systems based on Large Language Models

Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models

Exploring Post-Training Quantization of Protein Language Models

Rethinking Memory and Communication Cost for Efficient Large Language Model Training

Sparse Fine-tuning for Inference Acceleration of Large Language Models

Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations

Pruning Large Language Models via Accuracy Predictor

Training and inference of large language models using 8-bit floating point

Do Generative Large Language Models need billions of parameters?

Continual Pre-Training of Large Language Models: How to (re)warm your model?

Retentive Network: A Successor to Transformer for Large Language Models

Distilling Large Language Models for Biomedical Knowledge Extraction: A Case Study on Adverse Drug Events

Conformal Prediction with Large Language Models for Multi-Choice Question Answering

Improving Retrieval-Augmented Large Language Models via Data Importance Learning

LLMZip: Lossless Text Compression using Large Language Models

NarrowBERT: Accelerating Masked Language Model Pretraining and Inference

Elixir: Train a Large Language Model on a Small GPU Cluster

Generating Data for Symbolic Language with Large Language Models

Understanding Causality with Large Language Models: Feasibility and Opportunities

Automatically Auditing Large Language Models via Discrete Optimization

Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models

Structured Pruning of Large Language Models

AlphaRoute: Large Language Models as Semantic Optimizers for Multi-Objective Routing