语言大模型 / LLM - arXivDaily 专题

2410.05062 2024-11-27 cs.IT eess.SP math.IT 89%

Large Language Model Based Multi-Objective Optimization for Integrated Sensing and Communications in UAV Networks

Haoyun Li, Ming Xiao, Kezhi Wang, Dong In Kim, Merouane Debbah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.15766 2024-11-26 cs.IR 89%

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

Suyuan Huang, Chao Zhang, Yuanyuan Wu, Haoxin Zhang, Yuan Wang, Maolin Wang, Shaosheng Cao, Tong Xu, Xiangyu Zhao, Zengchang Qin, Yan Gao, Yunhan Bai, Jun Fan, Yao Hu, Enhong Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.15715 2024-11-26 cs.CE 89%

Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems

Wenxiang Lin, Xinglin Pan, Shaohuai Shi, Xuan Wang, Xiaowen Chu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2407.02079 2024-11-25 cs.AR 89%

Theseus: Exploring Efficient Wafer-Scale Chip Design for Large Language Models

Jingchen Zhu, Chenhao Xue, Yiqi Chen, Zhao Wang, Chen Zhang, Yu Shen, Yifan Chen, Zekang Cheng, Yu Jiang, Tianqi Wang, Yibo Lin, Wei Hu, Bin Cui, Runsheng Wang, Yun Liang, Guangyu Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.13676 2024-11-22 cs.CL cs.AI cs.LG 89%

Hymba: A Hybrid-head Architecture for Small Language Models

Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin Byeon, Zijia Chen, Ameya Sunil Mahabaleshwarkar, Shih-Yang Liu, Matthijs Van Keirsbilck, Min-Hung Chen, Yoshi Suhara, Yingyan Lin, Jan Kautz, Pavlo Molchanov

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages, models are available on huggingface

2406.03488 2024-11-12 cs.DC 89%

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

Ao Sun, Weilin Zhao, Xu Han, Cheng Yang, Xinrong Zhang, Zhiyuan Liu, Chuan Shi, Maosong Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 12 pages, 4 figures, 6 tables

2411.05903 2024-11-12 cs.LG cs.AI cs.CL cs.CV cs.SD eess.AS 89%

Towards Multi-Modal Mastery: A 4.5B Parameter Truly Multi-Modal Small Language Model

Ben Koska, Mojmír Horváth

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2411.03881 2024-11-07 cs.IR 89%

Data Fusion of Synthetic Query Variants With Generative Large Language Models

Timo Breuer

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)

Comments The definitive version of record was published in SIGIR-AP '24

2411.03357 2024-11-07 cs.CR cs.DC 89%

PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

Yifan Tan, Cheng Tan, Zeyu Mi, Haibo Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments To appear in ASPLOS 2025

2404.14824 2024-11-07 cs.SE 89%

Automated Commit Message Generation with Large Language Models: An Empirical Study and Beyond

Pengyu Xue, Linhao Wu, Zhongxing Yu, Zhi Jin, Zhen Yang, Xinyi Li, Zhenyu Yang, Yue Tan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.02530 2024-11-06 cs.LG cs.AI cs.CL 89%

A Comprehensive Study on Quantization Techniques for Large Language Models

Jiedong Lang, Zhehao Guo, Shuyu Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2411.02063 2024-11-05 cs.CL cs.AI cs.LG 89%

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024 (Main Conference)

2410.22282 2024-11-05 cs.CY 89%

Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models

Renzhe Yu, Zhen Xu, Sky CH-Wang, Richard Arum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2405.09719 2024-11-05 cs.CL cs.AI cs.LG 89%

Spectral Editing of Activations for Large Language Model Alignment

Yifu Qiu, Zheng Zhao, Yftah Ziser, Anna Korhonen, Edoardo M. Ponti, Shay B. Cohen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 24 pages, NeurIPS 2024

2411.00473 2024-11-04 cs.NI physics.optics 89%

Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Yuchen Song, Yao Zhang, Anni Zhou, Yan Shi, Shikui Shen, Xiongyan Tang, Jin Li, Min Zhang, Danshi Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 7 pages,6 figures; Accepted by IEEE Communications Magazine, Open call

2402.15678 2024-10-31 cs.DC 89%

Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution

Siqi Wang, Hailong Yang, Xuezhu Wang, Tongxuan Liu, Pengbo Wang, Xuning Liang, Kejie Ma, Tianyu Feng, Xin You, Yongjun Bao, Yi Liu, Zhongzhi Luan, Depei Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2406.09041 2024-10-29 cs.CL cs.AI cs.LG 89%

ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

Jing Liu, Ruihao Gong, Mingyang Zhang, Yefei He, Jianfei Cai, Bohan Zhuang

专题命中效率与部署：large language model(title)；language model(title)；LLM(abstract)；foundation model(abstract)

Comments Tech report

2410.19160 2024-10-28 cs.LG cs.AI cs.CL cs.CR 89%

Adversarial Attacks on Large Language Models Using Regularized Relaxation

Samuel Jacob Chacko, Sajib Biswas, Chashi Mahiul Islam, Fatema Tabassum Liza, Xiuwen Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 6 figures

2410.17145 2024-10-23 cs.CL cs.AI cs.LG 89%

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?

Jirat Chiaranaipanich, Naiyarat Hanmatheekuna, Jitkapat Sawatphol, Krittamate Tiankanon, Jiramet Kinchagawat, Amrest Chinkamol, Parinthapat Pengpun, Piyalitt Ittichaiwong, Peerat Limkonchotiwat

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted in GenBench EMNLP 2024

2410.16804 2024-10-23 cs.RO 89%

Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robots

Haru Nakajima, Jun Miura

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)

Comments Accepted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2024)

2405.01943 2024-10-22 cs.CL cs.AI cs.LG 89%

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models

Zhiyu Guo, Hidetaka Kamigaito, Taro Wanatnabe

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2410.00131 2024-10-21 cs.LG cs.AI cs.CL cs.DC 89%

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models

Ji Liu, Jiaxiang Ren, Ruoming Jin, Zijie Zhang, Yang Zhou, Patrick Valduriez, Dejing Dou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 27 pages, 8 figures, 14 tables, to appear in EMNLP 2024

2410.12870 2024-10-18 cs.CL cs.AI cs.DB cs.ET cs.LG 89%

Skill Learning Using Process Mining for Large Language Model Plan Generation

Andrei Cosmin Redis, Mohammadreza Fani Sani, Bahram Zarrin, Andrea Burattin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 5 figures, 2 tables, accepted at ICPM 2024'

2410.02223 2024-10-18 cs.CL cs.AI cs.LG 89%

EmbedLLM: Learning Compact Representations of Large Language Models

Richard Zhuang, Tianhao Wu, Zhaojin Wen, Andrew Li, Jiantao Jiao, Kannan Ramchandran

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2407.02211 2024-10-17 cs.CL cs.AI cs.LG 89%

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning

Jiaru Zou, Mengyu Zhou, Tao Li, Shi Han, Dongmei Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments This paper has been accepted by EMNLP 2024

2410.09680 2024-10-15 eess.SY cs.SY 89%

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

Dong Chen, Yanbo Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 13 pages

2410.09241 2024-10-15 cs.SE 89%

Large Language Models for Energy-Efficient Code: Emerging Results and Future Directions

Huiyun Peng, Arjun Gupte, Nicholas John Eliopoulos, Chien Chou Ho, Rishi Mantri, Leo Deng, Wenxin Jiang, Yung-Hsiang Lu, Konstantin Läufer, George K. Thiruvathukal, James C. Davis

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2404.14408 2024-10-08 cs.CL cs.AI cs.LG 89%

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

Kevin Slagle

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9+10 pages, 3+1 figures, 2+4 tables

2409.17141 2024-09-26 cs.CL cs.AI cs.LG 89%

FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression

Fazal Mittu, Yihuan Bu, Akshat Gupta, Ashok Devireddy, Alp Eren Ozdarendeli, Anant Singh, Gopala Anumanchipalli

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.15534 2024-09-25 cs.LG cs.AI cs.CL q-bio.QM 89%

Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

Tianyu Liu, Yijia Xiao, Xiao Luo, Hua Xu, W. Jim Zheng, Hongyu Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages

Journal ref EMNLP 2024

1. 效率与部署 22405 篇

Large Language Model Based Multi-Objective Optimization for Integrated Sensing and Communications in UAV Networks

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems

Theseus: Exploring Efficient Wafer-Scale Chip Design for Large Language Models

Hymba: A Hybrid-head Architecture for Small Language Models

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

Towards Multi-Modal Mastery: A 4.5B Parameter Truly Multi-Modal Small Language Model

Data Fusion of Synthetic Query Variants With Generative Large Language Models

PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

Automated Commit Message Generation with Large Language Models: An Empirical Study and Beyond

A Comprehensive Study on Quantization Techniques for Large Language Models

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models

Spectral Editing of Activations for Large Language Model Alignment

Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution

ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

Adversarial Attacks on Large Language Models Using Regularized Relaxation

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?

Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robots

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models

Skill Learning Using Process Mining for Large Language Model Plan Generation

EmbedLLM: Learning Compact Representations of Large Language Models

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

Large Language Models for Energy-Efficient Code: Emerging Results and Future Directions

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression

Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research