语言大模型 / LLM - arXivDaily 专题

2410.20011 2024-10-29 cs.CL 88%

A Survey of Small Language Models

Chien Van Nguyen, Xuan Shen, Ryan Aponte, Yu Xia, Samyadeep Basu, Zhengmian Hu, Jian Chen, Mihir Parmar, Sasidhar Kunapuli, Joe Barrow, Junda Wu, Ashish Singh, Yu Wang, Jiuxiang Gu, Franck Dernoncourt, Nesreen K. Ahmed, Nedim Lipka, Ruiyi Zhang, Xiang Chen, Tong Yu, Sungchul Kim, Hanieh Deilamsalehy, Namyong Park, Mike Rimer, Zhehao Zhang, Huanrui Yang, Ryan A. Rossi, Thien Huu Nguyen

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL

2410.19812 2024-10-29 cs.CY cs.CL 88%

Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models

Eddie L. Ungless, Nikolas Vitsakis, Zeerak Talat, James Garforth, Björn Ross, Arno Onken, Atoosa Kasirzadeh, Alexandra Birch

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 47 pages

2309.14763 2024-10-28 cs.CL 88%

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Chenyang Song, Xu Han, Zheni Zeng, Kuai Li, Chen Chen, Zhiyuan Liu, Maosong Sun, Tao Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 12 pages, 3 figures. This work has been submitted to the IEEE for possible publication

2402.11819 2024-10-25 cs.CL 88%

Head-wise Shareable Attention for Large Language Models

Zouying Cao, Yifei Yang, Hai Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 17 pages, 7 figures, 21 tables, EMNLP'24 Findings

2408.12025 2024-10-24 cs.AI 88%

Exploring Large Language Models for Feature Selection: A Data-centric Perspective

Dawei Li, Zhen Tan, Huan Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted by SIGKDD Explorations (December 2024)

2410.15657 2024-10-22 cs.CV cs.CL 88%

CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models

Jianjun Gao, Chen Cai, Ruoyu Wang, Wenyang Liu, Kim-Hui Yap, Kratika Garg, Boon-Siew Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2409.19700 2024-10-21 cs.CL 88%

2D-TPE: Two-Dimensional Positional Encoding Enhances Table Understanding for Large Language Models

Jia-Nan Li, Jian Guan, Wei Wu, Zhengtao Yu, Rui Yan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.12388 2024-10-18 cs.CL 88%

Prompt Compression for Large Language Models: A Survey

Zongqian Li, Yinhong Liu, Yixuan Su, Nigel Collier

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.12924 2024-10-18 cs.CL 88%

Supporting Energy Policy Research with Large Language Models

Grant Buster, Pavlo Pinchuk, Jacob Barrons, Ryan McKeever, Aaron Levine, Anthony Lopez

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.11654 2024-10-16 cs.CL 88%

Transformer Layer Injection: A Novel Approach for Efficient Upscaling of Large Language Models

James Vo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.07542 2024-10-15 cs.CL 88%

EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models

Yunsheng Ni, Chuanjian Liu, Yehui Tang, Kai Han, Yunhe Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.03853 2024-10-14 cs.CL 88%

ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

Xin Men, Mingyu Xu, Qingyu Zhang, Bingning Wang, Hongyu Lin, Yaojie Lu, Xianpei Han, Weipeng Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.04335 2024-10-08 cs.CL 88%

ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model

Shuhao Gu, Mengdi Zhao, Bowen Zhang, Liangdong Wang, Jijie Li, Guang Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2406.11149 2024-10-07 cs.CL cs.CR 88%

GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory

Wei Fan, Haoran Li, Zheye Deng, Weiqi Wang, Yangqiu Song

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2024

2410.02016 2024-10-04 cs.LG cs.CR 88%

Adaptively Private Next-Token Prediction of Large Language Models

James Flemings, Meisam Razaviyayn, Murali Annavaram

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2408.12168 2024-10-04 cs.CL 88%

FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation

KaShun Shum, Minrui Xu, Jianshu Zhang, Zixin Chen, Shizhe Diao, Hanze Dong, Jipeng Zhang, Muhammad Omer Raza

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments EMNLP 2024

2402.16050 2024-10-04 cs.CV cs.CL 88%

Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge

Yuxuan Wang, Yueqian Wang, Pengfei Wu, Jianxin Liang, Dongyan Zhao, Yang Liu, Zilong Zheng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments To appear at EMNLP 2024

2409.13385 2024-10-03 cs.CL cs.IR 88%

Contextual Compression in Retrieval-Augmented Generation for Large Language Models: A Survey

Sourav Verma

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Ongoing Work

2409.16911 2024-10-03 cs.CL 88%

Pruning Multilingual Large Language Models for Multilingual Inference

Hwichan Kim, Jun Suzuki, Tosho Hirasawa, Mamoru Komachi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024 Findings

2409.20364 2024-10-01 cs.AI cs.CV cs.RO 88%

Efficient Driving Behavior Narration and Reasoning on Edge Device Using Large Language Models

Yizhou Huang, Yihua Cheng, Kezhi Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Submitted for possible journal publication

2406.13919 2024-09-26 cs.AI 88%

SPL: A Socratic Playground for Learning Powered by Large Language Model

Liang Zhang, Jionghao Lin, Ziyi Kuang, Sheng Xu, Xiangen Hu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2402.09801 2024-09-24 cs.CL cs.CV 88%

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

Shangyu Xing, Fei Zhao, Zhen Wu, Tuo An, Weihao Chen, Chunhui Li, Jianbing Zhang, Xinyu Dai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2409.13262 2024-09-23 cs.CL cs.SD eess.AS 88%

Large Language Model Should Understand Pinyin for Chinese ASR Error Correction

Yuang Li, Xiaosong Qiao, Xiaofeng Zhao, Huan Zhao, Wei Tang, Min Zhang, Hao Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2409.11057 2024-09-18 cs.CL 88%

KVPruner: Structural Pruning for Faster and Memory-Efficient Large Language Models

Bo Lv, Quan Zhou, Xuanang Ding, Yan Wang, Zeming Ma

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2407.19816 2024-09-17 cs.CL 88%

Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies

Nikita Matkin, Aleksei Smirnov, Mikhail Usanin, Egor Ivanov, Kirill Sobyanin, Sofiia Paklina, Petr Parshakov

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.15491 2024-08-29 cs.CL 88%

Enhancing and Accelerating Large Language Models via Instruction-Aware Contextual Compression

Haowen Hou, Fei Ma, Binwen Bai, Xinxin Zhu, Fei Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 20 pages

2408.11587 2024-08-22 cs.CL cs.CR 88%

Large Language Models are Good Attackers: Efficient and Stealthy Textual Backdoor Attacks

Ziqiang Li, Yueqi Zeng, Pengfei Xia, Lei Liu, Zhangjie Fu, Bin Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Under Review

2408.09972 2024-08-20 cs.RO cs.AI 88%

Edge-Cloud Collaborative Motion Planning for Autonomous Driving with Large Language Models

Jiao Chen, Suyan Dai, Fangfang Chen, Zuohong Lv, Jianhua Tang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2408.04775 2024-08-12 cs.CL cs.IR 88%

Hybrid Student-Teacher Large Language Model Refinement for Cancer Toxicity Symptom Extraction

Reza Khanmohammadi, Ahmed I. Ghanem, Kyle Verdecchia, Ryan Hall, Mohamed Elshaikh, Benjamin Movsas, Hassan Bagher-Ebadian, Bing Luo, Indrin J. Chetty, Tuka Alhanai, Kundan Thind, Mohammad M. Ghassemi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2407.20970 2024-07-31 cs.NI cs.AI 88%

Large Language Models (LLMs) for Semantic Communication in Edge-based IoT Networks

Alakesh Kalita

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 6pages, 3 figures, Magazine

1. 效率与部署 22313 篇

A Survey of Small Language Models

Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Head-wise Shareable Attention for Large Language Models

Exploring Large Language Models for Feature Selection: A Data-centric Perspective

CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models

2D-TPE: Two-Dimensional Positional Encoding Enhances Table Understanding for Large Language Models

Prompt Compression for Large Language Models: A Survey

Supporting Energy Policy Research with Large Language Models

Transformer Layer Injection: A Novel Approach for Efficient Upscaling of Large Language Models

EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models

ShortGPT: Layers in Large Language Models are More Redundant Than You Expect

ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model

GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory

Adaptively Private Next-Token Prediction of Large Language Models

FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation

Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge

Contextual Compression in Retrieval-Augmented Generation for Large Language Models: A Survey

Pruning Multilingual Large Language Models for Multilingual Inference

Efficient Driving Behavior Narration and Reasoning on Edge Device Using Large Language Models

SPL: A Socratic Playground for Learning Powered by Large Language Model

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

Large Language Model Should Understand Pinyin for Chinese ASR Error Correction

KVPruner: Structural Pruning for Faster and Memory-Efficient Large Language Models

Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies

Enhancing and Accelerating Large Language Models via Instruction-Aware Contextual Compression

Large Language Models are Good Attackers: Efficient and Stealthy Textual Backdoor Attacks

Edge-Cloud Collaborative Motion Planning for Autonomous Driving with Large Language Models

Hybrid Student-Teacher Large Language Model Refinement for Cancer Toxicity Symptom Extraction

Large Language Models (LLMs) for Semantic Communication in Edge-based IoT Networks