语言大模型 / LLM - arXivDaily 专题

2401.17221 2024-01-31 cs.CV cs.AI cs.CL cs.LG 82%

MouSi: Poly-Visual-Expert Vision-Language Models

Xiaoran Fan, Tao Ji, Changhao Jiang, Shuo Li, Senjie Jin, Sirui Song, Junke Wang, Boyang Hong, Lu Chen, Guodong Zheng, Ming Zhang, Caishuang Huang, Rui Zheng, Zhiheng Xi, Yuhao Zhou, Shihan Dou, Junjie Ye, Hang Yan, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2310.02998 2024-01-29 cs.CV cs.AI cs.CL cs.LG 82%

ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models

Yi-Lin Sung, Jaehong Yoon, Mohit Bansal

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2024 (project page: https://ecoflap.github.io/)

2401.11240 2024-01-23 cs.DC 82%

CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference

Suyi Li, Hanfeng Lu, Tianyuan Wu, Minchen Yu, Qizhen Weng, Xusheng Chen, Yizhou Shan, Binhang Yuan, Wei Wang

专题命中效率与部署：LLM(title)；large language model(abstract)；language model(abstract)

2312.17342 2024-01-01 cs.CR cs.AI cs.CL cs.LG 82%

SentinelLMs: Encrypted Input Adaptation and Fine-tuning of Language Models for Private and Secure Inference

Abhijit Mishra, Mingda Li, Soham Deo

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted and to appear in AAAI 2024

2301.10405 2023-12-29 cs.CL cs.AI cs.DB cs.IR cs.LG 82%

Editing Language Model-based Knowledge Graph Embeddings

Siyuan Cheng, Ningyu Zhang, Bozhong Tian, Xi Chen, Qingbing Liu, Huajun Chen

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AAAI 2024. The project website is https://zjunlp.github.io/project/KGE_Editing/

2310.17796 2023-12-19 cs.CV cs.MM 82%

ControlLLM: Augment Language Models with Tools by Searching on Graphs

Zhaoyang Liu, Zeqiang Lai, Zhangwei Gao, Erfei Cui, Ziheng Li, Xizhou Zhu, Lewei Lu, Qifeng Chen, Yu Qiao, Jifeng Dai, Wenhai Wang

专题命中效率与部署：language model(title,abstract)；large language model(abstract)

Comments 24 pages, 9 figures, 12 tables

2311.10770 2023-11-22 cs.CL cs.AI cs.LG cs.NE 82%

Exponentially Faster Language Modelling

Peter Belcak, Roger Wattenhofer

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2307.06440 2023-11-15 cs.LG cs.AI cs.CL cs.NE cs.PF 82%

No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models

Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2023

2305.06677 2023-10-23 cs.CL cs.AI cs.LG 82%

INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models

H S V N S Kowndinya Renduchintala, Krishnateja Killamsetty, Sumit Bhatia, Milan Aggarwal, Ganesh Ramakrishnan, Rishabh Iyer, Balaji Krishnamurthy

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2310.12818 2023-10-20 cs.CL cs.AI cs.LG 82%

Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models

Weize Chen, Xiaoyue Xu, Xu Han, Yankai Lin, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2023 Findings

2307.03135 2023-10-13 cs.CV cs.AI cs.CL cs.LG 82%

Distilling Large Vision-Language Model with Out-of-Distribution Generalizability

Xuanlin Li, Yunhao Fang, Minghua Liu, Zhan Ling, Zhuowen Tu, Hao Su

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at International Conference on Computer Vision (ICCV) 2023. Poster at https://xuanlinli17.github.io/pdfs/iccv23_large_vlm_distillation_poster.pdf

2309.14494 2023-09-27 cs.CV 82%

Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator

Hanzhuo Huang, Yufan Feng, Cheng Shi, Lan Xu, Jingyi Yu, Sibei Yang

专题命中效率与部署：LLM(title)；large language model(abstract)；language model(abstract)

Comments NeurIPS 2023; Project available at: https://github.com/SooLab/Free-Bloom

2204.04392 2023-09-20 cs.CL cs.AI cs.IR cs.LG 82%

Contrastive Demonstration Tuning for Pre-trained Language Models

Xiaozhuan Liang, Ningyu Zhang, Siyuan Cheng, Zhenru Zhang, Chuanqi Tan, Huajun Chen

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2022(Findings)

2308.03235 2023-08-08 cs.CL cs.AI cs.LG 82%

Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining

Nour Eddine Zekaoui, Siham Yousfi, Maryem Rhanoui, Mounia Mikram

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Journal ref IAES Int. J. Artif. Intell. (IJ-AI) 12(4), 1995-2010 (Dec. 2023)

2308.01223 2023-08-03 cs.CL cs.AI cs.LG 82%

Do Multilingual Language Models Think Better in English?

Julen Etxaniz, Gorka Azkune, Aitor Soroa, Oier Lopez de Lacalle, Mikel Artetxe

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2306.16601 2023-06-30 cs.LG cs.AI cs.CL 82%

An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs

Haihao Shen, Hengyu Meng, Bo Dong, Zhe Wang, Ofir Zafrir, Yi Ding, Yu Luo, Hanwen Chang, Qun Gao, Ziheng Wang, Guy Boudoukh, Moshe Wasserblat

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2305.18993 2023-05-31 cs.CV 82%

ConES: Concept Embedding Search for Parameter Efficient Tuning Large Vision Language Models

Huahui Yi, Ziyuan Qin, Wei Xu, Miaotian Guo, Kun Wang, Shaoting Zhang, Kang Li, Qicheng Lao

专题命中效率与部署：language model(title,abstract)；prompting(abstract)

2305.16597 2023-05-29 cs.CL cs.AI cs.LG 82%

Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models

Neal Lawton, Anoop Kumar, Govind Thattai, Aram Galstyan, Greg Ver Steeg

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 3 figures, ACL 2023

2305.11170 2023-05-19 cs.CL cs.AI cs.LG 82%

Efficient Prompting via Dynamic In-Context Learning

Wangchunshu Zhou, Yuchen Eleanor Jiang, Ryan Cotterell, Mrinmaya Sachan

专题命中效率与部署：prompting(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2304.02263 2023-05-09 cs.CV 82%

Towards Efficient Task-Driven Model Reprogramming with Foundation Models

Shoukai Xu, Jiangchao Yao, Ran Luo, Shuhai Zhang, Zihao Lian, Mingkui Tan, Bo Han, Yaowei Wang

专题命中效率与部署：foundation model(title,abstract)；pretraining(abstract)

2303.08138 2023-03-15 cs.CV 82%

Diversity-Aware Meta Visual Prompting

Qidong Huang, Xiaoyi Dong, Dongdong Chen, Weiming Zhang, Feifei Wang, Gang Hua, Nenghai Yu

专题命中效率与部署：prompting(title,abstract)；pretraining(abstract)

Comments CVPR2023, code is available at https://github.com/shikiw/DAM-VP

2302.07740 2023-02-16 cs.CL cs.AI cs.CV cs.LG 82%

Team Triple-Check at Factify 2: Parameter-Efficient Large Foundation Models with Feature Representations for Multi-Modal Fact Verification

Wei-Wei Du, Hong-Wei Wu, Wei-Yao Wang, Wen-Chih Peng

专题命中效率与部署：foundation model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AAAI-23 DeFactify 2 Workshop (1st Prize)

2302.01530 2023-02-06 cs.CL cs.AI cs.LG 82%

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective

Jongwoo Ko, Seungjoon Park, Minchan Jeong, Sukjin Hong, Euijai Ahn, Du-Seong Chang, Se-Young Yun

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The 17th Conference of the European Chapter of the Association for Computational Linguistics (Findings)

2301.12314 2023-01-31 cs.CL cs.AI cs.LG 82%

Progressive Prompts: Continual Learning for Language Models

Anastasia Razdaibiedina, Yuning Mao, Rui Hou, Madian Khabsa, Mike Lewis, Amjad Almahairi

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2212.11937 2022-12-23 cs.CL cs.AI cs.LG 82%

Efficient Induction of Language Models Via Probabilistic Concept Formation

Christopher J. MacLellan, Peter Matsakis, Pat Langley

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 18 pages, 5 figures, Presented at Advances in Cognitive Systems 2022

2202.07105 2022-11-30 cs.CL cs.AI cs.LG 82%

A Survey on Model Compression and Acceleration for Pretrained Language Models

Canwen Xu, Julian McAuley

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to AAAI 2023

2211.00384 2022-11-04 cs.CL cs.AI cs.LG cs.SI 82%

The future is different: Large pre-trained language models fail in prediction tasks

Kostadin Cvejoski, Ramsés J. Sánchez, César Ojeda

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2110.05354 2022-11-01 cs.CL cs.AI cs.LG cs.SD eess.AS 82%

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 5 pages, in Interspeech 2022

Journal ref Interspeech 2022, Incheon, Korea

2112.10684 2022-10-27 cs.CL cs.AI cs.LG 82%

Efficient Large Scale Language Modeling with Mixtures of Experts

Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona Diab, Zornitsa Kozareva, Ves Stoyanov

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2022

2203.01104 2022-10-14 cs.CL cs.AI cs.LG quant-ph 82%

Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models

Ze-Feng Gao, Peiyu Liu, Wayne Xin Zhao, Zhong-Yi Lu, Ji-Rong Wen

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages, 2 figures, 2 tables

Journal ref COLING2022 Oral Presentation

1. 效率与部署 22497 篇

MouSi: Poly-Visual-Expert Vision-Language Models

ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models

CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference

SentinelLMs: Encrypted Input Adaptation and Fine-tuning of Language Models for Private and Secure Inference

Editing Language Model-based Knowledge Graph Embeddings

ControlLLM: Augment Language Models with Tools by Searching on Graphs

Exponentially Faster Language Modelling

No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models

INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models

Boosting Inference Efficiency: Unleashing the Power of Parameter-Shared Pre-trained Language Models

Distilling Large Vision-Language Model with Out-of-Distribution Generalizability

Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator

Contrastive Demonstration Tuning for Pre-trained Language Models

Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining

Do Multilingual Language Models Think Better in English?

An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs

ConES: Concept Embedding Search for Parameter Efficient Tuning Large Vision Language Models

Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models

Efficient Prompting via Dynamic In-Context Learning

Towards Efficient Task-Driven Model Reprogramming with Foundation Models

Diversity-Aware Meta Visual Prompting

Team Triple-Check at Factify 2: Parameter-Efficient Large Foundation Models with Feature Representations for Multi-Modal Fact Verification

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective

Progressive Prompts: Continual Learning for Language Models

Efficient Induction of Language Models Via Probabilistic Concept Formation

A Survey on Model Compression and Acceleration for Pretrained Language Models

The future is different: Large pre-trained language models fail in prediction tasks

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Efficient Large Scale Language Modeling with Mixtures of Experts

Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models