语言大模型 / LLM - arXivDaily 专题

2404.06508 2024-07-18 cs.CL cs.LG 81%

On the Effect of (Near) Duplicate Subwords in Language Modelling

Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

2407.11121 2024-07-17 cs.CV cs.AI cs.LG 81%

Towards Adversarially Robust Vision-Language Models: Insights from Design Choices and Prompt Formatting Techniques

Rishika Bhagwatkar, Shravan Nayak, Reza Bayat, Alexis Roger, Daniel Z Kaplan, Pouya Bashivan, Irina Rish

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

2310.06684 2024-07-16 cs.CL cs.LG 81%

Learning Multiplex Representations on Text-Attributed Graphs with One Language Model Encoder

Bowen Jin, Wentao Zhang, Yu Zhang, Yu Meng, Han Zhao, Jiawei Han

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 11 appendix pages

2406.12230 2024-07-12 cs.CL cs.AI 81%

MCSD: An Efficient Language Model with Diverse Fusion

Hua Yang, Duohai Li, Shiman Li

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 8 pages, 9 figures

2407.02775 2024-07-04 cs.CL cs.LG 81%

MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models

Ying Zhang, Ziheng Yang, Shufan Ji

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

2406.15752 2024-06-25 eess.AS cs.AI cs.CL 81%

TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, Guanrou Yang, Xie Chen

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI

Comments INTERSPEECH 2024

2406.15518 2024-06-25 cs.CL cs.LG 81%

Steering Without Side Effects: Improving Post-Deployment Control of Language Models

Asa Cooper Stickland, Alexander Lyzhov, Jacob Pfau, Salsabila Mahdi, Samuel R. Bowman

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

2405.11117 2024-06-25 cs.CL cs.LG 81%

Dynamic Embeddings with Task-Oriented prompting

Allmin Balloccu, Jack Zhang

专题命中效率与部署：prompting(title,abstract)；分类 cs.CL、cs.LG

2406.06649 2024-06-12 eess.IV cs.AI cs.CV cs.LG 81%

2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution

Kai Liu, Haotong Qin, Yong Guo, Xin Yuan, Linghe Kong, Guihai Chen, Yulun Zhang

专题命中效率与部署：post-training(title,abstract)；分类 cs.AI、cs.LG

Comments 9 pages, 6 figures. The code and models will be available at https://github.com/Kai-Liu001/2DQuant

2405.19315 2024-06-10 cs.CV cs.CL cs.LG 81%

Matryoshka Query Transformer for Large Vision-Language Models

Wenbo Hu, Zi-Yi Dou, Liunian Harold Li, Amita Kamath, Nanyun Peng, Kai-Wei Chang

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Preprint. Our code and model are publicly available at https://github.com/gordonhu608/MQT-LLaVA

2403.18680 2024-06-07 cs.CL cs.LG 81%

Non-Linear Inference Time Intervention: Improving LLM Truthfulness

Jakub Hoscilowicz, Adam Wiacek, Jan Chojnacki, Adam Cieslak, Leszek Michon, Vitalii Urbanevych, Artur Janicki

专题命中效率与部署：LLM(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted on Interspeech 2024 Conference. Code is available at https://github.com/Samsung/NL-ITI

2406.03287 2024-06-06 cs.NE cs.CL cs.LG 81%

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

2406.02092 2024-06-05 cs.SD cs.AI cs.LG eess.AS eess.SP 81%

MaskSR: Masked Language Model for Full-band Speech Restoration

Xu Li, Qirui Wang, Xiaoyu Liu

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by INTERSPEECH 2024. Demo page: https://masksr.github.io/MaskSR/

2310.00809 2024-06-05 cs.LG cs.AI stat.ME stat.ML 81%

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

Jiaqi Zhang, Joel Jennings, Agrin Hilmkil, Nick Pawlowski, Cheng Zhang, Chao Ma

专题命中效率与部署：foundation model(title,abstract)；分类 cs.AI、cs.LG

2406.00060 2024-06-04 cs.CL cs.LG 81%

Cascade-Aware Training of Language Models

Congchao Wang, Sean Augenstein, Keith Rush, Wittawat Jitkrittum, Harikrishna Narasimhan, Ankit Singh Rawat, Aditya Krishna Menon, Alec Go

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 22 pages, 13 figures

2212.01032 2024-05-31 cs.CL cs.AI 81%

Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning

Shih-Cheng Huang, Shih-Heng Wang, Min-Han Shih, Saurav Sahay, Hung-yi Lee

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI

2405.16783 2024-05-28 cs.CR cs.AI cs.LG 81%

TrojFM: Resource-efficient Backdoor Attacks against Very Large Foundation Models

Yuzhou. Nie, Yanting. Wang, Jinyuan. Jia, Michael J. De Lucia, Nathaniel D. Bastian, Wenbo. Guo, Dawn. Song

专题命中效率与部署：foundation model(title,abstract)；分类 cs.AI、cs.LG

2405.11704 2024-05-21 cs.LG cs.AI 81%

Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks

Taiyuan Mei, Yun Zi, Xiaohan Cheng, Zijun Gao, Qi Wang, Haowei Yang

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

2405.07309 2024-05-14 cs.RO cs.AI cs.CV cs.LG 81%

DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Model

Yang Jin, Jun Lv, Shuqiang Jiang, Cewu Lu

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

2310.01558 2024-05-07 cs.CL cs.AI 81%

Making Retrieval-Augmented Language Models Robust to Irrelevant Context

Ori Yoran, Tomer Wolfson, Ori Ram, Jonathan Berant

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.AI

2312.04469 2024-05-03 cs.LG cs.CL cs.CR 81%

On the Learnability of Watermarks for Language Models

Chenchen Gu, Xiang Lisa Li, Percy Liang, Tatsunori Hashimoto

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at ICLR 2024

2405.00433 2024-05-02 cs.LG cs.AI cs.NE 81%

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Rishav Mukherji, Mark Schöne, Khaleelulla Khan Nazeer, Christian Mayr, David Kappel, Anand Subramoney

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2311.07625

2404.15182 2024-04-24 cs.LG cs.AI 81%

FLoRA: Enhancing Vision-Language Models with Parameter-Efficient Federated Learning

Duy Phuong Nguyen, J. Pablo Munoz, Ali Jannesari

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 11 figures

2404.14986 2024-04-24 cs.LG cs.AI 81%

$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning

Kerstin Kläser, Błażej Banaszewski, Samuel Maddrell-Mander, Callum McLean, Luis Müller, Ali Parviz, Shenyang Huang, Andrew Fitzgibbon

专题命中效率与部署：foundation model(title,abstract)；分类 cs.AI、cs.LG

2404.13265 2024-04-23 q-bio.GN cs.AI cs.LG 81%

F5C-finder: An Explainable and Ensemble Biological Language Model for Predicting 5-Formylcytidine Modifications on mRNA

Guohao Wang, Ting Liu, Hongqiang Lyu, Ze Liu

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 34 pages, 10 figures, journal

2404.11046 2024-04-18 cs.AI cs.CV cs.LG 81%

Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model

Hao Yan, Yuhong Guo

专题命中效率与部署：language model(title,abstract)；分类 cs.AI、cs.LG

2404.04759 2024-04-09 cs.CL cs.LG 81%

What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models

Busayo Awobade, Mardiyyah Oduwole, Steven Kolawole

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments AfricaNLP workshop at ICLR 2024

2404.02947 2024-04-05 cs.LG cs.AI 81%

DNN Memory Footprint Reduction via Post-Training Intra-Layer Multi-Precision Quantization

Behnam Ghavami, Amin Kamjoo, Lesley Shannon, Steve Wilton

专题命中效率与部署：post-training(title,abstract)；分类 cs.AI、cs.LG

Comments The 25th International Symposium on Quality Electronic Design (ISQED'24)

2203.11552 2024-04-05 cs.CL cs.LG 81%

Factual Consistency of Multilingual Pretrained Language Models

Constanza Fierro, Anders Søgaard

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Journal ref Findings of the Association for Computational Linguistics: ACL 2022, pages 3046-3052, Dublin, Ireland. Association for Computational Linguistics

2312.04193 2024-03-19 cs.CL cs.LG stat.ML 81%

Language Model Knowledge Distillation for Efficient Question Answering in Spanish

Adrián Bazaga, Pietro Liò, Gos Micklem

专题命中效率与部署：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2024 Tiny Paper (6 pages, 2 tables)

1. 效率与部署 22497 篇

On the Effect of (Near) Duplicate Subwords in Language Modelling

Towards Adversarially Robust Vision-Language Models: Insights from Design Choices and Prompt Formatting Techniques

Learning Multiplex Representations on Text-Attributed Graphs with One Language Model Encoder

MCSD: An Efficient Language Model with Diverse Fusion

MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models

TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

Steering Without Side Effects: Improving Post-Deployment Control of Language Models

Dynamic Embeddings with Task-Oriented prompting

2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution

Matryoshka Query Transformer for Large Vision-Language Models

Non-Linear Inference Time Intervention: Improving LLM Truthfulness

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

MaskSR: Masked Language Model for Full-band Speech Restoration

Towards Causal Foundation Model: on Duality between Causal Inference and Attention

Cascade-Aware Training of Language Models

Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning

TrojFM: Resource-efficient Backdoor Attacks against Very Large Foundation Models

Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks

DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Model

Making Retrieval-Augmented Language Models Robust to Irrelevant Context

On the Learnability of Watermarks for Language Models

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

FLoRA: Enhancing Vision-Language Models with Parameter-Efficient Federated Learning

$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning

F5C-finder: An Explainable and Ensemble Biological Language Model for Predicting 5-Formylcytidine Modifications on mRNA

Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model

What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models

DNN Memory Footprint Reduction via Post-Training Intra-Layer Multi-Precision Quantization

Factual Consistency of Multilingual Pretrained Language Models

Language Model Knowledge Distillation for Efficient Question Answering in Spanish