语言大模型 / LLM - arXivDaily 专题

2302.07027 2023-03-29 cs.CL 79%

AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models

Alexandra Chronopoulou, Matthew E. Peters, Alexander Fraser, Jesse Dodge

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted at EACL 2023; camera-ready version; fixed typo in related work

2303.15234 2023-03-28 cs.CV cs.AI 79%

Prompt Tuning based Adapter for Vision-Language Model Adaption

Jingchen Sun, Jiayu Qin, Zihao Lin, Changyou Chen

专题命中指令微调：language model(title,abstract)；分类 cs.AI

2302.09302 2023-02-21 cs.CL 79%

Bridge the Gap between Language models and Tabular Understanding

Nuo Chen, Linjun Shou, Ming Gong, Jian Pei, Chenyu You, Jianhui Chang, Daxin Jiang, Jia Li

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 7 pages

2011.09031 2023-02-17 cs.CL 79%

Predictions For Pre-training Language Models

Tong Guo

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 9 pages

2210.06442 2023-02-14 cs.CL 79%

Can Pretrained Language Models (Yet) Reason Deductively?

Zhangdie Yuan, Songbo Hu, Ivan Vulić, Anna Korhonen, Zaiqiao Meng

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments EACL 2023 camera-ready version

2209.09815 2023-02-14 cs.LG 79%

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation

Mohammadreza Tayaranian, Alireza Ghaffari, Marzieh S. Tahaei, Mehdi Rezagholizadeh, Masoud Asgharian, Vahid Partovi Nia

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Accepted in EACL2023

2302.01649 2023-02-10 cs.LG 79%

Structure-informed Language Models Are Protein Designers

Zaixiang Zheng, Yifan Deng, Dongyu Xue, Yi Zhou, Fei YE, Quanquan Gu

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments 10 pages; ver.2 update: added image credit to RFdiffusion (Watson et al., 2022) in Fig. 1F, and fixed some small presentation errors

2302.03183 2023-02-08 cs.CL 79%

Capturing Topic Framing via Masked Language Modeling

Xiaobo Guo, Weicheng Ma, Soroush Vosoughi

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments In Findings of EMNLP 2022

Journal ref In Findings of the Association for Computational Linguistics: EMNLP 2022 (pp. 6811-6825) (2022, December)

2111.09064 2023-01-10 cs.CL 79%

Guiding Generative Language Models for Data Augmentation in Few-Shot Text Classification

Aleksandra Edwards, Asahi Ushio, Jose Camacho-Collados, Hélène de Ribaupierre, Alun Preece

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Paper has been accepted and presented at DASH workshop, EMNLP 2022 conference

2212.06369 2022-12-21 cs.CL 79%

Technical Report -- Competition Solution for Prompt Tuning using Pretrained Language Model

Jiang-Long Song, Wu-He Zou, Feng Li, Xiao-Lei Qin, Wei-Dong Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2211.10986 2022-11-22 cs.CL 79%

UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning

Zengzhi Wang, Rui Xia, Jianfei Yu

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

2211.10086 2022-11-21 cs.CL cs.DL 79%

Metadata Might Make Language Models Better

Kaspar Beelen, Daniel van Strien

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2211.00479 2022-11-02 cs.CL 79%

Revisiting the Practical Effectiveness of Constituency Parse Extraction from Pre-trained Language Models

Taeuk Kim

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments COLING 2022

2210.10325 2022-10-20 cs.CL 79%

Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping

Chenghao Yang, Xuezhe Ma

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 Camera Ready

2210.09658 2022-10-19 cs.CL 79%

ROSE: Robust Selective Fine-tuning for Pre-trained Language Models

Lan Jiang, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Rui Jiang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2022. Code is available at https://github.com/jiangllan/ROSE

2210.03329 2022-10-19 cs.CL 79%

Calibrating Factual Knowledge in Pretrained Language Models

Qingxiu Dong, Damai Dai, Yifan Song, Jingjing Xu, Zhifang Sui, Lei Li

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by Findings of EMNLP 2022

2204.06487 2022-10-19 cs.CL 79%

Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning

Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, Dietrich Klakow

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2022

2112.01047 2022-10-18 cs.CL 79%

DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding

Taolin Zhang, Chengyu Wang, Nan Hu, Minghui Qiu, Chengguang Tang, Xiaofeng He, Jun Huang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by AAAI22

2210.06474 2022-10-14 cs.HC cs.AI cs.CV 79%

VR-SFT: Reproducing Swinging Flashlight Test in Virtual Reality to Detect Relative Afferent Pupillary Defect

Prithul Sarker, Nasif Zaman, Alireza Tavakkoli

专题命中指令微调：SFT(title,abstract)；分类 cs.AI

Comments International Symposium on Visual Computing

2210.05883 2022-10-13 cs.CL 79%

AD-DROP: Attribution-Driven Dropout for Robust Language Model Fine-Tuning

Tao Yang, Jinghao Deng, Xiaojun Quan, Qifan Wang, Shaoliang Nie

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to NeurIPS 2022

2210.00907 2022-10-04 cs.CL 79%

The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection

Sondre Wold

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Camera ready version for the 16th TextGraphs workshop, located at Coling 2022

2209.14161 2022-09-29 cs.CL 79%

Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models

Youness Moukafih, Mounir Ghogho, Kamel Smaili

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2110.15705 2022-09-12 cs.CL 79%

Distilling Relation Embeddings from Pre-trained Language Models

Asahi Ushio, Jose Camacho-Collados, Steven Schockaert

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2021 main conference

2208.08176 2022-08-18 cs.AI 79%

Visual Comparison of Language Model Adaptation

Rita Sevastjanova, Eren Cakmak, Shauli Ravfogel, Ryan Cotterell, Mennatallah El-Assady

专题命中指令微调：language model(title,abstract)；分类 cs.AI

2208.02959 2022-08-08 cs.CL 79%

Towards No.1 in CLUE Semantic Matching Challenge: Pre-trained Language Model Erlangshen with Propensity-Corrected Loss

Junjie Wang, Yuxiang Zhang, Ping Yang, Ruyi Gan

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2204.10555 2022-08-05 cs.CL 79%

KALA: Knowledge-Augmented Language Model Adaptation

Minki Kang, Jinheon Baek, Sung Ju Hwang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments NAACL 2022

2208.00635 2022-08-02 cs.CL 79%

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

Qianglong Chen, Feng-Lin Li, Guohai Xu, Ming Yan, Ji Zhang, Yin Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by IJCAI 2022

2207.01893 2022-07-06 cs.CL 79%

ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks

Valentin Pelloin, Franck Dary, Nicolas Herve, Benoit Favre, Nathalie Camelin, Antoine Laurent, Laurent Besacier

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Interspeech 2022 (Camera Ready)

2107.12930 2022-06-29 cs.CL 79%

gaBERT -- an Irish Language Model

James Barry, Joachim Wagner, Lauren Cassidy, Alan Cowap, Teresa Lynn, Abigail Walsh, Mícheál J. Ó Meachair, Jennifer Foster

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 4774-4788, Marseille, France, 20-25 June 2022, European Language Resources Association (ELRA)

2012.15643 2022-05-27 cs.CL 79%

CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations

Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng

专题命中指令微调：language model(title,abstract)；分类 cs.CL

1. 指令微调 11667 篇

AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models

Prompt Tuning based Adapter for Vision-Language Model Adaption

Bridge the Gap between Language models and Tabular Understanding

Predictions For Pre-training Language Models

Can Pretrained Language Models (Yet) Reason Deductively?

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation

Structure-informed Language Models Are Protein Designers

Capturing Topic Framing via Masked Language Modeling

Guiding Generative Language Models for Data Augmentation in Few-Shot Text Classification

Technical Report -- Competition Solution for Prompt Tuning using Pretrained Language Model

UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning

Metadata Might Make Language Models Better

Revisiting the Practical Effectiveness of Constituency Parse Extraction from Pre-trained Language Models

Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping

ROSE: Robust Selective Fine-tuning for Pre-trained Language Models

Calibrating Factual Knowledge in Pretrained Language Models

Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning

DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding

VR-SFT: Reproducing Swinging Flashlight Test in Virtual Reality to Detect Relative Afferent Pupillary Defect

AD-DROP: Attribution-Driven Dropout for Robust Language Model Fine-Tuning

The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection

Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models

Distilling Relation Embeddings from Pre-trained Language Models

Visual Comparison of Language Model Adaptation

Towards No.1 in CLUE Semantic Matching Challenge: Pre-trained Language Model Erlangshen with Propensity-Corrected Loss

KALA: Knowledge-Augmented Language Model Adaptation

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks

gaBERT -- an Irish Language Model

CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations