语言大模型 / LLM

Mix and Match: Learning-free Controllable Text Generation using Energy Language Models

Fatemehsadat Mireshghallah, Kartik Goyal, Taylor Berg-Kirkpatrick

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Camera ready--ACL 2022 (minor edits)

Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning

Ziyun Xu, Chengyu Wang, Minghui Qiu, Fuli Luo, Runxin Xu, Songfang Huang, Jun Huang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Fine-Tuning Pretrained Language Models With Label Attention for Biomedical Text Classification

Bruce Nguyen, Shaoxiong Ji

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

LaMDA: Language Models for Dialog Applications

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, Quoc Le

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Adaptive Fine-Tuning of Transformer-Based Language Models for Named Entity Recognition

Felix Stollenwerk

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 28 pages, 19 figures

Does QA-based intermediate training help fine-tuning language models for text classification?

Shiwei Zhang, Xiuzhen Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ALTA 2021

How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?

Xinhsuai Dong, Luu Anh Tuan, Min Lin, Shuicheng Yan, Hanwang Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by NeurIPS-2021

Teaching Autoregressive Language Models Complex Tasks By Demonstration

Gabriel Recchia

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Corrected typo in Figure 2. Updated two citations to adhere to the format preferred by the cited authors

Supporting Undotted Arabic with Pre-trained Language Models

Aviad Rom, Kfir Bar

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Paper accepted to 4th International Conference on Natural Language and Speech Processing (ICNLSP 2021)

GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation

Kang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee, Woomyeong Park

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP2021 Findings; 11 pages, 7 tables, 2 figures

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Journal ref IEEE/ACM Transactions on Audio, Speech, and Language Processing 2021

Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models

Xin Zhou, Ruotian Ma, Tao Gui, Yiding Tan, Qi Zhang, Xuanjing Huang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Work in Progress

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization

Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments The 58th annual meeting of the Association for Computational Linguistics (ACL 2020)

Sense representations for Portuguese: experiments with sense embeddings and deep neural language models

Jessica Rodrigues da Silva, Helena de Medeiros Caseli

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 24 pages, Springer Nature

Journal ref Language Resources and Evaluation (2021)

How to Query Language Models?

Leonard Adolphs, Shehzaad Dhuliawala, Thomas Hofmann

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators

Peiyu Liu, Ze-Feng Gao, Wayne Xin Zhao, Z. Y. Xie, Zhong-Yi Lu, Ji-Rong Wen

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by ACL 2021 main conference

Making Pre-trained Language Models Better Few-shot Learners

Tianyu Gao, Adam Fisch, Danqi Chen

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2021. The code is publicly available at https://github.com/princeton-nlp/LM-BFF

Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

Yue Yu, Simiao Zuo, Haoming Jiang, Wendi Ren, Tuo Zhao, Chao Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments NAACL-HLT 2021. Code: \url{https://github.com/yueyu1030/COSINE}

Journal ref NAACL-HLT 2021

Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning

Armen Aghajanyan, Luke Zettlemoyer, Sonal Gupta

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

On the Sentence Embeddings from Pre-trained Language Models

Bohan Li, Hao Zhou, Junxian He, Mingxuan Wang, Yiming Yang, Lei Li

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2020

Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages

Kushal Jain, Adwait Deshpande, Kumar Shridhar, Felix Laumann, Ayushman Dash

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at ML-RSA @ NeurIPS 2020

Rethinking embedding coupling in pre-trained language models

Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Cold-start Active Learning through Self-supervised Language Modeling

Michelle Yuan, Hsuan-Tien Lin, Jordan Boyd-Graber

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published in EMNLP 2020

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Adam Roberts, Colin Raffel, Noam Shazeer

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Camera-ready version for EMNLP

Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining

Chengyu Wang, Minghui Qiu, Jun Huang, Xiaofeng He

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments accepted by emnlp 2020

RobBERT: a Dutch RoBERTa-based Language Model

Pieter Delobelle, Thomas Winters, Bettina Berendt

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 11 pages, 4 tables, 3 figures. Accepted in EMNLP Findings

Improving Indonesian Text Classification Using Multilingual Language Model

Ilham Firdausi Putra, Ayu Purwarianti

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref 2020 International Conference on Advanced Informatics: Concept, Theory and Application (ICAICTA)

Discovering Useful Sentence Representations from Large Pretrained Language Models

Nishant Subramani, Nivedita Suresh

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 13 pages, 11 figures, 2 tables

Video-Grounded Dialogues with Pretrained Generation Language Models

Hung Le, Steven C. H. Hoi

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACL 2020 (Short Paper)

Journal ref Association for Computational Linguistics (2020) 5842-5848

MultiFiT: Efficient Multi-lingual Language Model Fine-tuning

Julian Martin Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Proceedings of EMNLP-IJCNLP 2019