语言大模型 / LLM - arXivDaily 专题

2109.11797 2022-05-23 cs.CV cs.CL 79%

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models

Yuan Yao, Ao Zhang, Zhengyan Zhang, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Work in progress

2205.03719 2022-05-10 cs.LG 79%

Odor Descriptor Understanding through Prompting

Laura Sisson

专题命中指令微调：prompting(title,abstract)；分类 cs.LG

Comments 14 pages, 6 figures, 5 tables

2204.08039 2022-04-19 cs.CL 79%

Pathologies of Pre-trained Language Models in Few-shot Fine-tuning

Hanjie Chen, Guoqing Zheng, Ahmed Hassan Awadallah, Yangfeng Ji

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments ACL 2022 Workshop on Insights from Negative Results in NLP

2204.07289 2022-04-18 cs.CL 79%

Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts

Apoorv Garg, Deval Srivastava, Zhiyang Xu, Lifu Huang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 2 figures

2204.04026 2022-04-11 cs.CL 79%

Fair and Argumentative Language Modeling for Computational Argumentation

Carolin Holtermann, Anne Lauscher, Simone Paolo Ponzetto

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments ACL 2022

2203.13397 2022-03-28 cs.CL 79%

GPT-D: Inducing Dementia-related Linguistic Anomalies by Deliberate Degradation of Artificial Neural Language Models

Changye Li, David Knopman, Weizhe Xu, Trevor Cohen, Serguei Pakhomov

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments This paper has been accepted by ACL 2022

2203.10995 2022-03-22 cs.CL 79%

Word Order Does Matter (And Shuffled Language Models Know It)

Vinit Ravishankar, Mostafa Abdou, Artur Kulmizev, Anders Søgaard

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear at ACL 2022; 9 pages

2104.08320 2022-03-03 cs.CL 79%

On the Importance of Effectively Adapting Pretrained Language Models for Active Learning

Katerina Margatina, Loïc Barrault, Nikolaos Aletras

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear at ACL 2022

2103.11790 2022-02-15 cs.CL cs.CY 79%

Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do

Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin A. Rothkopf, Kristian Kersting

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2202.05209 2022-02-11 cs.CL cs.SD eess.AS 79%

Improving Automatic Speech Recognition for Non-Native English with Transfer Learning and Language Model Decoding

Peter Sullivan, Toshiko Shibano, Muhammad Abdul-Mageed

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments arXiv admin note: substantial text overlap with arXiv:2110.00678

2202.03611 2022-02-09 cs.CL 79%

Do Language Models Learn Position-Role Mappings?

Jackson Petty, Michael Wilson, Robert Frank

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear in the BUCLD 46 Proceedings

2201.11227 2022-01-28 cs.LG cs.PL 79%

Synchromesh: Reliable code generation from pre-trained language models

Gabriel Poesia, Oleksandr Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Christopher Meek, Sumit Gulwani

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments 10 pages, 9 additional pages of Appendix

2201.08687 2022-01-24 cs.CL 79%

A Comparative Study on Language Models for Task-Oriented Dialogue Systems

Vinsen Marselino Andreas, Genta Indra Winata, Ayu Purwarianti

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 figure

Journal ref 2021 8th International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA) (pp. 1-5). IEEE

2109.07140 2021-12-21 cs.CL 79%

On the Universality of Deep Contextual Language Models

Shaily Bhatt, Poonam Goyal, Sandipan Dandapat, Monojit Choudhury, Sunayana Sitaram

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 9 pages

2110.01256 2021-10-05 cs.CL 79%

Revisiting Self-Training for Few-Shot Learning of Language Model

Yiming Chen, Yan Zhang, Chen Zhang, Grandee Lee, Ran Cheng, Haizhou Li

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2021

2109.10534 2021-09-23 cs.CL 79%

Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages

Tejas Indulal Dhamecha, Rudra Murthy, Samarth Bharadwaj, Karthik Sankaranarayanan, Pushpak Bhattacharyya

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted in EMNLP 2021

2109.10052 2021-09-22 cs.CL 79%

Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?

Rochelle Choenni, Ekaterina Shutova, Robert van Rooij

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2109.09237 2021-09-21 cs.CL 79%

MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models

Qianchu Liu, Fangyu Liu, Nigel Collier, Anna Korhonen, Ivan Vulić

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments CoNLL 2021

2109.07185 2021-09-16 cs.CL 79%

Transformer-based Language Models for Factoid Question Answering at BioASQ9b

Urvashi Khanna, Diego Mollá

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 3 figures, 4 tables. Accepted at BioASQ Workshop, CLEF Working Notes

2108.12848 2021-09-16 cs.CL 79%

Span Fine-tuning for Pre-trained Language Models

Rongzhou Bao, Zhuosheng Zhang, Hai Zhao

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2021 Finding(early version)

2103.09120 2021-09-09 cs.CL 79%

Structural Adapters in Pretrained Language Models for AMR-to-text Generation

Leonardo F. R. Ribeiro, Yue Zhang, Iryna Gurevych

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted as a long conference paper to EMNLP 2021

2108.06590 2021-08-17 cs.CL cs.CR cs.SE 79%

Few-Sample Named Entity Recognition for Security Vulnerability Reports by Fine-Tuning Pre-Trained Language Models

Guanqun Yang, Shay Dineen, Zhipeng Lin, Xueqing Liu

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by MLHat @ KDD '21

2108.03334 2021-08-10 cs.CL 79%

Towards Zero-shot Language Modeling

Edoardo Maria Ponti, Ivan Vulić, Ryan Cotterell, Roi Reichart, Anna Korhonen

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2106.10715 2021-06-25 cs.CL 79%

CPM-2: Large-scale Cost-effective Pre-trained Language Models

Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu, Maosong Sun

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2106.09204 2021-06-18 cs.CL 79%

An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models

Xueqing Liu, Chi Wang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear in ACL-IJCNLP 2021

2106.03164 2021-06-08 cs.CL 79%

On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation

Ruidan He, Linlin Liu, Hai Ye, Qingyu Tan, Bosheng Ding, Liying Cheng, Jia-Wei Low, Lidong Bing, Luo Si

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2021 (long paper)

2012.00955 2021-05-21 cs.CL 79%

How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering

Zhengbao Jiang, Jun Araki, Haibo Ding, Graham Neubig

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments TACL 2021

2010.12864 2021-04-13 cs.CL stat.ML 79%

On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning

Xisen Jin, Francesco Barbieri, Brendan Kennedy, Aida Mostafazadeh Davani, Leonardo Neves, Xiang Ren

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 14 pages; Accepted at NAACL 2021

2104.03767 2021-04-12 cs.CL 79%

Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation

Huiling You, Xingran Zhu, Sara Stymne

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear at SemEval-2021

2101.12294 2021-02-08 cs.CL 79%

Combining pre-trained language models and structured knowledge

Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso, Matthew Huggins, Cynthia Breazeal

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Updated references

1. 指令微调 11667 篇

CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models

Odor Descriptor Understanding through Prompting

Pathologies of Pre-trained Language Models in Few-shot Fine-tuning

Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts

Fair and Argumentative Language Modeling for Computational Argumentation

GPT-D: Inducing Dementia-related Linguistic Anomalies by Deliberate Degradation of Artificial Neural Language Models

Word Order Does Matter (And Shuffled Language Models Know It)

On the Importance of Effectively Adapting Pretrained Language Models for Active Learning

Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do

Improving Automatic Speech Recognition for Non-Native English with Transfer Learning and Language Model Decoding

Do Language Models Learn Position-Role Mappings?

Synchromesh: Reliable code generation from pre-trained language models

A Comparative Study on Language Models for Task-Oriented Dialogue Systems

On the Universality of Deep Contextual Language Models

Revisiting Self-Training for Few-Shot Learning of Language Model

Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages

Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?

MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models

Transformer-based Language Models for Factoid Question Answering at BioASQ9b

Span Fine-tuning for Pre-trained Language Models

Structural Adapters in Pretrained Language Models for AMR-to-text Generation

Few-Sample Named Entity Recognition for Security Vulnerability Reports by Fine-Tuning Pre-Trained Language Models

Towards Zero-shot Language Modeling

CPM-2: Large-scale Cost-effective Pre-trained Language Models

An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models

On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation

How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering

On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning

Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation

Combining pre-trained language models and structured knowledge