语言大模型 / LLM - arXivDaily 专题

2102.07988 2021-09-29 cs.LG cs.CL cs.DC 81%

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models

Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICML 2021

2104.07972 2021-09-21 cs.CL cs.LG 81%

Language Models are Few-Shot Butlers

Vincent Micheli, François Fleuret

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2021

2109.07684 2021-09-17 cs.CL cs.AI 81%

Language Models are Few-shot Multilingual Learners

Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, Rosanne Liu, Jason Yosinski, Pascale Fung

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 14 pages

2108.00082 2021-09-16 cs.CL cs.AI 81%

Towards Continual Entity Learning in Language Models for Conversational Agents

Ravi Teja Gadde, Ivan Bulyko

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to NeurIPS 2021. Paper is under review

2109.04404 2021-09-10 cs.CL cs.LG 81%

All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

William Timkey, Marten van Schijndel

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at EMNLP 2021

2004.13805 2021-09-09 cs.CL cs.LG 81%

Multilingual Chart-based Constituency Parse Extraction from Pre-trained Language Models

Taeuk Kim, Bowen Li, Sang-goo Lee

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2021 Findings

2107.06546 2021-07-20 cs.CL cs.LG cs.SD eess.AS 81%

ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition

Afra Alishahi, Grzegorz Chrupała, Alejandrina Cristia, Emmanuel Dupoux, Bertrand Higy, Marvin Lavechin, Okko Räsänen, Chen Yu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

2107.07691 2021-07-19 cs.CL cs.LG 81%

Intersectional Bias in Causal Language Models

Liam Magee, Lida Ghahremanlou, Karen Soldatic, Shanthi Robertson

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 18 pages, 4 figures

2106.13884 2021-07-06 cs.CV cs.CL cs.LG 81%

Multimodal Few-Shot Learning with Frozen Language Models

Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

2104.03006 2021-06-15 cs.CL cs.AI stat.ML 81%

Librispeech Transducer Model with Internal Language Model Prior Correction

Albert Zeyer, André Merboldt, Wilfried Michel, Ralf Schlüter, Hermann Ney

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments accepted at Interspeech 2021

1910.03756 2021-04-28 cs.CL cs.AI 81%

Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models

Qingyang Wu, Yichi Zhang, Yu Li, Zhou Yu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EACL 2021 (oral)

2104.06390 2021-04-14 cs.CL cs.LG 81%

Detoxifying Language Models Risks Marginalizing Minority Voices

Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments NAACL 2021

2104.04487 2021-04-12 cs.CL cs.LG cs.SD eess.AS 81%

Language model fusion for streaming end to end speech recognition

Rodrigo Cabrera, Xiaofeng Liu, Mohammadreza Ghodsi, Zebulun Matteson, Eugene Weinstein, Anjuli Kannan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages

2104.02526 2021-04-07 eess.AS cs.CL cs.LG 81%

LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

Anton Mitrofanov, Mariya Korenevskaya, Ivan Podluzhny, Yuri Khokhlov, Aleksandr Laptev, Andrei Andrusenko, Aleksei Ilin, Maxim Korenevsky, Ivan Medennikov, Aleksei Romanenko

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Submitted to InterSpeech 2021

2103.14659 2021-03-30 cs.AI cs.LG 81%

Alignment of Language Agents

Zachary Kenton, Tom Everitt, Laura Weidinger, Iason Gabriel, Vladimir Mikulik, Geoffrey Irving

专题命中其他LLM ：language agent(title,abstract)；分类 cs.AI、cs.LG

2008.00312 2021-03-12 cs.CR cs.CL cs.LG 81%

Trojaning Language Models for Fun and Profit

Xinyang Zhang, Zheng Zhang, Shouling Ji, Ting Wang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Additional experiments and text editing; To appear in 2021 6th IEEE European Symposium on Security and Privacy

2103.00199 2021-03-02 cs.CL cs.IR cs.LG 81%

COVID-19 Tweets Analysis through Transformer Language Models

Abdul Hameed Azeemi, Adeel Waheed

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages, 5 figures

2102.10535 2021-02-23 cs.CL cs.LG 81%

Automatic Code Generation using Pre-Trained Language Models

Luis Perez, Lizi Ottens, Sudharshan Viswanathan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 11 figures

2101.04758 2021-02-04 cs.CL cs.AI cs.NE 81%

Self-Training Pre-Trained Language Models for Zero- and Few-Shot Multi-Dialectal Arabic Sequence Labeling

Muhammad Khalifa, Muhammad Abdul-Mageed, Khaled Shaalan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at EACL 2021 (Camera Ready Version)

2012.13575 2020-12-29 cs.CL cs.LG 81%

Contextual Temperature for Language Modeling

Pei-Hsin Wang, Sheng-Iou Hsieh, Shih-Chieh Chang, Yu-Ting Chen, Jia-Yu Pan, Wei Wei, Da-Chang Juan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

2010.10874 2020-12-10 cs.CL cs.AI 81%

TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog

Erik Ekstedt, Gabriel Skantze

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of ACL: EMNLP 2020

2012.03551 2020-12-08 cs.CL cs.AI 81%

KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning

Bin He, Xin Jiang, Jinghui Xiao, Qun Liu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 3 figures

2002.03079 2020-11-18 cs.CL cs.LG 81%

Blank Language Models

Tianxiao Shen, Victor Quach, Regina Barzilay, Tommi Jaakkola

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2020 camera-ready

2011.01900 2020-11-04 cs.CL cs.AI 81%

Warped Language Models for Noise Robust Language Understanding

Mahdi Namazifar, Gokhan Tur, Dilek Hakkani Tür

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at IEEE SLT 2021

2010.05732 2020-10-13 cs.CL cs.AI 81%

On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling

Rajat Patel, Francis Ferraro

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at the EMNLP 2020 Workshop on Deep Learning Inside Out

2005.10200 2020-10-06 cs.CL cs.LG 81%

BERTweet: A pre-trained language model for English Tweets

Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments In Proceedings of EMNLP 2020: System Demonstrations

2002.02492 2020-10-06 cs.LG cs.CL stat.ML 81%

Consistency of a Recurrent Language Model With Respect to Incomplete Decoding

Sean Welleck, Ilia Kulikov, Jaedeok Kim, Richard Yuanzhe Pang, Kyunghyun Cho

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2020

2009.02645 2020-09-08 cs.CL cs.AI 81%

QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model

Pai Liu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

2008.02213 2020-08-06 cs.NI cs.CL cs.LG 81%

6VecLM: Language Modeling in Vector Space for IPv6 Target Generation

Tianyu Cui, Gang Xiong, Gaopeng Gou, Junzheng Shi, Wei Xia

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments The paper has been accepted at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECMLPKDD 2020) (accepted/#ADSTab" target="_blank" rel="noopener">https://ecmlpkdd2020.net/programme/accepted/#ADSTab)

1907.13528 2020-07-14 cs.CL cs.AI 81%

What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models

Allyson Ettinger

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

1. 其他LLM 12228 篇

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models

Language Models are Few-Shot Butlers

Language Models are Few-shot Multilingual Learners

Towards Continual Entity Learning in Language Models for Conversational Agents

All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

Multilingual Chart-based Constituency Parse Extraction from Pre-trained Language Models

ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition

Intersectional Bias in Causal Language Models

Multimodal Few-Shot Learning with Frozen Language Models

Librispeech Transducer Model with Internal Language Model Prior Correction

Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models

Detoxifying Language Models Risks Marginalizing Minority Voices

Language model fusion for streaming end to end speech recognition

LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

Alignment of Language Agents

Trojaning Language Models for Fun and Profit

COVID-19 Tweets Analysis through Transformer Language Models

Automatic Code Generation using Pre-Trained Language Models

Self-Training Pre-Trained Language Models for Zero- and Few-Shot Multi-Dialectal Arabic Sequence Labeling

Contextual Temperature for Language Modeling

TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog

KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning

Blank Language Models

Warped Language Models for Noise Robust Language Understanding

On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling

BERTweet: A pre-trained language model for English Tweets

Consistency of a Recurrent Language Model With Respect to Incomplete Decoding

QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model

6VecLM: Language Modeling in Vector Space for IPv6 Target Generation

What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models