语言大模型 / LLM - arXivDaily 专题

1911.03937 2019-11-12 cs.CL 79%

Language Model-Driven Unsupervised Neural Machine Translation

Wei Zhang, Youyuan Lin, Ruoran Ren, Xiaodong Wang, Zhenshuang Liang, Zhen Huang

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 11 pages, 3 figures, 7 tables

1911.03597 2019-11-12 cs.CL 79%

Zero-Shot Paraphrase Generation with Multilingual Language Models

Yinpeng Guo, Yi Liao, Xin Jiang, Qing Zhang, Yibo Zhang, Qun Liu

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1911.01071 2019-11-05 cs.LG cs.CV stat.ML 79%

Supervised level-wise pretraining for recurrent neural network initialization in multi-class classification

Dino Ienco, Roberto Interdonato, Raffaele Gaetano

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

1909.11861 2019-10-08 cs.CL 79%

Large-scale Pretraining for Neural Machine Translation with Tens of Billions of Sentence Pairs

Yuxian Meng, Xiangyuan Ren, Zijun Sun, Xiaoya Li, Arianna Yuan, Fei Wu, Jiwei Li

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1909.10599 2019-09-25 cs.CL 79%

Multi-stage Pretraining for Abstractive Summarization

Sebastian Goodman, Zhenzhong Lan, Radu Soricut

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1909.05858 2019-09-24 cs.CL 79%

CTRL: A Conditional Transformer Language Model for Controllable Generation

Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, Caiming Xiong, Richard Socher

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1909.08582 2019-09-19 cs.CL 79%

Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences

Genta Indra Winata, Andrea Madotto, Chien-Sheng Wu, Pascale Fung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted in CoNLL 2019

1909.04130 2019-09-11 cs.CL 79%

Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?

Lyan Verwimp, Jerome R. Bellegarda

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at Interspeech 2019

1909.00107 2019-09-04 cs.CL 79%

Behavior Gated Language Models

Prashanth Gurunath Shivakumar, Shao-Yen Tseng, Panayiotis Georgiou, Shrikanth Narayanan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1908.03734 2019-08-13 cs.CL eess.AS 79%

Unsupervised Stemming based Language Model for Telugu Broadcast News Transcription

Mythili Sharan Pala, Parayitam Laxminarayana, A. V. Ramana

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments first draft

1812.03919 2019-08-06 eess.AS cs.CL cs.SD 79%

Pretraining by Backtranslation for End-to-end ASR in Low-Resource Settings

Matthew Wiesner, Adithya Renduchintala, Shinji Watanabe, Chunxi Liu, Najim Dehak, Sanjeev Khudanpur

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1907.03187 2019-07-09 cs.CL 79%

Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

Bobak Farzin, Piotr Czapla, Jeremy Howard

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments IberLEF 2019 Workshop

1905.09217 2019-05-23 cs.IR cs.CL 79%

Deeper Text Understanding for IR with Contextual Neural Language Modeling

Zhuyun Dai, Jamie Callan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments In proceedings of SIGIR 2019

1905.07754 2019-05-21 cs.CV cs.LG 79%

Multimodal 3D Object Detection from Simulated Pretraining

Åsmund Brekke, Fredrik Vatsendvik, Frank Lindseth

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments 12 pages, part of proceedings for the NAIS 2019 symposium

1905.06655 2019-05-17 cs.CL cs.SD eess.AS 79%

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

Joongbo Shin, Yoonhyung Lee, Kyomin Jung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments submitted to INTERSPEECH 2019, 5 pages

1905.06018 2019-05-16 cs.LG stat.ML 79%

Can Graph Neural Networks Go "Online"? An Analysis of Pretraining and Inference

Lukas Galke, Iacopo Vagliano, Ansgar Scherp

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments 5 pages, 1 figure, Representation Learning on Graphs and Manifolds Workshop of the International Conference on Learning Representations (ICLR), 2019

1904.12104 2019-04-30 cs.CL 79%

Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference

Tianda Li, Xiaodan Zhu, Quan Liu, Qian Chen, Zhigang Chen, Si Wei

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1904.03035 2019-04-08 cs.CL 79%

Identifying and Reducing Gender Bias in Word-Level Language Models

Shikha Bordia, Samuel R. Bowman

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 12 pages with 8 tables and 1 figure; Published at NAACL SRW 2019

1903.07785 2019-03-20 cs.CL 79%

Cloze-driven Pretraining of Self-attention Networks

Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1903.04167 2019-03-13 cs.CL 79%

Partially Shuffling the Training Data to Improve Language Models

Ofir Press

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1903.03260 2019-03-11 cs.CL 79%

Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State

Richard Futrell, Ethan Wilcox, Takashi Morita, Peng Qian, Miguel Ballesteros, Roger Levy

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted to NAACL 2019. Not yet edited into the camera-ready version

1901.09296 2019-01-29 cs.CL 79%

Variational Smoothing in Recurrent Neural Network Language Models

Lingpeng Kong, Gabor Melis, Wang Ling, Lei Yu, Dani Yogatama

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted as a conference paper at ICLR 2019

1809.00125 2019-01-25 cs.CL 79%

Simple Fusion: Return of the Language Model

Felix Stahlberg, James Cross, Veselin Stoyanov

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments WMT18 paper

1812.04647 2018-12-13 cs.CL 79%

Scalable language model adaptation for spoken dialogue systems

Ankur Gandhe, Ariya Rastrow, Bjorn Hoffmeister

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted at SLT 2018

1810.10254 2018-10-31 cs.CL 79%

Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modeling

Genta Indra Winata, Andrea Madotto, Chien-Sheng Wu, Pascale Fung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Submitted to ICASSP 2019

1810.10045 2018-10-25 cs.CL 79%

Language Modeling at Scale

Mostofa Patwary, Milind Chabbi, Heewoo Jun, Jiaji Huang, Gregory Diamos, Kenneth Church

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1807.00930 2018-09-27 cs.CL cs.NE 79%

Neural Random Projections for Language Modelling

Davide Nunes, Luis Antunes

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1809.05157 2018-09-21 cs.CL cs.IR 79%

On the Strength of Character Language Models for Multilingual Named Entity Recognition

Xiaodong Yu, Stephen Mayhew, Mark Sammons, Dan Roth

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 5 pages, EMNLP 2018 short paper

Journal ref EMNLP 2018

1809.07182 2018-09-20 cs.CL 79%

String Transduction with Target Language Models and Insertion Handling

Garrett Nicolai, Saeed Najafi, Grzegorz Kondrak

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 8 pages + 1 page Appendix, 4 figures and 8 tables, plus an additional 1 figure and 2 tables in appendix; to appear at SIGMORPHON 2018, October, 2018

1711.01048 2018-08-06 cs.CL 79%

Dual Language Models for Code Switched Speech Recognition

Saurabh Garg, Tanmay Parekh, Preethi Jyothi

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted at Interspeech 2018

1. 预训练与数据 12403 篇

Language Model-Driven Unsupervised Neural Machine Translation

Zero-Shot Paraphrase Generation with Multilingual Language Models

Supervised level-wise pretraining for recurrent neural network initialization in multi-class classification

Large-scale Pretraining for Neural Machine Translation with Tens of Billions of Sentence Pairs

Multi-stage Pretraining for Abstractive Summarization

CTRL: A Conditional Transformer Language Model for Controllable Generation

Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences

Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?

Behavior Gated Language Models

Unsupervised Stemming based Language Model for Telugu Broadcast News Transcription

Pretraining by Backtranslation for End-to-end ASR in Low-Resource Settings

Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

Deeper Text Understanding for IR with Contextual Neural Language Modeling

Multimodal 3D Object Detection from Simulated Pretraining

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

Can Graph Neural Networks Go "Online"? An Analysis of Pretraining and Inference

Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference

Identifying and Reducing Gender Bias in Word-Level Language Models

Cloze-driven Pretraining of Self-attention Networks

Partially Shuffling the Training Data to Improve Language Models

Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State

Variational Smoothing in Recurrent Neural Network Language Models

Simple Fusion: Return of the Language Model

Scalable language model adaptation for spoken dialogue systems

Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modeling

Language Modeling at Scale

Neural Random Projections for Language Modelling

On the Strength of Character Language Models for Multilingual Named Entity Recognition

String Transduction with Target Language Models and Insertion Handling

Dual Language Models for Code Switched Speech Recognition