语言大模型 / LLM

Exploring Software Naturalness through Neural Language Models

Luca Buratti, Saurabh Pujar, Mihaela Bornea, Scott McCarley, Yunhui Zheng, Gaetano Rossiello, Alessandro Morari, Jim Laredo, Veronika Thost, Yufan Zhuang, Giacomo Domeniconi

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Position Masking for Language Models

Andy Wagner, Tiyasa Mitra, Mrinal Iyer, Godfrey Da Costa, Marc Tremblay

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Examination and Extension of Strategies for Improving Personalized Language Modeling via Interpolation

Liqun Shao, Sahitya Mantravadi, Tom Manzini, Alejandro Buendia, Manon Knoertzer, Soundar Srinivasan, Chris Quirk

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL Natural Language Interface Workshop 2020, short paper

Unsupervised Paraphrase Generation using Pre-trained Language Models

Chaitra Hegde, Shrikumar Patil

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Learning Architectures from an Extended Search Space for Language Modeling

Yinqiao Li, Chi Hu, Yuhao Zhang, Nuo Xu, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, Changliang Li

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2020

Considering Likelihood in NLP Classification Explanations with Occlusion and Language Modeling

David Harbecke, Christoph Alt

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2020 Student Research Workshop

Integrating Discrete and Neural Features via Mixed-feature Trans-dimensional Random Field Language Models

Silin Gao, Zhijian Ou, Wei Yang, Huifang Xu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted for presentation at ICASSP 2020, 5 pages, 2 figures

Finnish Language Modeling with Deep Transformer Models

Abhilash Jain, Aku Ruohe, Stig-Arne Grönroos, Mikko Kurimo

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 4 pages

Learning Dynamic Author Representations with Temporal Language Models

Edouard Delasalles, Sylvain Lamprier, Ludovic Denoyer

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments International Conference on Data Mining, ICDM 2019

Limits of Detecting Text Generated by Large-Scale Language Models

Lav R. Varshney, Nitish Shirish Keskar, Richard Socher

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ITA 2020

Transformer-based language modeling and decoding for conversational speech recognition

Kareem Nassar

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

End-to-end Named Entity Recognition and Relation Extraction using Pre-trained Language Models

John Giorgi, Xindi Wang, Nicola Sahar, Won Young Shin, Gary D. Bader, Bo Wang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 2 figures

Multiscale Self Attentive Convolutions for Vision and Language Modeling

Oren Barkan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

BERT-CNN: a Hierarchical Patent Classifier Based on a Pre-Trained Language Model

Xiaolei Lu, Bin Ni

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments in Chinese

Language Modeling with Deep Transformers

Kazuki Irie, Albert Zeyer, Ralf Schlüter, Hermann Ney

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments To appear in the proceedings of INTERSPEECH 2019

Ouroboros: On Accelerating Training of Transformer-Based Language Models

Qian Yang, Zhouyuan Huo, Wenlin Wang, Heng Huang, Lawrence Carin

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments To appear in the proceedings of Neural Information Processing Systems Conference (2019)

Distributionally Robust Language Modeling

Yonatan Oren, Shiori Sagawa, Tatsunori B. Hashimoto, Percy Liang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Camera ready version for EMNLP

The Unreasonable Effectiveness of Transformer Language Models in Grammatical Error Correction

Dimitrios Alikaniotis, Vipul Raheja

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 3 tables, accepted at the 14th Workshop on Innovative Use of NLP for Building Educational Applications

Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains

Samira Abnar, Lisa Beinborn, Rochelle Choenni, Willem Zuidema

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref 2nd BlackBoxNLP workshop @ACL2019

BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

Alex Wang, Kyunghyun Cho

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments NeuralGen 2019; https://colab.research.google.com/drive/1MxKZGtQ9SSBjTK5ArsZ5LKhkztzg52RV

Improving Unsupervised Word-by-Word Translation with Language Model and Denoising Autoencoder

Yunsu Kim, Jiahui Geng, Hermann Ney

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published in EMNLP 2018, with links to the source code

Unsupervised Neural Word Segmentation for Chinese via Segmental Language Modeling

Zhiqing Sun, Zhi-Hong Deng

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments To appear in EMNLP 2018

The Importance of Generation Order in Language Modeling

Nicolas Ford, Daniel Duckworth, Mohammad Norouzi, George E. Dahl

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models

Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Personalized neural language models for real-world query auto completion

Nicolas Fiorini, Zhiyong Lu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To appear in NAACL-HLT 2018

An Analysis of Neural Language Modeling at Multiple Scales

Stephen Merity, Nitish Shirish Keskar, Richard Socher

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Topic Compositional Neural Language Model

Wenlin Wang, Zhe Gan, Wenqi Wang, Dinghan Shen, Jiaji Huang, Wei Ping, Sanjeev Satheesh, Lawrence Carin

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments To appear in AISTATS 2018, updated version

Neural Language Modeling by Jointly Learning Syntax and Lexicon

Yikang Shen, Zhouhan Lin, Chin-Wei Huang, Aaron Courville

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 5 figures, ICLR 2018

Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling

Hakan Inan, Khashayar Khosravi, Richard Socher

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Data Noising as Smoothing in Neural Network Language Models

Ziang Xie, Sida I. Wang, Jiwei Li, Daniel Lévy, Aiming Nie, Dan Jurafsky, Andrew Y. Ng

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2017