语言大模型 / LLM - arXivDaily 专题

1911.03864 2020-04-24 cs.CL cs.LG 62%

Improving Transformer Models by Reordering their Sublayers

Ofir Press, Noah A. Smith, Omer Levy

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments To appear at ACL 2020

2004.07623 2020-04-23 cs.CL cs.LG 62%

Recognizing Long Grammatical Sequences Using Recurrent Networks Augmented With An External Differentiable Stack

Ankur Mali, Alexander Ororbia, Daniel Kifer, Clyde Lee Giles

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 14 pages, 10 tables

1912.11959 2020-01-01 cs.LG cs.CL stat.ML 62%

Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention

Thomas Dowdell, Hongyu Zhang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 2 figures

1907.05242 2019-12-17 cs.CL cs.LG 62%

Large Memory Layers with Product Keys

Guillaume Lample, Alexandre Sablayrolles, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Advances in Neural Information Processing Systems, 2019

1912.01116 2019-12-04 cs.LG cs.CL cs.NE stat.ML 62%

Long Distance Relationships without Time Travel: Boosting the Performance of a Sparse Predictive Autoencoder in Sequence Modeling

Jeremy Gordon, David Rawlinson, Subutai Ahmad

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 6 figures, 4 tables

1911.06415 2019-11-18 cs.CL cs.LG 62%

Sparse associative memory based on contextual code learning for disambiguating word senses

Max Raphael Sobroza, Tales Marra, Deok-Hee Kim-Dufor, Claude Berrou

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1911.03329 2019-11-11 cs.CL cs.LG cs.NE 62%

Memory-Augmented Recurrent Neural Networks Can Learn Generalized Dyck Languages

Mirac Suzgun, Sebastian Gehrmann, Yonatan Belinkov, Stuart M. Shieber

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1911.00461 2019-11-04 cs.CL cs.LG 62%

On the Unintended Social Bias of Training Language Generation Models with Data from Local Media

Omar U. Florez

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1910.10487 2019-10-24 cs.CL cs.LG stat.ML 62%

Memory-Augmented Recurrent Networks for Dialogue Coherence

David Donahue, Yuanliang Meng, Anna Rumshisky

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Honors project, 12 pages

1910.06764 2019-10-16 cs.LG cs.AI stat.ML 62%

Stabilizing Transformers for Reinforcement Learning

Emilio Parisotto, H. Francis Song, Jack W. Rae, Razvan Pascanu, Caglar Gulcehre, Siddhant M. Jayakumar, Max Jaderberg, Raphael Lopez Kaufman, Aidan Clark, Seb Noury, Matthew M. Botvinick, Nicolas Heess, Raia Hadsell

专题命中长上下文与记忆：language model(abstract)；分类 cs.AI、cs.LG

1907.01470 2019-07-03 cs.LG cs.CL stat.ML 62%

Augmenting Self-attention with Persistent Memory

Sainbayar Sukhbaatar, Edouard Grave, Guillaume Lample, Herve Jegou, Armand Joulin

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1906.09324 2019-06-25 cs.CL cs.AI cs.SI 62%

Automatic Conditional Generation of Personalized Social Media Short Texts

Ziwen Wang, Jie Wang, Haiqian Gu, Fei Su, Bojin Zhuang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments published in PRICAI 2018

Journal ref In: Geng X., Kang BH. (eds) PRICAI 2018: Trends in Artificial Intelligence

1805.01216 2019-04-08 cs.LG cs.CL stat.ML 62%

Disentangling Language and Knowledge in Task-Oriented Dialogs

Dinesh Raghu, Nikhil Gupta, Mausam

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Published in NAACL-HLT 2019

1707.08214 2019-03-01 cs.CL cs.LG cs.NE 62%

Dual Rectified Linear Units (DReLUs): A Replacement for Tanh Activation Functions in Quasi-Recurrent Neural Networks

Fréderic Godin, Jonas Degrave, Joni Dambre, Wesley De Neve

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1810.12754 2018-10-31 cs.LG cs.CL cs.NE stat.ML 62%

Recurrent Attention Unit

Guoqiang Zhong, Guohua Yue, Xiao Ling

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1810.06695 2018-10-17 cs.CL cs.LG stat.ML 62%

Exploring the Use of Attention within an Neural Machine Translation Decoder States to Translate Idioms

Giancarlo D. Salton, Robert J. Ross, John D. Kelleher

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1809.05916 2018-09-18 cs.LG cs.CL stat.ML 62%

Curriculum-Based Neighborhood Sampling For Sequence Prediction

James O' Neill, Danushka Bollegala

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1809.02836 2018-09-11 cs.NE cs.CL cs.LG 62%

Context-Free Transductions with Neural Stacks

Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, Simon Mendelsohn

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments To appear in the proceedings of the Analyzing and Interpreting Neural Networks for NLP workshop at EMNLP 2018

1809.01229 2018-09-06 cs.LG cs.CL stat.ML 62%

t-Exponential Memory Networks for Question-Answering Machines

Kyriakos Tolias, Sotirios Chatzis

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1806.00628 2018-06-05 cs.NE cs.CL cs.LG 62%

A Novel Framework for Recurrent Neural Networks with Enhancing Information Processing and Transmission between Units

Xi Chen, Zhihong Deng, Gehui Shen, Ting Huang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1803.08793 2018-03-26 cs.SE cs.CL cs.LG 62%

Exploring the Naturalness of Buggy Code with Recurrent Neural Networks

Jack Lanchantin, Ji Gao

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1801.10308 2018-02-01 cs.CL cs.LG 62%

Nested LSTMs

Joel Ruben Antony Moniz, David Krueger

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACML 2017

Journal ref Proceedings of the Ninth Asian Conference on Machine Learning, PMLR 77:530-544, 2017

1712.07316 2017-12-21 cs.CL cs.LG stat.ML 62%

A Flexible Approach to Automated RNN Architecture Generation

Martin Schrimpf, Stephen Merity, James Bradbury, Richard Socher

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

1708.00077 2017-08-02 stat.ML cs.CL cs.LG 62%

Bayesian Sparsification of Recurrent Neural Networks

Ekaterina Lobacheva, Nadezhda Chirkova, Dmitry Vetrov

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Published in Workshop on Learning to Generate Natural Language, ICML, 2017

1706.02222 2017-06-08 cs.LG cs.CL stat.ML 62%

Gated Recurrent Neural Tensor Network

Andros Tjandra, Sakriani Sakti, Ruli Manurung, Mirna Adriani, Satoshi Nakamura

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at IJCNN 2016 URL : http://ieeexplore.ieee.org/document/7727233/

1610.09893 2016-11-01 cs.CL cs.LG 62%

LightRNN: Memory and Computation-Efficient Recurrent Neural Networks

Xiang Li, Tao Qin, Jian Yang, Tie-Yan Liu

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments NIPS 2016

1606.03002 2016-06-10 cs.NE cs.AI cs.CL 62%

MuFuRU: The Multi-Function Recurrent Unit

Dirk Weissenborn, Tim Rocktäschel

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

1510.02693 2016-01-07 cs.NE cs.CL cs.LG 62%

Feedforward Sequential Memory Neural Networks without Recurrent Feedback

ShiLiang Zhang, Hui Jiang, Si Wei, LiRong Dai

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 4 pages, 1figure

1506.02078 2015-11-18 cs.LG cs.CL cs.NE 62%

Visualizing and Understanding Recurrent Networks

Andrej Karpathy, Justin Johnson, Li Fei-Fei

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments changing style, adding references, minor changes to text

1503.01838 2015-06-09 cs.CL cs.LG cs.NE 62%

Encoding Source Language with Convolutional Neural Network for Machine Translation

Fandong Meng, Zhengdong Lu, Mingxuan Wang, Hang Li, Wenbin Jiang, Qun Liu

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted as a full paper at ACL 2015

1. 长上下文与记忆 4797 篇

Improving Transformer Models by Reordering their Sublayers

Recognizing Long Grammatical Sequences Using Recurrent Networks Augmented With An External Differentiable Stack

Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention

Large Memory Layers with Product Keys

Long Distance Relationships without Time Travel: Boosting the Performance of a Sparse Predictive Autoencoder in Sequence Modeling

Sparse associative memory based on contextual code learning for disambiguating word senses

Memory-Augmented Recurrent Neural Networks Can Learn Generalized Dyck Languages

On the Unintended Social Bias of Training Language Generation Models with Data from Local Media

Memory-Augmented Recurrent Networks for Dialogue Coherence

Stabilizing Transformers for Reinforcement Learning

Augmenting Self-attention with Persistent Memory

Automatic Conditional Generation of Personalized Social Media Short Texts

Disentangling Language and Knowledge in Task-Oriented Dialogs

Dual Rectified Linear Units (DReLUs): A Replacement for Tanh Activation Functions in Quasi-Recurrent Neural Networks

Recurrent Attention Unit

Exploring the Use of Attention within an Neural Machine Translation Decoder States to Translate Idioms

Curriculum-Based Neighborhood Sampling For Sequence Prediction

Context-Free Transductions with Neural Stacks

t-Exponential Memory Networks for Question-Answering Machines

A Novel Framework for Recurrent Neural Networks with Enhancing Information Processing and Transmission between Units

Exploring the Naturalness of Buggy Code with Recurrent Neural Networks

Nested LSTMs

A Flexible Approach to Automated RNN Architecture Generation

Bayesian Sparsification of Recurrent Neural Networks

Gated Recurrent Neural Tensor Network

LightRNN: Memory and Computation-Efficient Recurrent Neural Networks

MuFuRU: The Multi-Function Recurrent Unit

Feedforward Sequential Memory Neural Networks without Recurrent Feedback

Visualizing and Understanding Recurrent Networks

Encoding Source Language with Convolutional Neural Network for Machine Translation