语言大模型 / LLM - arXivDaily 专题

1912.12384 2020-01-01 eess.AS cs.LG cs.SD eess.SP stat.ML 57%

Improved Multi-Stage Training of Online Attention-based Encoder-Decoder Models

Abhinav Garg, Dhananjaya Gowda, Ankur Kumar, Kwangyoun Kim, Mehul Kumar, Chanwoo Kim

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments Accepted and presented at the ASRU 2019 conference

1912.05911 2019-12-13 cs.LG stat.ML 57%

Recurrent Neural Networks (RNNs): A gentle Introduction and Overview

Robin M. Schmidt

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1905.05894 2019-12-05 cs.LG stat.ML 57%

Online Normalization for Training Neural Networks

Vitaliy Chiley, Ilya Sharapov, Atli Kosson, Urs Koster, Ryan Reece, Sofia Samaniego de la Fuente, Vishal Subbiah, Michael James

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments Published at the Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada. Code: https://github.com/Cerebras/online-normalization

1911.05507 2019-11-14 cs.LG stat.ML 57%

Compressive Transformers for Long-Range Sequence Modelling

Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, Timothy P. Lillicrap

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments 19 pages, 6 figures, 10 tables

1910.13830 2019-10-31 cs.LG cs.DS cs.IR stat.ML 57%

Extreme Classification in Log Memory using Count-Min Sketch: A Case Study of Amazon Search with 50M Products

Tharun Medini, Qixuan Huang, Yiqiu Wang, Vijai Mohan, Anshumali Shrivastava

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments Published at NeurIPS 2019. arXiv admin note: text overlap with arXiv:1810.04254

1910.13008 2019-10-30 cs.CL 57%

Sketch-Fill-A-R: A Persona-Grounded Chit-Chat Generation Framework

Michael Shum, Stephan Zheng, Wojciech Kryściński, Caiming Xiong, Richard Socher

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

Comments 10 pages, 9 tables, 4 figures

1909.01377 2019-10-30 cs.LG stat.ML 57%

Deep Equilibrium Models

Shaojie Bai, J. Zico Kolter, Vladlen Koltun

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments NeurIPS 2019 Spotlight Oral

1910.12590 2019-10-29 eess.AS cs.LG cs.SD stat.ML 57%

Detecting Multiple Speech Disfluencies using a Deep Residual Network with Bidirectional Long Short-Term Memory

Tedd Kourkounakis, Amirhossein Hajavi, Ali Etemad

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1910.05448 2019-10-15 cs.NE cs.CV cs.LG stat.ML 57%

Neural Memory Plasticity for Anomaly Detection

Tharindu Fernando, Simon Denman, David Ahmedt-Aristizabal, Sridha Sridharan, Kristin Laurens, Patrick Johnston, Clinton Fookes

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1909.12163 2019-09-27 cs.CL 57%

DARTS: Dialectal Arabic Transcription System

Sameer Khurana, Ahmed Ali, James Glass

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

1901.11150 2019-09-13 cs.LG math.OC stat.ML 57%

Memory-Efficient Adaptive Optimization

Rohan Anil, Vineet Gupta, Tomer Koren, Yoram Singer

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1905.07799 2019-08-09 cs.LG stat.ML 57%

Adaptive Attention Span in Transformers

Sainbayar Sukhbaatar, Edouard Grave, Piotr Bojanowski, Armand Joulin

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments Accepted to ACL 2019

1907.06607 2019-07-16 cs.LG stat.ML 57%

Agglomerative Attention

Matthew Spellings

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments 7 pages, 3 figures

1906.03677 2019-06-11 cs.CL 57%

Happy Together: Learning and Understanding Appraisal From Natural Language

Arun Rajendran, Chiyu Zhang, Muhammad Abdul-Mageed

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

Comments 11 pages, 5 figures, Proceedings of the 2nd Workshop on Affective Content Analysis@ AAAI (AffCon2019), Honolulu, Hawaii (January 2019)

1905.12340 2019-05-30 cs.LG stat.ML 57%

Rethinking Full Connectivity in Recurrent Neural Networks

Matthijs Van Keirsbilck, Alexander Keller, Xiaodong Yang

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1905.00507 2019-05-17 stat.ML cs.LG 57%

Learning higher-order sequential structure with cloned HMMs

Antoine Dedieu, Nishad Gothoskar, Scott Swingle, Wolfgang Lehrach, Miguel Lázaro-Gredilla, Dileep George

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1905.05381 2019-05-15 cs.CV cs.LG 57%

End to End Recognition System for Recognizing Offline Unconstrained Vietnamese Handwriting

Anh Duc Le, Hung Tuan Nguyen, Masaki Nakagawa

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1902.08077 2019-05-15 cs.LG stat.ML 57%

Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities

Octavian-Eugen Ganea, Sylvain Gelly, Gary Bécigneul, Aliaksei Severyn

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Journal ref ICML 2019

1711.00698 2019-04-30 cs.AI q-bio.NC 57%

Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task

Guillaume Viejo, Benoît Girard, Emmanuel Procyk, Mehdi Khamassi

专题命中长上下文与记忆：pretraining(abstract)；分类 cs.AI

Comments Behavioural Brain Research, Elsevier, 2017

1809.11086 2019-01-28 cs.LG cs.CC stat.ML 57%

Learning Recurrent Binary/Ternary Weights

Arash Ardakani, Zhengyun Ji, Sean C. Smithson, Brett H. Meyer, Warren J. Gross

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments Published as a conference paper at ICLR 2019

1811.03356 2018-11-09 cs.LG stat.ML 57%

Linear Memory Networks

Davide Bacciu, Antonio Carta, Alessandro Sperduti

专题命中长上下文与记忆：pretraining(abstract)；分类 cs.LG

1810.04437 2018-10-11 cs.LG stat.ML 57%

Persistence pays off: Paying Attention to What the LSTM Gating Mechanism Persists

Giancarlo D. Salton, John D. Kelleher

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1809.01329 2018-09-06 cs.CL 57%

RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency

Richard Futrell, Ethan Wilcox, Takashi Morita, Roger Levy

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

1807.08669 2018-07-24 cs.CL stat.ML 57%

Automatic Speech Recognition for Humanitarian Applications in Somali

Raghav Menon, Astik Biswas, Armin Saeb, John Quinn, Thomas Niesler

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

Comments 5 pages, 3 figures, 5 tables accepted at SLTU 2018

1807.06441 2018-07-18 eess.AS cs.CL cs.SD 57%

A Comparison of Adaptation Techniques and Recurrent Neural Network Architectures

Jan Vanek, Josef Michalek, Jan Zelinka, Josef Psutka

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

Comments submitted and accepted to SLSP 2018 conference. arXiv admin note: text overlap with arXiv:1806.07186, arXiv:1806.07974

1603.03116 2018-07-10 cs.LG cs.NE 57%

Low-rank passthrough neural networks

Antonio Valerio Miceli Barone

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

Comments 12 pages, 2 figures

1806.01822 2018-06-29 cs.LG stat.ML 57%

Relational recurrent neural networks

Adam Santoro, Ryan Faulkner, David Raposo, Jack Rae, Mike Chrzanowski, Theophane Weber, Daan Wierstra, Oriol Vinyals, Razvan Pascanu, Timothy Lillicrap

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1805.04264 2018-06-19 cs.CL cs.NE 57%

State Gradients for RNN Memory Analysis

Lyan Verwimp, Hugo Van hamme, Vincent Renkens, Patrick Wambacq

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

Comments Accepted for Interspeech 2018

1803.04439 2018-06-11 cs.NE cs.LG 57%

From Nodes to Networks: Evolving Recurrent Neural Networks

Aditya Rawal, Risto Miikkulainen

专题命中长上下文与记忆：language model(abstract)；分类 cs.LG

1704.00774 2018-05-15 cs.CL 57%

Restricted Recurrent Neural Tensor Networks: Exploiting Word Frequency and Compositionality

Alexandre Salle, Aline Villavicencio

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL

1. 长上下文与记忆 4789 篇

Improved Multi-Stage Training of Online Attention-based Encoder-Decoder Models

Recurrent Neural Networks (RNNs): A gentle Introduction and Overview

Online Normalization for Training Neural Networks

Compressive Transformers for Long-Range Sequence Modelling

Extreme Classification in Log Memory using Count-Min Sketch: A Case Study of Amazon Search with 50M Products

Sketch-Fill-A-R: A Persona-Grounded Chit-Chat Generation Framework

Deep Equilibrium Models

Detecting Multiple Speech Disfluencies using a Deep Residual Network with Bidirectional Long Short-Term Memory

Neural Memory Plasticity for Anomaly Detection

DARTS: Dialectal Arabic Transcription System

Memory-Efficient Adaptive Optimization

Adaptive Attention Span in Transformers

Agglomerative Attention

Happy Together: Learning and Understanding Appraisal From Natural Language

Rethinking Full Connectivity in Recurrent Neural Networks

Learning higher-order sequential structure with cloned HMMs

End to End Recognition System for Recognizing Offline Unconstrained Vietnamese Handwriting

Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities

Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task

Learning Recurrent Binary/Ternary Weights

Linear Memory Networks

Persistence pays off: Paying Attention to What the LSTM Gating Mechanism Persists

RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency

Automatic Speech Recognition for Humanitarian Applications in Somali

A Comparison of Adaptation Techniques and Recurrent Neural Network Architectures

Low-rank passthrough neural networks

Relational recurrent neural networks

State Gradients for RNN Memory Analysis

From Nodes to Networks: Evolving Recurrent Neural Networks

Restricted Recurrent Neural Tensor Networks: Exploiting Word Frequency and Compositionality