语言大模型 / LLM - arXivDaily 专题

1807.00993 2018-07-04 cs.CL stat.ML 79%

Improved training of neural trans-dimensional random field language models with dynamic noise-contrastive estimation

Bin Wang, Zhijian Ou

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 6 pages. Has been submitted to SLT 2018

1805.04836 2018-05-15 cs.CL 79%

Building Language Models for Text with Named Entities

Md Rizwan Parvez, Saikat Chakraborty, Baishakhi Ray, Kai-Wei Chang

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1804.09552 2018-04-26 cs.CL cs.HC 79%

Automatic speech recognition for launch control center communication using recurrent neural networks with data augmentation and custom language model

Kyongsik Yun, Joseph Osborne, Madison Lee, Thomas Lu, Edward Chow

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments SPIE 2018

1711.03541 2017-11-13 cs.CL 79%

Language Modeling for Code-Switched Data: Challenges and Approaches

Ganji Sreeram, Rohit Sinha

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1709.07777 2017-11-03 cs.CL 79%

Sentence Correction Based on Large-scale Language Modelling

Ji Wen

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1710.01809 2017-10-06 cs.CL 79%

Syntactic and Semantic Features For Code-Switching Factored Language Models

Heike Adel, Ngoc Thang Vu, Katrin Kirchhoff, Dominic Telaar, Tanja Schultz

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments IEEE/ACM Transactions on Audio, Speech, and Language Processing (Volume: 23, Issue: 3, March 2015)

1710.01799 2017-10-06 cs.CL 79%

Counterfactual Language Model Adaptation for Suggesting Phrases

Kenneth C. Arnold, Kai-Wei Chang, Adam T. Kalai

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1709.03759 2017-09-13 cs.CL 79%

Language Models of Spoken Dutch

Lyan Verwimp, Joris Pelemans, Marieke Lycke, Hugo Van hamme, Patrick Wambacq

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1709.02279 2017-09-08 cs.CL 79%

Cynical Selection of Language Model Training Data

Amittai Axelrod

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1607.04982 2017-09-01 cs.CL 79%

Dependency Language Models for Transition-based Dependency Parsing

Juntao Yu, Bernd Bohnet

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted by IWPT 2017

1708.06426 2017-08-23 cs.CL 79%

Cold Fusion: Training Seq2Seq Models Together with Language Models

Anuroop Sriram, Heewoo Jun, Sanjeev Satheesh, Adam Coates

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1703.10724 2017-06-21 cs.CL 79%

N-gram Language Modeling using Recurrent Neural Network Estimation

Ciprian Chelba, Mohammad Norouzi, Samy Bengio

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 10 pages, including references

1704.08960 2017-05-01 cs.CL 79%

Neural Word Segmentation with Rich Pretraining

Jie Yang, Yue Zhang, Fei Dong

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2017

1704.06986 2017-04-25 cs.CL 79%

Learning to Create and Reuse Words in Open-Vocabulary Neural Language Modeling

Kazuya Kawakami, Chris Dyer, Phil Blunsom

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments ACL 2017

1301.3614 2017-04-24 cs.CL 79%

Joint Space Neural Probabilistic Language Model for Statistical Machine Translation

Tsuyoshi Okita

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1703.08068 2017-03-24 cs.CL 79%

Sequential Recurrent Neural Networks for Language Modeling

Youssef Oualil, Clayton Greenberg, Mittul Singh, Dietrich Klakow

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments published (INTERSPEECH 2016), 5 pages, 3 figures, 4 tables

1506.03412 2017-02-23 cs.LG cs.CV cs.NE math.OC stat.ML 79%

Convergence rates for pretraining and dropout: Guiding learning parameters using network structure

Vamsi K. Ithapu, Sathya Ravi, Vikas Singh

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments This manuscript is now superseded by arXiv:1511.05297 and the corresponding accepted paper in 54th Allerton Conference on Communication, Control and Computing (2017)

1701.07880 2017-01-30 cs.CL 79%

emLam -- a Hungarian Language Modeling baseline

Dávid Márk Nemeskey

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Additional resources: - the emLam repository: https://github.com/DavidNemeskey/emLam - the emLam corpus: http://hlt.bme.hu/en/resources/emLam

Journal ref In Proceedings of the 13th Conference on Hungarian Computational Linguistics (MSZNY), pp. 91-102. Szeged, 2017

1701.04056 2017-01-17 cs.CL 79%

Dialog Context Language Modeling with Recurrent Neural Networks

Bing Liu, Ian Lane

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at ICASSP 2017

1611.00196 2016-12-15 cs.CL 79%

Recurrent Neural Network Language Model Adaptation Derived Document Vector

Wei Li, Brian Kan Wing Mak

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1612.03266 2016-12-13 cs.CL 79%

A Character-Word Compositional Neural Language Model for Finnish

Matti Lankinen, Hannes Heikinheimo, Pyry Takala, Tapani Raiko, Juha Karhunen

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

cmp-lg/9503011 2016-08-30 cmp-lg cs.CL 79%

Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies

John McMahon, F. J. Smith

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 17 Page Paper. Self-extracting PostScript File

1602.07803 2016-02-26 cs.CL 79%

Automated Word Prediction in Bangla Language Using Stochastic Language Models

Md. Masudul Haque, Md. Tarek Habib, Md. Mokhlesur Rahman

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments in International Journal in Foundations of Computer Science & Technology (IJFCST) Vol.5, No.6, November 2015

1511.01574 2016-02-23 cs.CL 79%

Multinomial Loss on Held-out Data for the Sparse Non-negative Matrix Language Model

Ciprian Chelba, Fernando Pereira

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1511.03729 2015-12-29 cs.CL 79%

Larger-Context Language Modelling

Tian Wang, Kyunghyun Cho

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1504.08183 2015-05-01 cs.CL 79%

Texts in, meaning out: neural language models in semantic similarity task for Russian

Andrey Kutuzov, Igor Andreev

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the Dialog 2015 Conference. Moscow, Russia

1405.3515 2014-08-26 cs.CL 79%

Temporal Analysis of Language through Neural Language Models

Yoon Kim, Yi-I Chiu, Kentaro Hanaki, Darshan Hegde, Slav Petrov

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Journal ref Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science. June, 2014. 61--65

1312.5813 2014-06-10 cs.LG cs.NE 79%

Unsupervised Pretraining Encourages Moderate-Sparseness

Jun Li, Wei Luo, Jian Yang, Xiaotong Yuan

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments 6 pages, 2 figures, (to appear) ICML-Workshop on Unsupervised Learning from Bioacoustic Big Data (uLearnBio) 2014

1404.3377 2014-04-15 cs.CL 79%

A Generalized Language Model as the Combination of Skipped n-grams and Modified Kneser-Ney Smoothing

Rene Pickhardt, Thomas Gottron, Martin Körner, Paul Georg Wagner, Till Speicher, Steffen Staab

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 13 pages, 2 figures, ACL 2014

cs/0405044 2009-12-01 cs.IR cs.CL 79%

Corpus structure, language models, and ad hoc information retrieval

Oren Kurland, Lillian Lee

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments To appear, SIGIR 2004

1. 预训练与数据 12403 篇

Improved training of neural trans-dimensional random field language models with dynamic noise-contrastive estimation

Building Language Models for Text with Named Entities

Automatic speech recognition for launch control center communication using recurrent neural networks with data augmentation and custom language model

Language Modeling for Code-Switched Data: Challenges and Approaches

Sentence Correction Based on Large-scale Language Modelling

Syntactic and Semantic Features For Code-Switching Factored Language Models

Counterfactual Language Model Adaptation for Suggesting Phrases

Language Models of Spoken Dutch

Cynical Selection of Language Model Training Data

Dependency Language Models for Transition-based Dependency Parsing

Cold Fusion: Training Seq2Seq Models Together with Language Models

N-gram Language Modeling using Recurrent Neural Network Estimation

Neural Word Segmentation with Rich Pretraining

Learning to Create and Reuse Words in Open-Vocabulary Neural Language Modeling

Joint Space Neural Probabilistic Language Model for Statistical Machine Translation

Sequential Recurrent Neural Networks for Language Modeling

Convergence rates for pretraining and dropout: Guiding learning parameters using network structure

emLam -- a Hungarian Language Modeling baseline

Dialog Context Language Modeling with Recurrent Neural Networks

Recurrent Neural Network Language Model Adaptation Derived Document Vector

A Character-Word Compositional Neural Language Model for Finnish

Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies

Automated Word Prediction in Bangla Language Using Stochastic Language Models

Multinomial Loss on Held-out Data for the Sparse Non-negative Matrix Language Model

Larger-Context Language Modelling

Texts in, meaning out: neural language models in semantic similarity task for Russian

Temporal Analysis of Language through Neural Language Models

Unsupervised Pretraining Encourages Moderate-Sparseness

A Generalized Language Model as the Combination of Skipped n-grams and Modified Kneser-Ney Smoothing

Corpus structure, language models, and ad hoc information retrieval