语言大模型 / LLM - arXivDaily 专题

2007.04249 2020-07-23 cs.CL cs.IR cs.LG stat.ML 62%

Cooking Is All About People: Comment Classification On Cookery Channels Using BERT and Classification Models (Malayalam-English Mix-Code)

Subramaniam Kazhuparambil, Abhishek Kaushik

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Rectified typos

2007.09757 2020-07-21 cs.CL cs.LG 62%

Mono vs Multilingual Transformer-based Models: a Comparison across Several Language Tasks

Diego de Vargas Feijo, Viviane Pereira Moreira

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2004.13432 2020-07-21 cs.CL cs.LG 62%

Kungfupanda at SemEval-2020 Task 12: BERT-Based Multi-Task Learning for Offensive Language Detection

Wenliang Dai, Tiezheng Yu, Zihan Liu, Pascale Fung

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Submitted to SemEval-2020 Workshop

1911.03829 2020-07-21 cs.CL cs.LG 62%

Distilling Knowledge Learned in BERT for Text Generation

Yen-Chun Chen, Zhe Gan, Yu Cheng, Jingzhou Liu, Jingjing Liu

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments ACL 2020

2006.13561 2020-06-25 cs.LG cs.CL stat.ML 62%

Differentiable Window for Dynamic Local Attention

Thanh-Tung Nguyen, Xuan-Phi Nguyen, Shafiq Joty, Xiaoli Li

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACL 2020

1910.04345 2020-06-19 cs.CL cs.LG 62%

FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams

Wanzheng Zhu, Hongyu Gong, Jiaming Shen, Chao Zhang, Jingbo Shang, Suma Bhat, Jiawei Han

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2002.05442 2020-06-16 cs.SE cs.AI cs.LG 62%

Deep Learning for Source Code Modeling and Generation: Models, Applications and Challenges

Triet H. M. Le, Hao Chen, M. Ali Babar

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

Journal ref ACM Comput. Surv., 53, 3 (2020), Article 62

2006.01538 2020-06-03 cs.CL cs.LG 62%

WikiBERT models: deep transfer learning for many languages

Sampo Pyysalo, Jenna Kanerva, Antti Virtanen, Filip Ginter

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 1 figure

2005.10049 2020-05-21 eess.AS cs.CL cs.LG cs.SD stat.ML 62%

Early Stage LM Integration Using Local and Global Log-Linear Combination

Wilfried Michel, Ralf Schlüter, Hermann Ney

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Submitted to Interspeech 2020

2005.04511 2020-05-21 cs.CL cs.LG 62%

Finding Universal Grammatical Relations in Multilingual BERT

Ethan A. Chi, John Hewitt, Christopher D. Manning

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments To appear in ACL 2020; Farsi typo corrected

1908.05646 2020-05-19 cs.CL cs.LG 62%

SenseBERT: Driving Some Sense into BERT

Yoav Levine, Barak Lenz, Or Dagan, Ori Ram, Dan Padnos, Or Sharir, Shai Shalev-Shwartz, Amnon Shashua, Yoav Shoham

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2020

1910.02893 2020-05-18 cs.CL cs.LG 62%

Parallel Iterative Edit Models for Local Sequence Transduction

Abhijeet Awasthi, Sunita Sarawagi, Rasna Goyal, Sabyasachi Ghosh, Vihari Piratla

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at EMNLP-IJCNLP 2019

2005.02794 2020-05-12 stat.ML cs.AI cs.LG 62%

Token Manipulation Generative Adversarial Network for Text Generation

DaeJin Jo

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

Comments 5 pages, 2 figures

2005.00702 2020-05-05 cs.CL cs.IR cs.LG 62%

A Girl Has A Name: Detecting Authorship Obfuscation

Asad Mahmood, Zubair Shafiq, Padmini Srinivasan

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 4 figures, 2 tables, ACL 2020

1912.13080 2020-05-01 cs.IR cs.CL cs.LG 62%

Teaching a New Dog Old Tricks: Resurrecting Multilingual Retrieval Using Zero-shot Learning

Sean MacAvaney, Luca Soldaini, Nazli Goharian

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments ECIR 2020 (short)

2004.08900 2020-04-21 cs.CL cs.LG cs.NE 62%

The Cost of Training NLP Models: A Concise Overview

Or Sharir, Barak Peleg, Yoav Shoham

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2003.03239 2020-04-08 cs.CL cs.AI 62%

On the Role of Conceptualization in Commonsense Knowledge Graph Construction

Mutian He, Yangqiu Song, Kun Xu, Dong Yu

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 4 figures

2004.01655 2020-04-06 cs.CL cs.LG stat.ML 62%

Aligned Cross Entropy for Non-Autoregressive Machine Translation

Marjan Ghazvininejad, Vladimir Karpukhin, Luke Zettlemoyer, Omer Levy

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2004.00248 2020-04-02 cs.CL cs.LG 62%

Adversarial Transfer Learning for Punctuation Restoration

Jiangyan Yi, Jianhua Tao, Ye Bai, Zhengkun Tian, Cunhang Fan

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2003.11530 2020-03-26 cs.CL cs.LG stat.ML 62%

Meta-CoTGAN: A Meta Cooperative Training Paradigm for Improving Adversarial Text Generation

Haiyan Yin, Dingcheng Li, Xu Li, Ping Li

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

1905.11978 2020-02-25 cs.LG cs.CL stat.ML 62%

Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer

Yanshuai Cao, Peng Xu

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Camera-ready for AISTATS 2020

1909.05830 2020-02-24 cs.LG cs.AI cs.CR stat.ML 62%

Differentially Private Meta-Learning

Jeffrey Li, Mikhail Khodak, Sebastian Caldas, Ameet Talwalkar

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

1912.09257 2020-02-18 cs.CL cs.LG eess.AS 62%

Generating Synthetic Audio Data for Attention-Based Speech Recognition Systems

Nick Rossenbach, Albert Zeyer, Ralf Schlüter, Hermann Ney

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted to ICASSP 2020

2002.04723 2020-02-13 cs.LG cs.CL stat.ML 62%

Superbloom: Bloom filter meets Transformer

John Anderson, Qingqing Huang, Walid Krichene, Steffen Rendle, Li Zhang

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

1909.09656 2020-01-29 cs.LG cs.AI cs.CV stat.ML 62%

Understanding and Robustifying Differentiable Architecture Search

Arber Zela, Thomas Elsken, Tonmoy Saikia, Yassine Marrakchi, Thomas Brox, Frank Hutter

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

Comments In: International Conference on Learning Representations (ICLR 2020); 28 pages, 30 figures

2001.08785 2020-01-27 cs.CL cs.LG stat.ML 62%

Semi-Autoregressive Training Improves Mask-Predict Decoding

Marjan Ghazvininejad, Omer Levy, Luke Zettlemoyer

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2001.03521 2020-01-13 cs.CL cs.AI 62%

Towards Minimal Supervision BERT-based Grammar Error Correction

Yiyuan Li, Antonios Anastasopoulos, Alan W Black

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

2001.01243 2020-01-07 cs.CL cs.LG 62%

Automatic Business Process Structure Discovery using Ordered Neurons LSTM: A Preliminary Study

Xue Han, Lianxue Hu, Yabin Dang, Shivali Agarwal, Lijun Mei, Shaochun Li, Xin Zhou

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

1904.04697 2019-12-19 cs.CL cs.AI 62%

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

Hang Yan, Xipeng Qiu, Xuanjing Huang

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at Transactions of the Association for Computational Linguistics (TACL)

1904.08779 2019-12-04 eess.AS cs.CL cs.LG cs.SD stat.ML 62%

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition

Daniel S. Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D. Cubuk, Quoc V. Le

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 5 pages, 3 figures, 6 tables; v3: references added

Journal ref Proc. Interspeech 2019, 2613-2617

1. 其他LLM 12321 篇

Cooking Is All About People: Comment Classification On Cookery Channels Using BERT and Classification Models (Malayalam-English Mix-Code)

Mono vs Multilingual Transformer-based Models: a Comparison across Several Language Tasks

Kungfupanda at SemEval-2020 Task 12: BERT-Based Multi-Task Learning for Offensive Language Detection

Distilling Knowledge Learned in BERT for Text Generation

Differentiable Window for Dynamic Local Attention

FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams

Deep Learning for Source Code Modeling and Generation: Models, Applications and Challenges

WikiBERT models: deep transfer learning for many languages

Early Stage LM Integration Using Local and Global Log-Linear Combination

Finding Universal Grammatical Relations in Multilingual BERT

SenseBERT: Driving Some Sense into BERT

Parallel Iterative Edit Models for Local Sequence Transduction

Token Manipulation Generative Adversarial Network for Text Generation

A Girl Has A Name: Detecting Authorship Obfuscation

Teaching a New Dog Old Tricks: Resurrecting Multilingual Retrieval Using Zero-shot Learning

The Cost of Training NLP Models: A Concise Overview

On the Role of Conceptualization in Commonsense Knowledge Graph Construction

Aligned Cross Entropy for Non-Autoregressive Machine Translation

Adversarial Transfer Learning for Punctuation Restoration

Meta-CoTGAN: A Meta Cooperative Training Paradigm for Improving Adversarial Text Generation

Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer

Differentially Private Meta-Learning

Generating Synthetic Audio Data for Attention-Based Speech Recognition Systems

Superbloom: Bloom filter meets Transformer

Understanding and Robustifying Differentiable Architecture Search

Semi-Autoregressive Training Improves Mask-Predict Decoding

Towards Minimal Supervision BERT-based Grammar Error Correction

Automatic Business Process Structure Discovery using Ordered Neurons LSTM: A Preliminary Study

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition