语言大模型 / LLM - arXivDaily 专题

2104.05544 2021-06-18 cs.CL cs.SD eess.AS stat.ML 79%

Investigating Methods to Improve Language Model Integration for Attention-based Encoder-Decoder ASR Models

Mohammad Zeineldeen, Aleksandr Glushko, Wilfried Michel, Albert Zeyer, Ralf Schlüter, Hermann Ney

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments accepted to Interspeech 2021

2106.08689 2021-06-17 cs.CL cs.SD eess.AS 79%

Alzheimer's Disease Detection from Spontaneous Speech through Combining Linguistic Complexity and (Dis)Fluency Features with Pretrained Language Models

Yu Qiao, Xuefeng Yin, Daniel Wiechmann, Elma Kerz

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments accepted at Interspeech2021

2106.07947 2021-06-16 cs.CL 79%

Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection

Yixiao Wang, Zied Bouraoui, Luis Espinosa Anke, Steven Schockaert

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2106.05505 2021-06-11 cs.CL 79%

Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models

Tyler A. Chang, Yifan Xu, Weijian Xu, Zhuowen Tu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL-IJCNLP 2021

2106.02171 2021-06-07 cs.CL 79%

nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?

Mihir Kale, Aditya Siddhant, Noah Constant, Melvin Johnson, Rami Al-Rfou, Linting Xue

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at ACL-IJCNLP 2021

2101.09469 2021-06-04 cs.CL 79%

Training Multilingual Pre-trained Language Model with Byte-level Subwords

Junqiu Wei, Qun Liu, Yinpeng Guo, Xin Jiang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2106.01044 2021-06-03 cs.CL 79%

Examining the Inductive Bias of Neural Language Models with Artificial Languages

Jennifer C. White, Ryan Cotterell

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2021

2102.01017 2021-06-01 cs.CL 79%

Measuring and Improving Consistency in Pretrained Language Models

Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to the TACL journal, pre-MIT Press publication version

2104.07204 2021-05-31 cs.CL 79%

Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models

Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang, Dongyan Zhao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2021, 16 pages, https://github.com/alibaba/AliceMind/tree/main/LatticeBERT

2105.04688 2021-05-12 cs.CL 79%

Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models

Laura Pérez-Mayos, Alba Táboas García, Simon Mille, Leo Wanner

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To be published in Findings of ACL 2021

2104.10259 2021-05-07 cs.CL cs.CY 79%

Analyzing COVID-19 Tweets with Transformer-based Language Models

Philip Feldman, Sim Tiwari, Charissa S. L. Cheah, James R. Foulds, Shimei Pan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Six pages, six tables, four figures

2105.00908 2021-05-06 cs.CL 79%

Impact of Gender Debiased Word Embeddings in Language Modeling

Christine Basta, Marta R. Costa-jussà

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 9 pages, 2 figures, 6 tables, accepted in 20th International Conference on Intelligent Text Processing and Computational Linguistics, CICLing 2019. To be published in Springer LNCS volume

2104.12369 2021-04-27 cs.CL 79%

PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Wei Zeng, Xiaozhe Ren, Teng Su, Hui Wang, Yi Liao, Zhiwei Wang, Xin Jiang, ZhenZhang Yang, Kaisheng Wang, Xiaoda Zhang, Chen Li, Ziyan Gong, Yifan Yao, Xinjing Huang, Jun Wang, Jianfeng Yu, Qi Guo, Yue Yu, Yan Zhang, Jin Wang, Hengtao Tao, Dasen Yan, Zexuan Yi, Fang Peng, Fangqing Jiang, Han Zhang, Lingfeng Deng, Yehong Zhang, Zhe Lin, Chao Zhang, Shaojie Zhang, Mingyue Guo, Shanzhi Gu, Gaojun Fan, Yaowei Wang, Xuefeng Jin, Qun Liu, Yonghong Tian

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments The technique report for PanGu-$α$

2104.09833 2021-04-21 cs.CL 79%

Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Model

Honai Ueoka, Yugo Murawaki, Sadao Kurohashi

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 7 pages, 4 firgures

2104.05115 2021-04-13 cs.CL 79%

Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models

James Y. Huang, Kuan-Hao Huang, Kai-Wei Chang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments NAACL 2021

2104.03474 2021-04-09 cs.CL 79%

Revisiting Simple Neural Probabilistic Language Models

Simeng Sun, Mohit Iyyer

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To appear at NAACL 2021

2007.07834 2021-04-08 cs.CL 79%

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments NAACL 2021

2103.14580 2021-03-29 cs.CL 79%

Correcting Automated and Manual Speech Transcription Errors using Warped Language Models

Mahdi Namazifar, John Malik, Li Erran Li, Gokhan Tur, Dilek Hakkani Tür

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Submitted to INTERSPEECH

2012.06717 2021-03-19 cs.CL 79%

Mapping the Timescale Organization of Neural Language Models

Hsiang-Yun Sherry Chien, Jinhan Zhang, Christopher. J. Honey

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 23 pages, 4 main figures, 10 appendix figures; published as a conference paper at ICLR 2021

2103.07875 2021-03-16 cs.CL 79%

Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation

Heewoong Park, Sukhyun Cho, Jonghun Park

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 8 pages, 1 figures, 3 figures

2102.10958 2021-02-23 cs.CL 79%

Bilingual Language Modeling, A transfer learning technique for Roman Urdu

Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2102.06391 2021-02-16 cs.HC cs.CL 79%

Multiversal views on language models

Laria Reynolds, Kyle McDonell

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 10 pages, 7 figures

2102.04310 2021-02-09 cs.CL 79%

The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point

Magnus Sahlgren, Fredrik Carlsson

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2102.00894 2021-02-02 cs.CL 79%

Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models

Nora Kassner, Philipp Dufter, Hinrich Schütze

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to EACL 2021

2101.10448 2021-01-27 cs.CL 79%

PolyLM: Learning about Polysemy through Language Modeling

Alan Ansell, Felipe Bravo-Marquez, Bernhard Pfahringer

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EACL 2021

2101.03204 2021-01-12 cs.CL 79%

Misspelling Correction with Pre-trained Contextual Language Model

Yifei Hu, Xiaonan Jing, Youlim Ko, Julia Taylor Rayz

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted by 2020 IEEE 19th International Conference on Cognitive Informatics & Cognitive Computing (ICCI* CC). IEEE

2012.15070 2021-01-01 cs.CL 79%

Enhancing Pre-trained Language Model with Lexical Simplification

Rongzhou Bao, Jiayi Wang, Zhuosheng Zhang, Hai Zhao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2010.02448 2020-12-17 cs.CL 79%

On the Branching Bias of Syntax Extracted from Pre-trained Language Models

Huayang Li, Lemao Liu, Guoping Huang, Shuming Shi

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2020 findings

Journal ref EMNLP 2020 Findings

2011.06754 2020-11-16 cs.CL 79%

Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning

Morteza Rohanian, Julian Hough

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Journal ref The 28th International Conference on Computational Linguistics (COLING 2020)

2011.06056 2020-11-13 cs.CL 79%

Text Augmentation for Language Models in High Error Recognition Scenario

Karel Beneš, Lukáš Burget

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

1. 其他LLM 12169 篇

Investigating Methods to Improve Language Model Integration for Attention-based Encoder-Decoder ASR Models

Alzheimer's Disease Detection from Spontaneous Speech through Combining Linguistic Complexity and (Dis)Fluency Features with Pretrained Language Models

Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection

Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models

nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?

Training Multilingual Pre-trained Language Model with Byte-level Subwords

Examining the Inductive Bias of Neural Language Models with Artificial Languages

Measuring and Improving Consistency in Pretrained Language Models

Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models

Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models

Analyzing COVID-19 Tweets with Transformer-based Language Models

Impact of Gender Debiased Word Embeddings in Language Modeling

PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Model

Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models

Revisiting Simple Neural Probabilistic Language Models

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

Correcting Automated and Manual Speech Transcription Errors using Warped Language Models

Mapping the Timescale Organization of Neural Language Models

Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation

Bilingual Language Modeling, A transfer learning technique for Roman Urdu

Multiversal views on language models

The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point

Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models

PolyLM: Learning about Polysemy through Language Modeling

Misspelling Correction with Pre-trained Contextual Language Model

Enhancing Pre-trained Language Model with Lexical Simplification

On the Branching Bias of Syntax Extracted from Pre-trained Language Models

Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning

Text Augmentation for Language Models in High Error Recognition Scenario