语言大模型 / LLM - arXivDaily 专题

2205.06910 2022-05-17 cs.CL 79%

A Property Induction Framework for Neural Language Models

Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments CogSci 2022 camera ready version, with hyperref-compatible citations. Code and Supplemental Material can be found in https://github.com/kanishkamisra/lm-induction

2205.06644 2022-05-16 cs.CL 79%

Controlling Translation Formality Using Pre-trained Multilingual Language Models

Elijah Rippeth, Sweta Agrawal, Marine Carpuat

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 9 pages, 2 figures, IWSLT22 camera-ready (system paper @ ACL-IWSLT Shared Task on Formality Control for Spoken Language Translation)

2205.06149 2022-05-13 cs.CL 79%

Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?

Lukas Thoma, Benjamin Roth

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2205.05296 2022-05-12 cs.LG 79%

Subspace Learning Machine (SLM): Methodology and Performance

Hongyu Fu, Yijing Yang, Vinod K. Mishra, C. -C. Jay Kuo

专题命中其他LLM ：SLM(title,abstract)；分类 cs.LG

2104.12250 2022-05-12 cs.CL 79%

XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond

Francesco Barbieri, Luis Espinosa Anke, Jose Camacho-Collados

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments LREC 2022. Code and data available at https://github.com/cardiffnlp/xlm-t

2204.10281 2022-05-04 cs.CL 79%

How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns

Stephanie Brandl, Ruixiang Cui, Anders Søgaard

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To appear at NAACL 2022

2204.13309 2022-04-29 cs.CL 79%

Improving robustness of language models from a geometry-aware perspective

Bin Zhu, Zhaoquan Gu, Le Wang, Jinyin Chen, Qi Xuan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments accepted at Findings of ACL 2022

2204.11134 2022-04-26 cs.RO cs.AI 79%

Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation?

Yuchen Cui, Scott Niekum, Abhinav Gupta, Vikash Kumar, Aravind Rajeswaran

专题命中其他LLM ：foundation model(title,abstract)；分类 cs.AI

Comments 30 pages with appendix, published as a conference paper at L4DC 2022

2204.07483 2022-04-21 cs.CL cs.CY 79%

Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models

Philip Feldman, Aaron Dant, James R. Foulds, Shemei Pan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 10 pages, 9 figures, 7 tables

2204.08644 2022-04-20 cs.CL 79%

Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion

Shunsuke Kando, Hiroshi Noji, Yusuke Miyao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To appear in the 6th ACL Workshop on Structured Prediction for NLP (SPNLP)

2106.16138 2022-04-20 cs.CL 79%

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments ACL-2022

2204.07746 2022-04-19 cs.CL 79%

Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models

Keigo Takahashi, Danushka Bollegala

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2204.06145 2022-04-14 cs.CL 79%

HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection

Zheng Chu, Ziqing Yang, Yiming Cui, Zhigang Chen, Ming Liu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 6 pages; SemEval-2022 Task 2

2204.05717 2022-04-13 cs.CL 79%

Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change

Mario Giulianelli, Andrey Kutuzov, Lidia Pivovarova

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 3rd International Workshop on Computational Approaches to Historical Language Change 2022 (LChange'22)

2203.16747 2022-04-01 cs.CL 79%

How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis

Shaobo Li, Xiaoguang Li, Lifeng Shang, Zhenhua Dong, Chengjie Sun, Bingquan Liu, Zhenzhou Ji, Xin Jiang, Qun Liu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at Findings of ACL 2022

2203.15917 2022-03-31 cs.CL 79%

Shallow Fusion of Weighted Finite-State Transducer and Language Model for Text Normalization

Evelina Bakhturina, Yang Zhang, Boris Ginsburg

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2203.10692 2022-03-22 cs.CL 79%

Better Language Model with Hypernym Class Prediction

He Bai, Tong Wang, Alessandro Sordoni, Peng Shi

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments ACL 2022

2203.10315 2022-03-22 cs.CL 79%

Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging

Houquan Zhou, Yang Li, Zhenghua Li, Min Zhang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accept to Findings of ACL 2022

2203.10256 2022-03-22 cs.CL 79%

Dependency-based Mixture Language Models

Zhixian Yang, Xiaojun Wan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2022 Main Conference

2101.00036 2022-03-18 cs.CL 79%

KART: Parameterization of Privacy Leakage Scenarios from Pre-trained Language Models

Yuta Nakamura, Shouhei Hanaoka, Yukihiro Nomura, Naoto Hayashi, Osamu Abe, Shuntaro Yada, Shoko Wakamiya, Eiji Aramaki

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2203.08430 2022-03-17 cs.CL 79%

Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure

Yuan Chai, Yaobo Liang, Nan Duan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments ACL 2022

2203.08308 2022-03-17 cs.CL 79%

Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction

Kuan-Hao Huang, I-Hung Hsu, Premkumar Natarajan, Kai-Wei Chang, Nanyun Peng

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments ACL 2022. Our code is available at https://github.com/PlusLabNLP/X-Gear

2203.06906 2022-03-15 cs.CL 79%

PERT: Pre-training BERT with Permuted Language Model

Yiming Cui, Ziqing Yang, Ting Liu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 14 pages

2202.07894 2022-02-17 cs.CL cs.SD eess.AS 79%

Knowledge Transfer from Large-scale Pretrained Language Models to End-to-end Speech Recognizers

Yotaro Kubo, Shigeki Karita, Michiel Bacchiani

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To be presented in ICASSP 2022

2202.04145 2022-02-10 cs.AI cs.IR 79%

Using a Language Model in a Kiosk Recommender System at Fast-Food Restaurants

Eduard Zubchuk, Dmitry Menshikov, Nikolay Mikhaylovskiy

专题命中其他LLM ：language model(title,abstract)；分类 cs.AI

2202.03907 2022-02-09 cs.LG 79%

Context-Aware Discrimination Detection in Job Vacancies using Computational Language Models

S. Vethman, A. Adhikari, M. H. T. de Boer, J. A. G. M. van Genabeek, C. J. Veenman

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments 17 pages, 2 figures

2110.02870 2022-02-02 cs.CL cs.SE 79%

Capturing Structural Locality in Non-parametric Language Models

Frank F. Xu, Junxian He, Graham Neubig, Vincent J. Hellendoorn

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments ICLR 2022

2112.00114 2022-01-02 cs.LG cs.NE 79%

Show Your Work: Scratchpads for Intermediate Computation with Language Models

Maxwell Nye, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, Charles Sutton, Augustus Odena

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

2112.07782 2021-12-16 q-bio.BM cs.LG 79%

Deciphering antibody affinity maturation with language models and weakly supervised learning

Jeffrey A. Ruffolo, Jeffrey J. Gray, Jeremias Sulam

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments Presented at Machine Learning for Structural Biology Workshop, NeurIPS 2021

2110.15704 2021-11-01 cs.CL cs.SD eess.AS 79%

Influence of ASR and Language Model on Alzheimer's Disease Detection

Joan Codina-Filbà, Guillermo Cámbara, Jordi Luque, Mireia Farrús

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 5 pages. Submitted to Interspeech 2021. arXiv admin note: text overlap with arXiv:2011.09272

1. 其他LLM 12193 篇

A Property Induction Framework for Neural Language Models

Controlling Translation Formality Using Pre-trained Multilingual Language Models

Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?

Subspace Learning Machine (SLM): Methodology and Performance

XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond

How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns

Improving robustness of language models from a geometry-aware perspective

Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation?

Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models

Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models

HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection

Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change

How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis

Shallow Fusion of Weighted Finite-State Transducer and Language Model for Text Normalization

Better Language Model with Hypernym Class Prediction

Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging

Dependency-based Mixture Language Models

KART: Parameterization of Privacy Leakage Scenarios from Pre-trained Language Models

Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure

Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction

PERT: Pre-training BERT with Permuted Language Model

Knowledge Transfer from Large-scale Pretrained Language Models to End-to-end Speech Recognizers

Using a Language Model in a Kiosk Recommender System at Fast-Food Restaurants

Context-Aware Discrimination Detection in Job Vacancies using Computational Language Models

Capturing Structural Locality in Non-parametric Language Models

Show Your Work: Scratchpads for Intermediate Computation with Language Models

Deciphering antibody affinity maturation with language models and weakly supervised learning

Influence of ASR and Language Model on Alzheimer's Disease Detection