语言大模型 / LLM - arXivDaily 专题

2212.10408 2022-12-21 cs.CL 79%

Geographic and Geopolitical Biases of Language Models

Fahim Faisal, Antonios Anastasopoulos

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2205.12247 2022-11-30 cs.CL 79%

GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models

Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022. Code and data are released at https://github.com/WadeYin9712/GeoMLAMA/

2211.12677 2022-11-24 cs.CL 79%

Word-Level Representation From Bytes For Language Modeling

Chu-Tak Lee, Qipeng Guo, Xipeng Qiu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments preprint

2211.11678 2022-11-22 cs.CL 79%

Measuring Harmful Representations in Scandinavian Language Models

Samia Touileb, Debora Nozza

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at the 5th workshop on Natural Language Processing and Computational Social Science (NLP+CSS) at EMNLP 2022 in Abu Dhabi, Dec 7 2022

2211.08769 2022-11-17 cs.CL cs.IR 79%

RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models

Shitao Xiao, Zheng Liu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2211.04079 2022-11-09 cs.CL 79%

COPEN: Probing Conceptual Knowledge in Pre-trained Language Models

Hao Peng, Xiaozhi Wang, Shengding Hu, Hailong Jin, Lei Hou, Juanzi Li, Zhiyuan Liu, Qun Liu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2022

2210.12378 2022-11-01 cs.CL 79%

Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling

Vidhisha Balachandran, Hannaneh Hajishirzi, William W. Cohen, Yulia Tsvetkov

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2204.07367 2022-10-31 cs.CL 79%

On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

Zebin Ou, Meishan Zhang, Yue Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments COLING 2022

2210.14328 2022-10-27 cs.CL 79%

Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models

Aaron Mueller, Yu Xia, Tal Linzen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to CoNLL 2022

2210.13181 2022-10-25 cs.CL 79%

The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative

Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2210.03575 2022-10-25 cs.CL 79%

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

Emmy Liu, Graham Neubig

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2205.10964 2022-10-25 cs.CL 79%

The Geometry of Multilingual Language Model Representations

Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2022

2210.10293 2022-10-20 cs.CL 79%

Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning

Hongqiu Wu, Ruixue Ding, Hai Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 (findings)

2206.06583 2022-10-18 q-bio.QM cs.AI 79%

Exploring evolution-aware & -free protein language models as protein function predictors

Mingyang Hu, Fajie Yuan, Kevin K. Yang, Fusong Ju, Jin Su, Hui Wang, Fei Yang, Qiuyang Ding

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

2204.12130 2022-10-14 cs.CL 79%

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

Mor Geva, Avi Caciularu, Guy Dar, Paul Roit, Shoval Sadde, Micah Shlain, Bar Tamir, Yoav Goldberg

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 System Demonstrations

2209.09406 2022-09-21 cond-mat.mtrl-sci cs.LG physics.chem-ph 79%

Probabilistic Generative Transformer Language models for Generative Design of Molecules

Lai Wei, Nihang Fu, Yuqi Song, Qian Wang, Jianjun Hu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments 13 pages

2209.08982 2022-09-20 cs.CL 79%

How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?

Lovisa Hagström, Richard Johansson

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2209.04811 2022-09-13 cs.CL 79%

Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models

David K. Yi, James V. Bruno, Jiayu Han, Peter Zukerman, Shane Steinert-Threlkeld

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 8 pages, 6 figures

2208.12539 2022-09-01 cs.CL 79%

Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models

Tianyi Li, Wenyu Huang, Nikos Papasarantopoulos, Pavlos Vougiouklis, Jeff Z. Pan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear in ISWC 2022

2208.08263 2022-08-18 cs.NE cs.AI cs.MM 79%

Multimodal foundation models are better simulators of the human brain

Haoyu Lu, Qiongyi Zhou, Nanyi Fei, Zhiwu Lu, Mingyu Ding, Jingyuan Wen, Changde Du, Xin Zhao, Hao Sun, Huiguang He, Ji-Rong Wen

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.AI

2206.14017 2022-08-09 cs.CL 79%

Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing

Lihan Wang, Bowen Qin, Binyuan Hui, Bowen Li, Min Yang, Bailin Wang, Binhua Li, Fei Huang, Luo Si, Yongbin Li

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at KDD 2022

2207.07706 2022-07-19 cs.CL cs.IR cs.PL 79%

Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis

Shounak Naik, Rajaswa Patil, Swati Agarwal, Veeky Baths

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Under review at ADMA 2022

2207.06897 2022-07-15 cs.CL 79%

Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language

Rita Sevastjanova, Mennatallah El-Assady

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2106.09063 2022-06-22 cs.CL 79%

Specializing Multilingual Language Models: An Empirical Study

Ethan C. Chau, Noah A. Smith

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Workshop on Multilingual Representation Learning (MRL) 2021

Journal ref Workshop on Multilingual Representation Learning (2021) 51-61

2205.01917 2022-06-15 cs.CV cs.LG cs.MM 79%

CoCa: Contrastive Captioners are Image-Text Foundation Models

Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mojtaba Seyedhosseini, Yonghui Wu

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.LG

Comments Preprint

2206.04935 2022-06-13 cs.CL 79%

Sort by Structure: Language Model Ranking as Dependency Probing

Max Müller-Eberstein, Rob van der Goot, Barbara Plank

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2022 (Main Conference)

2205.13708 2022-05-30 cs.CL 79%

HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models

Minghuan Tan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2110.08173 2022-05-24 cs.CL 79%

Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

Zaiqiao Meng, Fangyu Liu, Ehsan Shareghi, Yixuan Su, Charlotte Collins, Nigel Collier

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2022; code and data are released at https://github.com/cambridgeltl/medlama

2112.08787 2022-05-04 cs.CL 79%

AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models

Yue Yu, Lingkai Kong, Jieyu Zhang, Rongzhi Zhang, Chao Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments NAACL 2022 Main Conference (Code: https://github.com/yueyu1030/actune)

Journal ref NAACL 2022

2108.11857 2022-04-28 cs.CL 79%

Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition

Elena V. Epure, Romain Hennequin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication in LREC2022

1. 知识编辑与模型理解 7596 篇

Geographic and Geopolitical Biases of Language Models

GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models

Word-Level Representation From Bytes For Language Modeling

Measuring Harmful Representations in Scandinavian Language Models

RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models

COPEN: Probing Conceptual Knowledge in Pre-trained Language Models

Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling

On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models

The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

The Geometry of Multilingual Language Model Representations

Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning

Exploring evolution-aware & -free protein language models as protein function predictors

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

Probabilistic Generative Transformer Language models for Generative Design of Molecules

How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?

Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models

Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models

Multimodal foundation models are better simulators of the human brain

Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing

Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis

Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language

Specializing Multilingual Language Models: An Empirical Study

CoCa: Contrastive Captioners are Image-Text Foundation Models

Sort by Structure: Language Model Ranking as Dependency Probing

HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models

Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models

Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition