语言大模型 / LLM - arXivDaily 专题

2204.03162 2022-04-26 cs.CV cs.CL 79%

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments CVPR 2022

2204.06201 2022-04-14 cs.CL 79%

Probing for Constituency Structure in Neural Language Models

David Arps, Younes Samih, Laura Kallmeyer, Hassan Sajjad

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 20 pages, 9 Figures, 9 tables

2204.04163 2022-04-11 cs.CL 79%

Contextual Representation Learning beyond Masked Language Modeling

Zhiyi Fu, Wangchunshu Zhou, Jingjing Xu, Hao Zhou, Lei Li

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2022

2204.02130 2022-04-07 q-bio.GN cs.LG 79%

SemanticCAP: Chromatin Accessibility Prediction Enhanced by Features Learning from a Language Model

Yikang Zhang, Xiaomin Chu, Yelu Jiang, Hongjie Wu, Lijun Quan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

2203.14139 2022-03-29 cs.CL 79%

Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages

Ehsan Aghazadeh, Mohsen Fayyaz, Yadollah Yaghoobzadeh

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2022 (main conference)

2203.07860 2022-03-22 cs.CL 79%

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Long paper accepted by ACL main conference. 17 pages

2202.06840 2022-02-15 cs.SE cs.AI 79%

What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code

Yao Wan, Wei Zhao, Hongyu Zhang, Yulei Sui, Guandong Xu, Hai Jin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

Comments Accepted by ICSE 2022 (The 44th International Conference on Software Engineering)

2111.12174 2021-11-25 cs.CL 79%

Using Distributional Principles for the Semantic Study of Contextual Language Models

Olivier Ferret

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments PACLIC 35

2104.08768 2021-11-18 cs.CL 79%

Constrained Language Models Yield Few-Shot Semantic Parsers

Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Benjamin Van Durme

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2021. Code is available at https://github.com/microsoft/semantic_parsing_with_constrained_lm

2011.14039 2021-09-28 cs.CL 79%

An Investigation of Language Model Interpretability via Sentence Editing

Samuel Stevens, Yu Su

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 9 figures. Accepted at EMNLP BlackboxNLP 2021

2109.07848 2021-09-17 cs.CL 79%

The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation

Laura Aina, Tal Linzen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear in Proceedings of BlackboxNLP 2021: Analyzing and Interpreting Neural Networks for NLP

2109.02772 2021-09-14 cs.AI 79%

An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

Tianxing He, Kyunghyun Cho, James Glass

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

2106.04832 2021-06-10 cs.CL 79%

Probing Multilingual Language Models for Discourse

Murathan Kurfalı, Robert Östling

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To be presented at RepL4NLP 2021

2005.10089 2021-04-22 eess.AS cs.CL cs.SD 79%

Investigation of Large-Margin Softmax in Neural Language Modeling

Jingjing Huo, Yingbo Gao, Weiyue Wang, Ralf Schlüter, Hermann Ney

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Proceedings of INTERSPEECH 2020

2104.07578 2021-04-16 cs.CL 79%

Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models

Matteo Alleman, Jonathan Mamou, Miguel A Del Rio, Hanlin Tang, Yoon Kim, SueYeon Chung

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 7 figures

2104.05882 2021-04-14 cs.CL 79%

Discourse Probing of Pretrained Language Models

Fajri Koto, Jey Han Lau, Timothy Baldwin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2021

2005.00619 2021-04-14 cs.CL cs.CV 79%

Probing Contextual Language Models for Common Ground with Visual Representations

Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the 2021 North American Chapter of the Association for Computational Linguistics (NAACL 2021)

1912.00239 2021-03-05 cs.CL 79%

Neural language modeling of free word order argument structure

Charlotte Rochereau, Benoît Sagot, Emmanuel Dupoux

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2102.10848 2021-02-23 cs.CL 79%

Evaluating Contextualized Language Models for Hungarian

Judit Ács, Dániel Lévai, Dávid Márk Nemeskey, András Kornai

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Journal ref Hungarian NLP Conference (MSZNY2021)

1904.03799 2021-01-14 cs.CL 79%

Enriching Rare Word Representations in Neural Language Models by Embedding Matrix Augmentation

Yerbolat Khassanov, Zhiping Zeng, Van Tung Pham, Haihua Xu, Eng Siong Chng

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 2 figures, accepted to INTERSPEECH 2019

2012.03460 2021-01-07 cs.LG q-bio.MN 79%

Reprogramming Language Models for Molecular Representation Learning

Ria Vinod, Pin-Yu Chen, Payel Das

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments 6 pages, 5 tables, accepted at Learning Meaningful Representations of Life @ NeurIPS 2020, Women in Machine Learning @ NeurIPS 2020. 8 pages, LaTeX; typos corrected, references added

2010.06189 2020-10-28 cs.CL 79%

X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models

Zhengbao Jiang, Antonios Anastasopoulos, Jun Araki, Haibo Ding, Graham Neubig

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2020

2010.05731 2020-10-13 cs.CL 79%

Probing Pretrained Language Models for Lexical Semantics

Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, Goran Glavaš, Anna Korhonen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2020: Long paper

2009.08636 2020-09-21 cs.CL 79%

Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models

Jihyeon Roh, Huiseong Gim, Soo-Young Lee

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2004.13897 2020-07-01 cs.CL 79%

Empower Entity Set Expansion via Language Model Probing

Yunyi Zhang, Jiaming Shen, Jingbo Shang, Jiawei Han

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2020

2004.04877 2020-06-17 cs.CL 79%

Probing Neural Language Models for Human Tacit Assumptions

Nathaniel Weir, Adam Poliak, Benjamin Van Durme

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To be published in CogSci 2020

1911.03343 2020-05-18 cs.CL 79%

Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly

Nora Kassner, Hinrich Schütze

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2020

2005.05864 2020-05-13 cs.CL 79%

Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach

Wenyu Du, Zhouhan Lin, Yikang Shen, Timothy J. O'Donnell, Yoshua Bengio, Yue Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL20

2005.05716 2020-05-13 cs.LG stat.ML 79%

AttViz: Online exploration of self-attention for transparent neural language modeling

Blaž Škrlj, Nika Eržen, Shane Sheehan, Saturnino Luz, Marko Robnik-Šikonja, Senja Pollak

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

1910.14286 2019-11-01 cs.CL 79%

A neural document language modeling framework for spoken document retrieval

Li-Phen Yen, Zhen-Yu Wu, Kuan-Yu Chen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

1. 知识编辑与模型理解 7596 篇

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

Probing for Constituency Structure in Neural Language Models

Contextual Representation Learning beyond Masked Language Modeling

SemanticCAP: Chromatin Accessibility Prediction Enhanced by Features Learning from a Language Model

Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code

Using Distributional Principles for the Semantic Study of Contextual Language Models

Constrained Language Models Yield Few-Shot Semantic Parsers

An Investigation of Language Model Interpretability via Sentence Editing

The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation

An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

Probing Multilingual Language Models for Discourse

Investigation of Large-Margin Softmax in Neural Language Modeling

Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models

Discourse Probing of Pretrained Language Models

Probing Contextual Language Models for Common Ground with Visual Representations

Neural language modeling of free word order argument structure

Evaluating Contextualized Language Models for Hungarian

Enriching Rare Word Representations in Neural Language Models by Embedding Matrix Augmentation

Reprogramming Language Models for Molecular Representation Learning

X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models

Probing Pretrained Language Models for Lexical Semantics

Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models

Empower Entity Set Expansion via Language Model Probing

Probing Neural Language Models for Human Tacit Assumptions

Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly

Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach

AttViz: Online exploration of self-attention for transparent neural language modeling

A neural document language modeling framework for spoken document retrieval