语言大模型 / LLM

Inductive Learning on Commonsense Knowledge Graph Completion

Bin Wang, Guangtao Wang, Jing Huang, Jiaxuan You, Jure Leskovec, C. -C. Jay Kuo

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI

Comments 8 pages

Train a One-Million-Way Instance Classifier for Unsupervised Visual Representation Learning

Yu Liu, Lianghua Huang, Pan Pan, Bin Wang, Yinghui Xu, Rong Jin

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI

Comments Accepted by AAAI2021

General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework

Yucheng Zhao, Dacheng Yin, Chong Luo, Zhiyuan Zhao, Chuanxin Tang, Wenjun Zeng, Zheng-Jun Zha

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Prediction

Anuroop Sriram, Matthew Muckley, Koustuv Sinha, Farah Shamout, Joelle Pineau, Krzysztof J. Geras, Lea Azour, Yindalon Aphinyanaphongs, Nafissa Yakubova, William Moore

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Estimating Galactic Distances From Images Using Self-supervised Representation Learning

Md Abul Hayat, Peter Harrington, George Stein, Zarija Lukić, Mustafa Mustafa

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI

Learning Better Sentence Representation with Syntax Information

Chen Yang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

CLEAR: Contrastive Learning for Sentence Representation

Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, Hao Ma

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 10 pages, 2 figures

BURT: BERT-inspired Universal Representation from Learning Meaningful Segment

Yian Li, Hai Zhao

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2009.04656

Pre-Training Transformers as Energy-Based Cloze Models

Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments EMNLP 2020

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

Xiaozhi Wang, Tianyu Gao, Zhaocheng Zhu, Zhengyan Zhang, Zhiyuan Liu, Juanzi Li, Jian Tang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted to TACL

Unsupervised Explanation Generation for Machine Reading Comprehension

Yiming Cui, Ting Liu, Shijin Wang, Guoping Hu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 10 pages

Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT

Rik van Noord, Antonio Toral, Johan Bos

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments EMNLP 2020 (long)

The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks

Brihi Joshi, Neil Shah, Francesco Barbieri, Leonardo Neves

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted at COLING 2020. Code available at https://github.com/brihijoshi/granular-similarity-COLING-2020

Topic Modeling with Contextualized Word Representation Clusters

Laure Thompson, David Mimno

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries

Aditi Chaudhary, Karthik Raman, Krishna Srinivasan, Jiecao Chen

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 13 pages

TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis

Mohiuddin Md Abdul Qudar, Vijay Mago

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube

Jack Hessel, Zhenhai Zhu, Bo Pang, Radu Soricut

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL

Comments 11 pages including supplementary materials

Journal ref Published in EMNLP 2020

Representation Learning via Invariant Causal Mechanisms

Jovana Mitrovic, Brian McWilliams, Jacob Walker, Lars Buesing, Charles Blundell

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring

Farjana Sultana Mim, Naoya Inoue, Paul Reisert, Hiroki Ouchi, Kentaro Inui

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Multiple Word Embeddings for Increased Diversity of Representation

Brian Lester, Daniel Pressel, Amy Hemmeter, Sagnik Ray Choudhury, Srinivas Bangalore

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2001.01167

Quantifying the Contextualization of Word Representations with Semantic Class Probing

Mengjie Zhao, Philipp Dufter, Yadollah Yaghoobzadeh, Hinrich Schütze

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments EMNLP Findings 2020

How Decoding Strategies Affect the Verifiability of Generated Text

Luca Massarelli, Fabio Petroni, Aleksandra Piktus, Myle Ott, Tim Rocktäschel, Vassilis Plachouras, Fabrizio Silvestri, Sebastian Riedel

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments accepted at Findings of EMNLP 2020

What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties

Rochelle Choenni, Ekaterina Shutova

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL

SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge

Pei Ke, Haozhe Ji, Siyang Liu, Xiaoyan Zhu, Minlie Huang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2020 (Main Conference)

Learning semantic Image attributes using Image recognition and knowledge graph embeddings

Ashutosh Tiwari, Sandeep Varma

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI

Comments 7 Pages, 6 figures, Accepted at Future Technologies Conference (FTC) 2020, Vancouver, Canada

Learning to Scale Multilingual Representations for Vision-Language Tasks

Andrea Burns, Donghyun Kim, Derry Wijaya, Kate Saenko, Bryan A. Plummer

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments ECCV 2020 accepted spotlight paper

BURT: BERT-inspired Universal Representation from Twin Structure

Yian Li, Hai Zhao

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Representation Learning with Video Deep InfoMax

R Devon Hjelm, Philip Bachman

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

LSBert: A Simple Framework for Lexical Simplification

Jipeng Qiang, Yun Li, Yi Zhu, Yunhao Yuan, Xindong Wu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:1907.06226

A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning

Fang Liu, Ge Li, Bolin Wei, Xin Xia, Zhiyi Fu, Zhi Jin

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI

Comments Accepted by International Conference on Program Comprehension (ICPC 2020)