语言大模型 / LLM

HYDRA -- Hyper Dependency Representation Attentions

Ha-Thanh Nguyen, Vu Tran, Tran-Binh Dang, Minh-Quan Bui, Minh-Phuong Nguyen, Le-Minh Nguyen

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL

Representation Memorization for Fast Learning New Knowledge without Forgetting

Fei Mi, Tao Lin, Boi Faltings

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Debiasing Methods in Natural Language Understanding Make Bias More Accessible

Michael Mendelson, Yonatan Belinkov

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2021

RefineCap: Concept-Aware Refinement for Image Captioning

Yekun Chai, Shuo Jin, Junliang Xing

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted at ViGIL @NAACL 2021

Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation

Yuning Mao, Wenchang Ma, Deren Lei, Jiawei Han, Xiang Ren

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments EMNLP 2021

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Work in Progress

Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning

Qian Chen, Wen Wang, Qinglin Zhang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by INTERSPEECH 2021

Journal ref Proc. Interspeech 2021

Learning to Remove: Towards Isotropic Pre-trained BERT Embedding

Yuxin Liang, Rui Cao, Jie Zheng, Jie Ren, Ling Gao

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by ICANN2021

DESYR: Definition and Syntactic Representation Based Claim Detection on the Web

Megha Sundriyal, Parantak Singh, Md Shad Akhtar, Shubhashis Sengupta, Tanmoy Chakraborty

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 10 pages, Accepted at CIKM 2021

Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images

Boon Peng Yap, Beng Koon Ng

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

Mingkun Xu, Yujie Wu, Lei Deng, Faqiang Liu, Guoqi Li, Jing Pei

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.LG

Comments Accepted by IJCAI-21

Transformer-Based Behavioral Representation Learning Enables Transfer Learning for Mobile Sensing in Small Datasets

Mike A. Merrill, Tim Althoff

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Speech SIMCLR: Combining Contrastive and Reconstruction Objective for Self-supervised Speech Representation Learning

Dongwei Jiang, Wubo Li, Miao Cao, Wei Zou, Xiangang Li

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL

Joint Emotion Label Space Modelling for Affect Lexica

Luna De Bruyne, Pepa Atanasova, Isabelle Augenstein

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Computer Speech and Language journal, to appear

Probing Image-Language Transformers for Verb Understanding

Lisa Anne Hendricks, Aida Nematzadeh

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL

Learning Multilingual Representation for Natural Language Understanding with Enhanced Cross-Lingual Supervision

Yinpeng Guo, Liangyou Li, Xin Jiang, Qun Liu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words

Valentin Hofmann, Janet B. Pierrehumbert, Hinrich Schütze

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments ACL 2021

Alleviating the Knowledge-Language Inconsistency: A Study for Deep Commonsense Knowledge

Yi Zhang, Lei Li, Yunfang Wu, Qi Su, Xu Sun

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition

Yinghao Li, Pranav Shetty, Lucas Liu, Chao Zhang, Le Song

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT

Zhiyong Wu, Yun Chen, Ben Kao, Qun Liu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments ACL2020

Introducing Information Retrieval for Biomedical Informatics Students

Sanya B. Taneja, Richard D. Boyce, William T. Reynolds, Denis Newman-Griffis

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments To appear in the Proceedings of the Fifth Workshop on Teaching NLP @ NAACL

Morph Call: Probing Morphosyntactic Content of Multilingual Transformers

Vladislav Mikhailov, Oleg Serikov, Ekaterina Artemova

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments To appear in the Proceedings of the 3rd Workshop on Research in Computational Typology and Multilingual NLP (SIGTYP, NAACL)

Spatially Consistent Representation Learning

Byungseok Roh, Wuhyun Shin, Ildoo Kim, Sungwoong Kim

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Comments Accepted by CVPR 2021

Low Anisotropy Sense Retrofitting (LASeR) : Towards Isotropic and Sense Enriched Representations

Geetanjali Bihani, Julia Taylor Rayz

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments DEELIO Workshop@NAACL 2021

ELECTRAMed: a new pre-trained language representation model for biomedical NLP

Giacomo Miolo, Giulio Mantoan, Carlotta Orsenigo

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

A multilabel approach to morphosyntactic probing

Naomi Tachikawa Shapiro, Amandalynne Paullada, Shane Steinert-Threlkeld

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression

Yiwen Meng, William Speier, Michael K. Ong, Corey W. Arnold

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Comments in IEEE Journal of Biomedical and Health Informatics (2021)

RuSentEval: Linguistic Source, Encoder Force!

Vladislav Mikhailov, Ekaterina Taktasheva, Elina Sigdel, Ekaterina Artemova

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments The paper is accepted to BSNLP workshop at EACL 2021. The title follows Power Rangers Mystic Force series (Roll Call Team-Morph: "Magical Source, Mystic Force!")

Exploring Early Prediction of Buyer-Seller Negotiation Outcomes

Kushal Chawla, Gale Lucas, Jonathan May, Jonathan Gratch

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

TCN: Table Convolutional Network for Web Table Interpretation

Daheng Wang, Prashant Shiralkar, Colin Lockard, Binxuan Huang, Xin Luna Dong, Meng Jiang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG