语言大模型 / LLM

Gendered Mental Health Stigma in Masked Language Models

Inna Wanyin Lin, Lucille Njoo, Anjalie Field, Ashish Sharma, Katharina Reinecke, Tim Althoff, Yulia Tsvetkov

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

PIVOT: Prompting for Video Continual Learning

Andrés Villa, Juan León Alcázar, Motasem Alfarra, Kumail Alhamoud, Julio Hurtado, Fabian Caba Heilbron, Alvaro Soto, Bernard Ghanem

专题命中 领域大模型 ：prompting(title,abstract)；分类 cs.AI

Comments CVPR 2023

Internal Language Model Estimation based Adaptive Language Model Fusion for Domain Adaptation

Rao Ma, Xiaobo Wu, Jin Qiu, Yanan Qin, Haihua Xu, Peihao Wu, Zejun Ma

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by ICASSP 2023

Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking

Derek Chen, Kun Qian, Zhou Yu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 3 figures, 7 tables. Accepted at EACL 2023

Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP

Omar Khattab, Keshav Santhanam, Xiang Lisa Li, David Hall, Percy Liang, Christopher Potts, Matei Zaharia

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension

Wenyue Hua, Yuchen Zhang, Zhe Chen, Josie Li, Melanie Weber

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

SpeechLMScore: Evaluating speech generation using speech language model

Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain

Markus Bayer, Philipp Kuehn, Ramin Shanehsaz, Christian Reuter

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 13 Pages, 7 tables, 1 figure

Addressing Distribution Shift at Test Time in Pre-trained Language Models

Ayush Singh, John E. Ortega

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to 2nd International Workshop on Practical Deep Learning in the Wild at AAAI 2023

CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text

B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 figure. Presented at Tackling Climate Change with Machine Learning: workshop at NeurIPS 2022

Extend and Explain: Interpreting Very Long Language Models

Joel Stremmel, Brian L. Hill, Jeffrey Hertzberg, Jaime Murillo, Llewelyn Allotey, Eran Halperin

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 11 pages

Journal ref Proceedings of the 2nd Machine Learning for Health symposium, PMLR 193:218-258, 2022

BARTSmiles: Generative Masked Language Models for Molecular Representations

Gayane Chilingaryan, Hovhannes Tamoyan, Ani Tevosyan, Nelly Babayan, Lusine Khondkaryan, Karen Hambardzumyan, Zaven Navoyan, Hrant Khachatrian, Armen Aghajanyan

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

Comments 27 pages (including appendix)

SsciBERT: A Pre-trained Language Model for Social Science Texts

Si Shen, Jiangfeng Liu, Litao Lin, Ying Huang, Lin Zhang, Chang Liu, Yutong Feng, Dongbo Wang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 24 pages,2 figures

MSDT: Masked Language Model Scoring Defense in Text Domain

Jaechul Roh, Minhao Cheng, Yajun Fang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 figure, 4 tables, accepted as a conference paper at IEEE UV 2022, Boston, USA

Active Learning with Tabular Language Models

Martin Ringsquandl, Aneta Koleva

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 8 pages

AraLegal-BERT: A pretrained language model for Arabic Legal text

Muhammad AL-Qurishi, Sarah AlQaseemi, Riad Soussi

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

M2D2: A Massively Multi-domain Language Modeling Dataset

Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

Assessing Out-of-Domain Language Model Performance from Few Examples

Prasann Singhal, Jarad Forristal, Xi Ye, Greg Durrett

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

MedJEx: A Medical Jargon Extraction Model with Wiki's Hyperlink Span and Contextualized Masked Language Model Score

Sunjae Kwon, Zonghai Yao, Harmon S. Jordan, David A. Levy, Brian Corner, Hong Yu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 22

RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models

Lingzhi Wang, Huang Hu, Lei Sha, Can Xu, Kam-Fai Wong, Daxin Jiang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by AACL 2022

OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services

Xiao Liu, Da Yin, Jingnan Zheng, Xingjian Zhang, Peng Zhang, Hongxia Yang, Yuxiao Dong, Jie Tang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to KDD 2022

Journal ref In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2022). Association for Computing Machinery, New York, NY, USA, 3418-3428

Self-Supervised Pretraining for 2D Medical Image Segmentation

András Kalapos, Bálint Gyires-Tóth

专题命中 领域大模型 ：pretraining(title,abstract)；分类 cs.LG

Comments Submitted manuscript accepted for the Workshop on AI-enabled Medical Image Analysis at ECCV 2022

A Transformer-based Neural Language Model that Synthesizes Brain Activation Maps from Free-Form Text Queries

Gia H. Ngo, Minh Nguyen, Nancy F. Chen, Mert R. Sabuncu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

Comments arXiv admin note: text overlap with arXiv:2109.13814

Journal ref Medical Image Analysis. 2022 Jul 19:102540

MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare

Shaoxiong Ji, Tianlin Zhang, Luna Ansari, Jie Fu, Prayag Tiwari, Erik Cambria

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Journal ref Proceedings of the Language Resources and Evaluation Conference (LREC), 2022

Internal Language Model Estimation based Language Model Fusion for Cross-Domain Code-Switching Speech Recognition

Yizhou Peng, Yufei Liu, Jicheng Zhang, Haihua Xu, Yi He, Hao Huang, Eng Siong Chng

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 5 pages. Submitted to INTERSPEECH 2022

TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models

Ali Davody, David Ifeoluwa Adelani, Thomas Kleinbauer, Dietrich Klakow

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to 25th International Conference on Text, Speech and Dialogue (TSD 2022)

Improving Speech Recognition for Indic Languages using Language Model

Ankur Dhuriya, Harveen Singh Chadha, Anirudh Gupta, Priyanshi Shah, Neeraj Chhimwal, Rishabh Gaur, Vivek Raghavan

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Need to upgrade the content completely

SFE-AI at SemEval-2022 Task 11: Low-Resource Named Entity Recognition using Large Pre-trained Language Models

Changyu Hou, Jun Wang, Yixuan Qiao, Peng Jiang, Peng Gao, Guotong Xie, Qizhi Lin, Xiaopeng Wang, Xiandi Jiang, Benqi Wang, Qifeng Xiao

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models

Deming Ye, Yankai Lin, Peng Li, Maosong Sun, Zhiyuan Liu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2022. The code and models are available at https://github.com/thunlp/PELT

PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain

Thiago Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey H. Smith, Hari Trivedi, Imon Banerjee

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments submitted to "American Medical Informatics Association (AMIA)" 2022 Annual Symposium