语言大模型 / LLM - arXivDaily 专题

2205.05535 2022-05-12 cs.CL 79%

Clinical Prompt Learning with Frozen Language Models

Niall Taylor, Yi Zhang, Dan Joyce, Alejo Nevado-Holgado, Andrey Kormilitzin

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments 18 pages, 6 figures, 6 tables

2205.03695 2022-05-10 cs.CL 79%

AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury

Chengsheng Mao, Liang Yao, Yuan Luo

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2205.00176 2022-05-03 cs.CL 79%

Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models

Sanghwan Bae, Donghyun Kwak, Sungdong Kim, Donghoon Ham, Soyoung Kang, Sang-Woo Lee, Woomyoung Park

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted to NAACL2022 as a long paper

2204.04521 2022-04-12 cs.CL 79%

Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model

Usman Naseem, Byoung Chan Lee, Matloob Khushi, Jinman Kim, Adam G. Dunn

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted @ ACL2022 Workshop: The First Workshop on Efficient Benchmarking in NLP

2112.12672 2022-04-04 cs.CL 79%

Towards more patient friendly clinical notes through language models and ontologies

Francesco Moramarco, Damir Juric, Aleksandar Savkov, Jack Flann, Maria Lehl, Kristian Boda, Tessa Grafen, Vitalii Zhelezniak, Sunir Gohil, Alex Papadopoulos Korfiatis, Nils Hammerla

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2203.15595 2022-03-30 cs.IR cs.AI 79%

Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model

Benzhi Wang, Meiyu Liang, Feifei Kou, Mingying Xu

专题命中领域大模型：language model(title,abstract)；分类 cs.AI

2203.15364 2022-03-30 cs.IR cs.CL 79%

The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through

Shruti Singh, Mayank Singh

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments 21 pages. To appear in Findings of ACL 2022

2109.10274 2022-03-23 cs.CL 79%

The Trade-offs of Domain Adaptation for Neural Language Models

David Grangier, Dan Iter

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2022

2104.01785 2022-03-02 cs.DB cs.CL 79%

Annotating Columns with Pre-trained Language Models

Yoshihiko Suhara, Jinfeng Li, Yuliang Li, Dan Zhang, Çağatay Demiralp, Chen Chen, Wang-Chiew Tan

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments SIGMOD 2022

2110.01485 2022-02-15 cs.CL 79%

JuriBERT: A Masked-Language Model Adaptation for French Legal Text

Stella Douka, Hadi Abdine, Michalis Vazirgiannis, Rajaa El Hamdani, David Restrepo Amariles

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments 7 pages

2201.11867 2022-02-01 cs.CL cs.SD eess.AS 79%

Neural-FST Class Language Model for End-to-End Speech Recognition

Antoine Bruguier, Duc Le, Rohit Prabhavalkar, Dangna Li, Zhe Liu, Bo Wang, Eun Chang, Fuchun Peng, Ozlem Kalinli, Michael L. Seltzer

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at ICASSP 2022

2201.05411 2022-01-17 cs.CL 79%

Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizer

Yinyi Wei, Tong Mo, Yongtao Jiang, Weiping Li, Wen Zhao

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2112.04184 2021-12-09 cs.CL cs.IR 79%

Zero-Shot Recommendation as Language Modeling

Damien Sileo, Wout Vossen, Robbe Raymaekers

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted at ECIR 2022

2111.08088 2021-11-17 cs.CL cs.CY 79%

Assessing gender bias in medical and scientific masked language models with StereoSet

Robert Robinson

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 table

2110.10261 2021-10-22 cs.CL 79%

Learning Domain Specific Language Models for Automatic Speech Recognition through Machine Translation

Saurav Jha

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Master's thesis work from July 2021, 22 pages including references

2110.07640 2021-10-18 cs.HC cs.CL 79%

Sparks: Inspiration for Science Writing using Language Models

Katy Ilonka Gero, Vivian Liu, Lydia B. Chilton

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2110.03730 2021-10-11 cs.CL 79%

UoB at SemEval-2021 Task 5: Extending Pre-Trained Language Models to Include Task and Domain-Specific Information for Toxic Span Prediction

Erik Yan, Harish Tayyar Madabushi

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Published in Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021); Code available at: https://github.com/erikdyan/toxic_span_detection

Journal ref 2021.semeval-1.28 (2021) 243-248

2109.15290 2021-10-01 cs.CL cond-mat.mtrl-sci 79%

MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extraction

Tanishq Gupta, Mohd Zaki, N. M. Anoop Krishnan, Mausam

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2104.06960 2021-09-28 cs.CL 79%

K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce

Song Xu, Haoran Li, Peng Yuan, Yujia Wang, Youzheng Wu, Xiaodong He, Ying Liu, Bowen Zhou

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted by Findings of EMNLP 2021

2109.10547 2021-09-23 cs.AI 79%

K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering

Fu Sun, Feng-Lin Li, Ruize Wang, Qianglong Chen, Xingyi Cheng, Ji Zhang

专题命中领域大模型：language model(title,abstract)；分类 cs.AI

Comments CIKM 2021

2109.10234 2021-09-22 cs.CL 79%

BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets

Yanzhu Guo, Virgile Rennard, Christos Xypolopoulos, Michalis Vazirgiannis

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted at the Seventh Workshop on Noisy User-generated Text (W-NUT 2021)

2106.13375 2021-09-20 cs.IR cs.CL cs.DL 79%

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Robert Tinn, Cliff Wong, Naoto Usuyama, Richard Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul N. Bennett, Jianfeng Gao, Hoifung Poon

专题命中领域大模型：pretraining(title,abstract)；分类 cs.CL

Comments ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) 2021 Applied Data Science Track

2010.12885 2021-09-14 cs.CL 79%

Unsupervised Paraphrasing with Pretrained Language Models

Tong Niu, Semih Yavuz, Yingbo Zhou, Nitish Shirish Keskar, Huan Wang, Caiming Xiong

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2021 main conference

2109.04607 2021-09-13 cs.CL 79%

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization

Fajri Koto, Jey Han Lau, Timothy Baldwin

专题命中领域大模型：language model(title)；pretraining(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2021

2108.08983 2021-08-23 cs.CL 79%

SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining

Taolin Zhang, Zerui Cai, Chengyu Wang, Minghui Qiu, Bite Yang, Xiaofeng He

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments ACL2021

2105.12192 2021-05-27 cs.CL 79%

NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains

Lee Burke, Karl Pazdernik, Daniel Fortin, Benjamin Wilson, Rustam Goychayev, John Mattingly

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments 11 pages, 2 figures

2105.03887 2021-05-11 cs.CL 79%

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, Maosong Sun

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2105.02987 2021-05-10 cs.CL 79%

Do language models learn typicality judgments from text?

Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

Comments Accepted as a talk to CogSci 2021

2104.08742 2021-04-20 cs.CL 79%

Go Forth and Prosper: Language Modeling with Ancient Textual History

Rik Koncel-Kedziorski, Noah A. Smith

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

2104.08305 2021-04-20 cs.CL 79%

Membership Inference Attack Susceptibility of Clinical Language Models

Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu

专题命中领域大模型：language model(title,abstract)；分类 cs.CL

1. 领域大模型 12705 篇

Clinical Prompt Learning with Frozen Language Models

AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury

Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models

Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model

Towards more patient friendly clinical notes through language models and ontologies

Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model

The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through

The Trade-offs of Domain Adaptation for Neural Language Models

Annotating Columns with Pre-trained Language Models

JuriBERT: A Masked-Language Model Adaptation for French Legal Text

Neural-FST Class Language Model for End-to-End Speech Recognition

Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizer

Zero-Shot Recommendation as Language Modeling

Assessing gender bias in medical and scientific masked language models with StereoSet

Learning Domain Specific Language Models for Automatic Speech Recognition through Machine Translation

Sparks: Inspiration for Science Writing using Language Models

UoB at SemEval-2021 Task 5: Extending Pre-Trained Language Models to Include Task and Domain-Specific Information for Toxic Span Prediction

MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extraction

K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce

K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering

BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Unsupervised Paraphrasing with Pretrained Language Models

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization

SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining

NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains

Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Do language models learn typicality judgments from text?

Go Forth and Prosper: Language Modeling with Ancient Textual History

Membership Inference Attack Susceptibility of Clinical Language Models