语言大模型 / LLM

Watermarking Text Generated by Black-Box Language Models

Xi Yang, Kejiang Chen, Weiming Zhang, Chang Liu, Yuang Qi, Jie Zhang, Han Fang, Nenghai Yu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Code will be available at https://github.com/Kiode/Text_Watermark_Language_Models

MasonNLP+ at SemEval-2023 Task 8: Extracting Medical Questions, Experiences and Claims from Social Media using Knowledge-Augmented Pre-trained Language Models

Giridhar Kaushik Ramachandran, Haritha Gangavarapu, Kevin Lybarger, Ozlem Uzuner

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection

Yi Wang, Jiajun Deng, Tianzi Wang, Bo Zheng, Shoukang Hu, Xunying Liu, Helen Meng

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted ICASSP 2023 (will update with IEEE vision later)

TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs

Yaobo Liang, Chenfei Wu, Ting Song, Wenshan Wu, Yan Xia, Yu Liu, Yang Ou, Shuai Lu, Lei Ji, Shaoguang Mao, Yun Wang, Linjun Shou, Ming Gong, Nan Duan

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Leveraging Foundation Models for Clinical Text Analysis

Shaina Raza, Syed Raza Bashir

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Frozen Language Model Helps ECG Zero-Shot Learning

Jun Li, Che Liu, Sibo Cheng, Rossella Arcucci, Shenda Hong

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI、cs.LG

Scalable Prompt Generation for Semi-supervised Learning with Language Models

Yuhang Zhou, Suraj Maharjan, Beiye Liu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EACL2023 Findings

Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning

Nuofan Xu, Chenhui Hu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

A Comparative Study of Pretrained Language Models for Long Clinical Text

Yikuan Li, Ramsey M. Wehbe, Faraz S. Ahmad, Hanyin Wang, Yuan Luo

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments arXiv admin note: substantial text overlap with arXiv:2201.11838

Removing Non-Stationary Knowledge From Pre-Trained Language Models for Entity-Level Sentiment Classification in Finance

Guijin Son, Hanwool Lee, Nahyeon Kang, Moonjeong Hahm

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published at The AAAI-2023 Workshop On Multimodal AI For Financial Forecasting (muffin@AAAI2023)

Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems

Denis Emelin, Daniele Bonadiman, Sawsan Alqahtani, Yi Zhang, Saab Mansour

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Published at EMNLP 2022 (main conference)

Scientific and Creative Analogies in Pretrained Language Models

Tamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra, Ekaterina Shutova

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments To be published in Findings of EMNLP 2022

How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling

Samuel Cahyawijaya, Bryan Wilie, Holy Lovenia, Huan Zhong, MingQian Zhong, Yuk-Yu Nancy Ip, Pascale Fung

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Invariant Language Modeling

Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published at EMNLP 2022

A Comparison of SVM against Pre-trained Language Models (PLMs) for Text Classification Tasks

Yasmen Wahba, Nazim Madhavji, John Steinbacher

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

$N$-gram Is Back: Residual Learning of Neural Text Generation with $n$-gram Language Model

Huayang Li, Deng Cai, Jin Xu, Taro Watanabe

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to findings of EMNLP 2022

Multimodal data matters: language model pre-training over structured and unstructured electronic health records

Sicen Liu, Xiaolong Wang, Yongshuai Hou, Ge Li, Hui Wang, Hui Xu, Yang Xiang, Buzhou Tang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 5 figures accepted for publication in the IEEE Journal of Biomedical and Health Informatics (J-BHI)

Understanding Domain Learning in Language Models Through Subpopulation Analysis

Zheng Zhao, Yftah Ziser, Shay B. Cohen

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to BlackboxNLP 2022

SecureBERT: A Domain-Specific Language Model for Cybersecurity

Ehsan Aghaei, Xi Niu, Waseem Shadid, Ehab Al-Shaer

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments This is the initial draft of this work and it may contain errors and typos. The revised version has already been submitted to a venue

Language Models Understand Us, Poorly

Jared Moore

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 5 pages, 1 figure, to be published in Findings of EMNLP 2022

AstBERT: Enabling Language Model for Financial Code Understanding with Abstract Syntax Trees

Rong Liang, Tiehua Zhang, Yujie Lu, Yuze Liu, Zhen Huang, Xin Chen

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI、cs.LG

Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets

Yi Yang, Chen Zhang, Benyou Wang, Dawei Song

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to NLPCC 2022. Code is available at https://github.com/Ylily1015/DogeTickets

A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language

Bing Su, Dazhao Du, Zhao Yang, Yujie Zhou, Jiangmeng Li, Anyi Rao, Hao Sun, Zhiwu Lu, Ji-Rong Wen

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

An Empirical Study of Language Model Integration for Transducer based Speech Recognition

Huahuan Zheng, Keyu An, Zhijian Ou, Chen Huang, Ke Ding, Guanglu Wan

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted into INTERSPEECH 2022

Prompt Tuning GPT-2 language model for parameter-efficient domain adaptation of ASR systems

Saket Dingliwal, Ashish Shenoy, Sravan Bodapati, Ankur Gandhe, Ravi Teja Gadde, Katrin Kirchhoff

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at InterSpeech 2022

CLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domain

Lukas Lange, Heike Adel, Jannik Strötgen, Dietrich Klakow

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments This article has been accepted for publication in Bioinformatics \c{opyright}: 2022 The Author(s). Published by Oxford University Press. All rights reserved. The published manuscript can be found here: https://doi.org/10.1093/bioinformatics/btac297

Chess as a Testbed for Language Model State Tracking

Shubham Toshniwal, Sam Wiseman, Karen Livescu, Kevin Gimpel

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments AAAI 2022 extended version with supplementary material

UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQL

Longxu Dou, Yan Gao, Mingyang Pan, Dingzirui Wang, Wanxiang Che, Dechen Zhan, Jian-Guang Lou

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Codes and checkpoints are available at https://github.com/microsoft/ContextualSP/tree/master/unified_parser_text_to_sql

Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion

Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller, Arthur Szlam, Jason Weston

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Building Chinese Biomedical Language Models via Multi-Level Text Discrimination

Quan Wang, Songtai Dai, Benfeng Xu, Yajuan Lyu, Yong Zhu, Hua Wu, Haifeng Wang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI