语言大模型 / LLM

Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting

Xuefeng Li, Liwen Wang, Guanting Dong, Keqing He, Jinzheng Zhao, Hao Lei, Jiachi Liu, Weiran Xu

专题命中 领域大模型 ：prompting(title,abstract)；分类 cs.CL

Comments Accepted by the Findings of ACL2023

Full Automation of Goal-driven LLM Dialog Threads with And-Or Recursors and Refiner Oracles

Paul Tarau

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.AI

Comments 23 pages, 1 figure, more information at https://github.com/ptarau/recursors

EriBERTa: A Bilingual Pre-Trained Language Model for Clinical Natural Language Processing

Iker de la Iglesia, Aitziber Atutxa, Koldo Gojenola, Ander Barrena

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain Search

Jian Xie, Yidan Liang, Jingping Liu, Yanghua Xiao, Baohua Wu, Shenghua Ni

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments KDD2023 accepted paper

Towards Coding Social Science Datasets with Language Models

Christopher Michael Rytting, Taylor Sorensen, Lisa Argyle, Ethan Busby, Nancy Fulda, Joshua Gubler, David Wingate

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI

MetaVL: Transferring In-Context Learning Ability From Language Models to Vision-Language Models

Masoud Monajatipoor, Liunian Harold Li, Mozhdeh Rouhsedaghat, Lin F. Yang, Kai-Wei Chang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Are Layout-Infused Language Models Robust to Layout Distribution Shifts? A Case Study with Scientific Documents

Catherine Chen, Zejiang Shen, Dan Klein, Gabriel Stanovsky, Doug Downey, Kyle Lo

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments To appear in ACL Findings 2023

From Characters to Words: Hierarchical Pre-trained Language Model for Open-vocabulary Language Understanding

Li Sun, Florian Luisier, Kayhan Batmanghelich, Dinei Florencio, Cha Zhang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2023 Main Conference

LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

Ilias Chalkidis, Nicolas Garneau, Catalina Goanta, Daniel Martin Katz, Anders Søgaard

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 9 pages, long paper at ACL 2023 proceedings

DarkBERT: A Language Model for the Dark Side of the Internet

Youngjin Jin, Eugene Jang, Jian Cui, Jin-Woo Chung, Yongjae Lee, Seungwon Shin

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 9 pages (main paper), 17 pages (including bibliography and appendix), to appear at the ACL 2023 Main Conference

THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval

Haitao Li, Weihang Su, Changyue Wang, Yueyue Wu, Qingyao Ai, Yiqun Liu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments COLIEE 2023

Language models can generate molecules, materials, and protein binding sites directly in three dimensions as XYZ, CIF, and PDB files

Daniel Flam-Shepherd, Alán Aspuru-Guzik

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking

Deepak Gupta, Dina Demner-Fushman

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Mask The Bias: Improving Domain-Adaptive Generalization of CTC-based ASR with Internal Language Model Estimation

Nilaksh Das, Monica Sunkara, Sravan Bodapati, Jinglun Cai, Devang Kulshreshtha, Jeff Farris, Katrin Kirchhoff

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

Comments Accepted to ICASSP 2023

RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models

Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2023. Code will be available at https://github.com/staoxiao/RetroMAE. arXiv admin note: substantial text overlap with arXiv:2211.08769

SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval

Haitao Li, Qingyao Ai, Jia Chen, Qian Dong, Yueyue Wu, Yiqun Liu, Chong Chen, Qi Tian

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 10 pages, accepted by SIGIR 2023

Gendered Mental Health Stigma in Masked Language Models

Inna Wanyin Lin, Lucille Njoo, Anjalie Field, Ashish Sharma, Katharina Reinecke, Tim Althoff, Yulia Tsvetkov

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

PIVOT: Prompting for Video Continual Learning

Andrés Villa, Juan León Alcázar, Motasem Alfarra, Kumail Alhamoud, Julio Hurtado, Fabian Caba Heilbron, Alvaro Soto, Bernard Ghanem

专题命中 领域大模型 ：prompting(title,abstract)；分类 cs.AI

Comments CVPR 2023

Internal Language Model Estimation based Adaptive Language Model Fusion for Domain Adaptation

Rao Ma, Xiaobo Wu, Jin Qiu, Yanan Qin, Haihua Xu, Peihao Wu, Zejun Ma

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by ICASSP 2023

Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking

Derek Chen, Kun Qian, Zhou Yu

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 3 figures, 7 tables. Accepted at EACL 2023

Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP

Omar Khattab, Keshav Santhanam, Xiang Lisa Li, David Hall, Percy Liang, Christopher Potts, Matei Zaharia

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension

Wenyue Hua, Yuchen Zhang, Zhe Chen, Josie Li, Melanie Weber

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

SpeechLMScore: Evaluating speech generation using speech language model

Soumi Maiti, Yifan Peng, Takaaki Saeki, Shinji Watanabe

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain

Markus Bayer, Philipp Kuehn, Ramin Shanehsaz, Christian Reuter

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 13 Pages, 7 tables, 1 figure

Addressing Distribution Shift at Test Time in Pre-trained Language Models

Ayush Singh, John E. Ortega

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to 2nd International Workshop on Practical Deep Learning in the Wild at AAAI 2023

CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text

B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 figure. Presented at Tackling Climate Change with Machine Learning: workshop at NeurIPS 2022

Extend and Explain: Interpreting Very Long Language Models

Joel Stremmel, Brian L. Hill, Jeffrey Hertzberg, Jaime Murillo, Llewelyn Allotey, Eran Halperin

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 11 pages

Journal ref Proceedings of the 2nd Machine Learning for Health symposium, PMLR 193:218-258, 2022

BARTSmiles: Generative Masked Language Models for Molecular Representations

Gayane Chilingaryan, Hovhannes Tamoyan, Ani Tevosyan, Nelly Babayan, Lusine Khondkaryan, Karen Hambardzumyan, Zaven Navoyan, Hrant Khachatrian, Armen Aghajanyan

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.LG

Comments 27 pages (including appendix)

SsciBERT: A Pre-trained Language Model for Social Science Texts

Si Shen, Jiangfeng Liu, Litao Lin, Ying Huang, Lin Zhang, Chang Liu, Yutong Feng, Dongbo Wang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 24 pages,2 figures

MSDT: Masked Language Model Scoring Defense in Text Domain

Jaechul Roh, Minhao Cheng, Yajun Fang

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 1 figure, 4 tables, accepted as a conference paper at IEEE UV 2022, Boston, USA