语言大模型 / LLM

External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation

Mingfu Liang, Xi Liu, Rong Jin, Boyang Liu, Qiuling Suo, Qinghai Zhou, Song Zhou, Laming Chen, Hua Zheng, Zhiyuan Li, Shali Jiang, Jiyan Yang, Xiaozhen Xia, Fan Yang, Yasmine Badr, Ellie Wen, Shuyu Xu, Hansey Chen, Zhengyu Zhang, Jade Nie, Chunzhi Yang, Zhichen Zeng, Weilin Zhang, Xingliang Huang, Qianru Li, Shiquan Wang, Evelyn Lyu, Wenjing Lu, Rui Zhang, Wenjun Wang, Jason Rudy, Mengyue Hang, Kai Wang, Yinbin Ma, Shuaiwen Wang, Sihan Zeng, Tongyi Tang, Xiaohan Wei, Longhao Jin, Jamey Zhang, Marcus Chen, Jiayi Xu, Angie Huang, Xihuan Zeng, Chi Zhang, Zhengli Zhao, Jared Yang, Qiang Jin, Xian Chen, Amit Anand Amlesahwaram, Lexi Song, Liang Luo, Yuchen Hao, Nan Xiao, Yavuz Yetim, Luoshang Pan, Gaoxiang Liu, Yuxi Hu, Yuzhen Huang, Jackie Xu, Rich Zhu, Xin Zhang, Yiqun Liu, Hang Yin, Yuxin Chen, Buyun Zhang, Xiaoyi Liu, Xingyuan Wang, Wenguang Mao, Zhijing Li, Zhehui Zhou, Feifan Gu, Qin Huang, Chonglin Sun, Nancy Yu, Shuo Gu, Shupin Mao, Benjamin Au, Jingzheng Qin, Peggy Yao, Jae-Woo Choi, Bin Gao, Ernest Wang, Lei Zhang, Wen-Yen Chen, Ted Lee, Yujie Zha, Yi Meng, Alex Gong, Edison Gao, Jack Hsueh, Jie Zheng, Alireza Vahdatpour, Yiping Han, Yantao Yao, Toshinari Kureha, Shuo Chang, Musharaf Sultan, John Bocharov, Sagar Chordia, Xiaorui Gan, Peng Sun, Rocky Liu, Bo Long, Wenlin Chen, Santanu Kolay, Huayu Li

机构 * AI at Meta（Meta人工智能） 纠错

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by the ACM Web Conference (WWW) 2025 Industrial Track as Oral Presentation

Towards Text-free Graph Foundation Models: Rethinking Multi-Domain Graph Contrastive Learning

Zihao Zhao, Xinlong Zhai, Jinyu Yang, Chuan Shi

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） 纠错

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 5 figures

PRISM: A Transformer-based Language Model of Structured Clinical Event Data

Lionel Levine, John Santerre, Alex S. Young, T. Barry Levine, Francis Campion, Majid Sarrafzadeh

机构 * UCLA David Geffen School of Medicine（加州大学洛杉矶分校大卫·盖芬医学院） ； ABLE Medical（ABLE医疗公司） ； MITRE Corp.（MITRE公司） 纠错

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 4 Figures, 1 Table

Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings

Rong-Xi Tan, Ming Chen, Ke Xue, Yao Wang, Yaoyuan Wang, Sheng Fu, Chao Qian

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments ICML 2025

DivScore: Zero-Shot Detection of LLM-Generated Text in Specialized Domains

Zhihui Chen, Kai He, Yucheng Huang, Yunxiao Zhu, Mengling Feng

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.CL、cs.AI

Comments Zhihui Chen and Kai He contributed equally to this work, Mengling Feng is the corresponding author

FAMA: The First Large-Scale Open-Science Speech Foundation Model for English and Italian

Sara Papi, Marco Gaido, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo, Roberto Gretter, Marco Matassoni, Mohamed Nabih, Matteo Negri

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Defining Foundation Models for Computational Science: A Call for Clarity and Rigor

Youngsoo Choi, Siu Wun Cheung, Youngkyu Kim, Ping-Hsuan Tsai, Alejandro N. Diaz, Ivan Zanardi, Seung Whan Chung, Dylan Matthew Copeland, Coleman Kendrick, William Anderson, Traian Iliescu, Matthias Heinkenschloss

机构 * Center for Applied Scientific Computing（应用科学计算中心） ； Lawrence Livermore National Laboratory（劳伦斯利弗莫尔国家实验室） ； Intelligence and Interaction Research Center（智能交互研究中心） ； Korea Institute of Science and Technology（韩国科学技术院） ； Department of Mathematics（数学系） ； Virginia Tech（弗吉尼亚理工大学） ； Quantitative Modeling and Software Engineering（定量建模与软件工程） ； Sandia National Laboratories（桑地亚国家实验室） ； Department of Aerospace Engineering（航空航天工程系） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Dept. Computational Applied Mathematics and Operations Research（计算应用数学与运筹学系） ； Rice University（莱斯大学） 纠错

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments 26 pages, 2 tables, 7 figures

Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignment

Shuo Wang, Bokui Wang, Zhixiang Shen, Boyan Deng, Zhao Kang

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Bidirectional Generation of Structure and Properties Through a Single Molecular Foundation Model

Jinho Chang, Jong Chul Ye

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Journal ref Nature Communications, 2024

Integrating Single-Cell Foundation Models with Graph Neural Networks for Drug Response Prediction

Till Rossner, Ziteng Li, Jonas Balke, Nikoo Salehfard, Tom Seifert, Ming Tang

机构 * L3S Research Center（L3S研究所以） ； Leibniz University Hannover（汉诺威莱布尼茨大学） 纠错

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.CL、cs.LG

Comments 8 pages, 6 figures

Bringing legal knowledge to the public by constructing a legal question bank using large-scale pre-trained language model

Mingruo Yuan, Ben Kao, Tien-Hsuan Wu, Michael M. K. Cheung, Henry W. H. Chan, Anne S. Y. Cheung, Felix W. H. Chan, Yongxi Chen

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref Artificial Intelligence and Law 2024-09

FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models

Xiaochen Wang, Jiaqi Wang, Houping Xiao, Jinghui Chen, Fenglong Ma

机构 * Pennsylvania State University（宾夕法尼亚州立大学） ； Georgia State University（佐治亚州立大学） 纠错

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by EMNLP'24 Main

FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models

Bithiah Yuan

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Submitted in partial fulfillment of the requirements for the Master of Science degree in Computer Science at the University of Freiburg, July 31, 2020

Towards Physics-Guided Foundation Models

Majid Farhadloo, Arun Sharma, Mingzhou Yang, Bharat Jayaprakash, William Northrop, Shashi Shekhar

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Protecting Copyright of Medical Pre-trained Language Models: Training-Free Backdoor Model Watermarking

Cong Kong, Rui Xu, Weixi Chen, Jiawei Chen, Zhaoxia Yin

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 9 pages

Prompting the Unseen: Detecting Hidden Backdoors in Black-Box Models

Zi-Xuan Huang, Jia-Wei Chen, Zhi-Peng Zhang, Chia-Mu Yu

专题命中 领域大模型 ：prompting(title,abstract)；分类 cs.AI、cs.LG

Comments This paper has been accepted by IEEE/IFIP DSN 2025

Vision-Language Models for Acute Tuberculosis Diagnosis: A Multimodal Approach Combining Imaging and Clinical Data

Ananya Ganapthy, Praveen Shastry, Naveen Kumarasami, Anandakumar D, Keerthana R, Mounigasri M, Varshinipriya M, Kishore Prasath Venkatesh, Bargava Subramanian, Kalyan Sivasailam

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 11 pages, 3 figures

CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models

Wei Dai, Peilin Chen, Malinda Lu, Daniel Li, Haowen Wei, Hejie Cui, Paul Pu Liang

专题命中 领域大模型 ：foundation model(title)；pretraining(abstract)；分类 cs.AI、cs.LG

Real-world validation of a multimodal LLM-powered pipeline for High-Accuracy Clinical Trial Patient Matching leveraging EHR data

Anatole Callies, Quentin Bodinier, Philippe Ravaud, Kourosh Davarpanah

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.CL、cs.AI

Improving Semantic Understanding in Speech Language Models via Brain-tuning

Omer Moussa, Dietrich Klakow, Mariya Toneva

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Published as a conference paper at ICLR 2025

MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models

Peng Xia, Kangyu Zhu, Haoran Li, Tianze Wang, Weijia Shi, Sheng Wang, Linjun Zhang, James Zou, Huaxiu Yao

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2025

GLEAN: Generalized Category Discovery with Diverse and Quality-Enhanced LLM Feedback

Henry Peng Zou, Siffi Singh, Yi Nian, Jianfeng He, Jason Cai, Saab Mansour, Hang Su

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.CL、cs.LG

Transferable and Forecastable User Targeting Foundation Model

Bin Dou, Baokun Wang, Yun Zhu, Xiaotong Lin, Yike Xu, Xiaorui Huang, Yang Chen, Yun Liu, Shaoshuai Han, Yongchao Liu, Tianyi Zhang, Yu Cheng, Weiqiang Wang, Chuntao Hong

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 6 figures, accept by The ACM Web Conference 2025 (WWW 2025) Industry Track

Can Language Models Learn Typologically Implausible Languages?

Tianyang Xu, Tatsuki Kuribayashi, Yohei Oseki, Ryan Cotterell, Alex Warstadt

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models

Shengqi Zhu, Jeffrey M. Rzeszotarski

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2025

FACTER: Fairness-Aware Conformal Thresholding and Prompt Engineering for Enabling Fair LLM-Based Recommender Systems

Arya Fayyazi, Mehdi Kamal, Massoud Pedram

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.AI、cs.LG

MentalArena: Self-play Training of Language Models for Diagnosis and Treatment of Mental Health Disorders

Cheng Li, May Fung, Qingyun Wang, Chi Han, Manling Li, Jindong Wang, Heng Ji

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Technical Report; 26 pages

Current Pathology Foundation Models are unrobust to Medical Center Differences

Edwin D. de Jong, Eric Marcus, Jonas Teuwen

专题命中 领域大模型 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Can we Retrieve Everything All at Once? ARM: An Alignment-Oriented LLM-based Retrieval Method

Peter Baile Chen, Yi Zhang, Michael Cafarella, Dan Roth

专题命中 领域大模型 ：LLM(title,abstract)；分类 cs.CL、cs.AI

Generating Synthetic Free-text Medical Records with Low Re-identification Risk using Masked Language Modeling

Samuel Belkadi, Libo Ren, Nicolo Micheletti, Lifeng Han, Goran Nenadic

专题命中 领域大模型 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Rewrote manuscript and moved content to appendix