Foundation models, including Large Language Models (LLMs), Multimodal Large Language Models (MLLMs), Image Generative Models (i.e, Text-to-Image Models and Image-Editing Models), and Video Generative Models, have become essential tools with broad applications across various domains such as law, medicine, education, finance, science, and beyond. As these models see increasing real-world deployment, ensuring their reliability and responsibility has become critical for academia, industry, and government. This survey addresses the reliable and responsible development of foundation models. We explore critical issues, including bias and fairness, security and privacy, uncertainty, explainability, and distribution shift. Our research also covers model limitations, such as hallucinations, as well as methods like alignment and Artificial Intelligence-Generated Content (AIGC) detection. For each area, we review the current state of the field and outline concrete future research directions. Additionally, we discuss the intersections between these areas, highlighting their connections and shared challenges. We hope our survey fosters the development of foundation models that are not only powerful but also ethical, trustworthy, reliable, and socially responsible.
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources
MIT(麻省理工学院);EleutherAI;UCSB(加利福尼亚大学圣巴巴拉分校);SynthLabs;Princeton University(普林斯顿大学);Stanford University(斯坦福大学);Harvard University(哈佛大学);Allen Institute for AI(艾伦人工智能研究所);Google DeepMind(谷歌DeepMind);ML Commons;Contextual AI;HuggingFace;University College London(伦敦大学学院)
Low-Rank Adaptation for Foundation Models: A Comprehensive Review
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Yale University(耶鲁大学);Nanyang Technological University(南洋理工大学);Central University of Finance and Economics(中央财经大学);The Chinese University of Hong Kong(香港中文大学);Xi’an University of Electronic Science and Technology(西安电子科技大学);University of California, Davis(加州大学戴维斯分校);The University of Cambridge(剑桥大学);LOGS AI
Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models
School of Cyber Science and Engineering, Southeast University(电子科技大学信息与通信工程学院);Data61, CSIRO(数据61,CSIRO);Zhejiang Laboratory(浙江省实验室);school of Computer Science and Artificial Intelligence, Wuhan University of Technology(计算机科学与人工智能学院,武汉理工大学);College of Computing and Data Science, Nanyang Technological University(计算科学与数据科学学院,南洋理工大学)
A Comprehensive Survey of Foundation Models in Medicine
Herbert Wertheim College of Engineering, University of Florida(佛罗里达大学赫伯特·沃特海姆工程学院);Norman Fixel Institute for Neurological Diseases, University of Florida(佛罗里达大学诺曼·菲克塞尔神经疾病研究所);University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校);McKnight Brain Institute, University of Florida(佛罗里达大学麦克奈特脑科学研究所)
A Comprehensive Review of Generative Physical Artificial Intelligence
Qualcomm Research(高通研究院);University of the Cumberlands(坎伯兰大学);BITS-Pilani(皮拉尼比尔拉理工学院);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学)
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
Michigan State University(密歇根州立大学);Lehigh University(理海大学);Beihang University(北京航空航天大学);Macquarie University(麦考瑞大学);Nanyang Technological University(南洋理工大学);University of California San Diego(加利福尼亚大学圣地亚哥分校);Salesforce AI Research(Salesforce人工智能研究院);Duke University(杜克大学);University of Illinois at Chicago(伊利诺伊大学芝加哥分校)
BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Language
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);OpenDataLab, Shanghai Artificial Intelligence Laboratory(上海人工智能实验室 OpenDataLab);Zhejiang University(浙江大学);Shanghai Innovation Institute(上海创新研究院);East China Normal University(华东师范大学);Zhongguancun Academy(中关村学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)
A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
University of Glasgow(格拉斯哥大学);University of Sheffield(谢菲尔德大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);National University of Singapore(新加坡国家大学);University of Cambridge(剑桥大学);University College London(伦敦大学学院);University of Aberdeen(阿伯丁大学);Leiden University(莱顿大学)
LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
School of Electrical Engineering, Korea University(韩国大学电气工程学院);Department of Integrative Biology, The University of Texas at Austin(德克萨斯大学奥斯汀分校整合生物学系);Department of Software Engineering, FPT University(FPT大学软件工程系)
A Comprehensive Survey on Reinforcement Learning-based Agentic Search: Foundations, Roles, Optimizations, Evaluations, and Applications
The Pennsylvania State University(宾夕法尼亚州立大学);The University of Utah(犹他大学);Amazon(亚马逊);Microsoft(微软);IBM T.J. Watson Research Center(IBM T.J.沃森研究中心);Michigan State University(密歇根州立大学)
TFD: A Comprehensive Structured Tibetan Foundation Dataset for Low-Resource Language Processing and Large-Scale Modeling
University of Electronic Science and Technology of China(电子科技大学);Xizang University(西藏大学);ZenWeave AI;The State Key Laboratory of Tibetan Intelligence(藏语智能国家重点实验室);Nanyang Technological University(南洋理工大学)
Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey
Department of Mathematical Sciences, School of Physical sciences, University of Liverpool(利物浦大学数学科学系);Department of Communications and Networking, School of Advanced Technology, Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学通讯与网络系);Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)人工智能方向);Deep Interdisciplinary Intelligence Lab, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)深度跨学科智能实验室);School of Mathematics and Statistics, Shandong University(山东大学数学与统计学院);School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院);Thrust of Data Science and Analytics, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)数据科学与分析方向);Institute of Deep Perception Technology, Jiangsu(江苏深度感知技术研究院)
Foundations and Recent Trends in Multimodal Mobile Agents: A Survey
Australian Artificial Intelligence Institute(澳大利亚人工智能研究所);The Pennsylvania State University(宾夕法尼亚州立大学);Beijing Jiaotong University(北京交通大学);University of Liverpool(利物浦大学)
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学);University of Edinburgh(爱丁堡大学);The Hong Kong University of Science and Technology(香港科技大学)
Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Shanghai University of Finance and Economics(上海财经大学)
Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine
Harvard Medical School(哈佛医学院);Stanford University(斯坦福大学);Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Review
University of Electronic Science and Technology of China(电子科技大学);Aalborg University(奥尔堡大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findings
Department of Computer Science, Emory University(埃默里大学计算机科学系);Bakar Computational Health Sciences Institute, University of California, San Francisco(加州大学旧金山分校巴卡计算健康科学研究所);Center for Data Science, School of Nursing, Emory University(埃默里大学护理学院数据科学中心);Department of Computer Science, University of Southern California(南加州大学计算机科学系)
A Foundation Chemical Language Model for Comprehensive Fragment-Based Drug Discovery
Advanced Technology Core for Macromolecular X-Ray Crystallography(宏分子X射线衍射先进技术核心);Verna and Marrs McLean Dept. of Biochemistry and Molecular Pharmacology(韦纳和玛里斯麦克莱恩生物化学与分子药理学系);Dept. of Molecular & Cellular Biology(分子与细胞生物学系);Dept. of Molecular Virology & Microbiology(分子病毒学与微生物学系);Baylor College of Medicine(贝勒医学院)
University of Notre Dame(诺丁汉大学);University of Connecticut(康涅狄格大学);University of Virginia(弗吉尼亚大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Cambridge(剑桥大学);Mila - Québec AI Institute(魁北克AI研究院);Université de Montréal(蒙特利尔大学)