The rapid proliferation of generative AI, especially large language models, has led to their integration into a variety of applications. A key phenomenon known as weak-to-strong generalization - where a strong model trained on a weak model's outputs surpasses the weak model in task performance - has gained significant attention. Yet, whether critical trustworthiness properties such as robustness, fairness, and privacy can generalize similarly remains an open question. In this work, we study this question by examining if a stronger model can inherit trustworthiness properties when fine-tuned on a weaker model's outputs, a process we term weak-to-strong trustworthiness generalization. To address this, we introduce two foundational training strategies: 1) Weak Trustworthiness Finetuning (Weak TFT), which leverages trustworthiness regularization during the fine-tuning of the weak model, and 2) Weak and Weak-to-Strong Trustworthiness Finetuning (Weak+WTS TFT), which extends regularization to both weak and strong models. Our experimental evaluation on real-world datasets reveals that while some trustworthiness properties, such as fairness, adversarial, and OOD robustness, show significant improvement in transfer when both models were regularized, others like privacy do not exhibit signs of weak-to-strong trustworthiness. As the first study to explore trustworthiness generalization via weak-to-strong generalization, our work provides valuable insights into the potential and limitations of weak-to-strong generalization.
A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation
University of Liverpool(利物浦大学);Purple Mountain Laboratories(紫金山实验室);Université Grenoble Alpes(格勒诺布尔阿尔卑斯大学);The University of Manchester(曼彻斯特大学);KU Leuven(鲁汶大学)
Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
University of Texas at Austin(德克萨斯大学奥斯汀分校);Drexel University(德雷塞尔大学);MIT(麻省理工学院);UIUC(伊利诺伊大学厄巴纳-香槟分校);Duke University(杜克大学);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);Center for AI Safety(人工智能安全中心);University of California, Berkeley(加州大学伯克利分校);University of Chicago(芝加哥大学)
MLA-Trust: Benchmarking Trustworthiness of Multimodal LLM Agents in GUI Environments
Department of Computer Science & Technology, Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint Center for ML(计算机科学与技术系、人工智能研究院、BNRist中心、THBI实验室、清华-博世联合机器学习中心);Shanghai Key Lab. of Multidimensional Info. Processing(上海多维信息处理重点实验室)
TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health
Renmin University of China, China(中国人民大学);Beijing University of Posts and Telecommunications, China(北京邮电大学);Hefei University of Technology, China(合肥工业大学)
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);The University of Sydney(悉尼大学);Renmin University of China(中国人民大学);University of Chinese Academy of Sciences(中国科学院大学)
TRUSTVIS: A Multi-Dimensional Trustworthiness Evaluation Framework for Large Language Models
University of Alberta(阿尔伯塔大学);Mila - Quebec Artificial Intelligence Institute(魁北克人工智能研究所);The University of Tokyo(东京大学);Macau University of Science and Technology(澳门科学技术大学)
Eliciting Trustworthiness Priors of Large Language Models via Economic Games
University of Hong Kong(香港大学);The University of Hong Kong(香港大学);Peking University(北京大学);School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京大学行为与心理健康重点实验室);IDG/McGovern Institute for Brain Research, Peking University(北京大学脑科学研究院);Peking-Tsinghua Center for Life Sciences, Peking University(北京大学-清华大学生命科学中心);Key Laboratory of Machine Perception, Ministry of Education, China(教育部机器感知重点实验室)
Leveraging Generative AI for Clinical Evidence Summarization Needs to Ensure Trustworthiness
Columbia University(哥伦比亚大学);National Institutes of Health(美国国立卫生研究院);Northeastern University(东北大学);University of Pennsylvania(宾夕法尼亚大学);Weill Cornell Medicine(威尔康奈尔医学院);Cornell University(康奈尔大学);University of Pittsburgh(匹兹堡大学);Vanderbilt University Medical Center(范德堡大学医学中心);University of Haifa(海法大学)
From Prompt Optimization to Multi-Dimensional Credibility Evaluation: Enhancing Trustworthiness of Chinese LLM-Generated Liver MRI Reports -- with Preliminary Extension to Lung Cancer
Yu-Yue Pathology Research Center, Jinfeng Laboratory, Chongqing, China(渝粤病理研究所,金风实验室,重庆,中国);T Magnetic Resonance Imaging Translational Medical Center, Department of Radiology, Southwest Hospital, Army Medical University, Chongqing, China(7T磁共振成像转化医学中心,放射科,西南医院,中国人民解放军军医大学,重庆,中国)
Trustworthiness in Retrieval-Augmented Generation Systems: A Survey
Tsinghua University(清华大学);Renmin University of China(中国人民大学);The Chinese University of Hong Kong(香港中文大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Hong Kong Polytechnic University(香港理工大学);Microsoft Research Asia(微软亚洲研究院);University of Illinois(伊利诺伊大学)
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(神经语言处理与机器智能中心,中国科学院自动化研究所)
A Survey of Safety and Trustworthiness of Deep Neural Networks: Verification, Testing, Adversarial Attack and Defence, and Interpretability
University of Liverpool(利物浦大学);University of Oxford(牛津大学);Lancaster University(兰卡斯特大学);Defence Science and Technology Laboratory (Dstl)(国防科学技术实验室);Queen’s University Belfast(贝尔法斯特女王大学)
TrustLDM: Benchmarking Trustworthiness in Language Diffusion Models
State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(中国科学院自动化研究所,智能科学与技术学院,北京大学);CISPA Helmholtz Center for Information Security(信息安全研究所);School of EECS, Peking University(电子工程学院,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究所,北京大学)
Enhancing Mutual Trustworthiness in Federated Learning for Data-Rich Smart Cities
Mohammad Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Polytechnique Montréal(蒙特利尔理工学院);Lebanese American University(黎巴嫩美国大学);Khalifa University(哈利法大学);New York University(纽约大学);Technology Innovation Institute (TII)(技术创新研究所)
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving
Texas A&M University(德州农工大学);University of Toronto(多伦多大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);University of Maryland(马里兰大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);UNC Chapel Hill(北卡罗来纳大学教堂山分校)