Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their predictive confidence scores unfortunately cannot be trusted: e.g., they are often overconfident when wrong predictions are made, or so even for obvious outliers. In this paper, we introduce a new approach of self-supervised probing, which enables us to check and mitigate the overconfidence issue for a trained model, thereby improving its trustworthiness. We provide a simple yet effective framework, which can be flexibly applied to existing trustworthiness-related methods in a plug-and-play manner. Extensive experiments on three trustworthiness-related tasks (misclassification detection, calibration and out-of-distribution detection) across various benchmarks verify the effectiveness of our proposed probing framework.
A Survey of Safety and Trustworthiness of Deep Neural Networks: Verification, Testing, Adversarial Attack and Defence, and Interpretability
University of Liverpool(利物浦大学);University of Oxford(牛津大学);Lancaster University(兰卡斯特大学);Defence Science and Technology Laboratory (Dstl)(国防科学技术实验室);Queen’s University Belfast(贝尔法斯特女王大学)
TrustLDM: Benchmarking Trustworthiness in Language Diffusion Models
State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(中国科学院自动化研究所,智能科学与技术学院,北京大学);CISPA Helmholtz Center for Information Security(信息安全研究所);School of EECS, Peking University(电子工程学院,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究所,北京大学)
VMDT: Decoding the Trustworthiness of Video Foundation Models
University of California, Berkeley(加州大学伯克利分校);University of California, Santa Cruz(加州大学圣克ruz分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Chicago(芝加哥大学);Amazon(亚马逊);Information Commissioner’s Office(信息专员办公室)
Enhancing Mutual Trustworthiness in Federated Learning for Data-Rich Smart Cities
Mohammad Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Polytechnique Montréal(蒙特利尔理工学院);Lebanese American University(黎巴嫩美国大学);Khalifa University(哈利法大学);New York University(纽约大学);Technology Innovation Institute (TII)(技术创新研究所)