Human-in-the-loop online multi-agent approach to increase trustworthiness in ML models through trust scores and data augmentation
Barcelona Supercomputing Center(巴塞罗那超级计算中心);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学);Lenovo Infrastructure Solutions Group, Lenovo(联想基础设施解决方案集团(联想))
Gusseppe Bravo-Rocca, Peini Liu, Jordi Guitart, Ajay Dholakia, David Ellison, Miroslav Hodak
备注:
Extended version of short paper accepted at IEEE COMPSAC 2022
Increasing a ML model accuracy is not enough, we must also increase its trustworthiness. This is an important step for building resilient AI systems for safety-critical applications such as automotive, finance, and healthcare. For that purpose, we propose a multi-agent system that combines both machine and human agents. In this system, a checker agent calculates a trust score of each instance (which penalizes overconfidence and overcautiousness in predictions) using an agreement-based method and ranks it; then an improver agent filters the anomalous instances based on a human rule-based procedure (which is considered safe), gets the human labels, applies geometric data augmentation, and retrains with the augmented data using transfer learning. We evaluate the system on corrupted versions of the MNIST and FashionMNIST datasets. We get an improvement in accuracy and trust score with just few additional labels compared to a baseline approach.
Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
University of Texas at Austin(德克萨斯大学奥斯汀分校);Drexel University(德雷塞尔大学);MIT(麻省理工学院);UIUC(伊利诺伊大学厄巴纳-香槟分校);Duke University(杜克大学);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);Center for AI Safety(人工智能安全中心);University of California, Berkeley(加州大学伯克利分校);University of Chicago(芝加哥大学)
MLA-Trust: Benchmarking Trustworthiness of Multimodal LLM Agents in GUI Environments
Department of Computer Science & Technology, Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint Center for ML(计算机科学与技术系、人工智能研究院、BNRist中心、THBI实验室、清华-博世联合机器学习中心);Shanghai Key Lab. of Multidimensional Info. Processing(上海多维信息处理重点实验室)
TRUSTVIS: A Multi-Dimensional Trustworthiness Evaluation Framework for Large Language Models
University of Alberta(阿尔伯塔大学);Mila - Quebec Artificial Intelligence Institute(魁北克人工智能研究所);The University of Tokyo(东京大学);Macau University of Science and Technology(澳门科学技术大学)
Eliciting Trustworthiness Priors of Large Language Models via Economic Games
University of Hong Kong(香港大学);The University of Hong Kong(香港大学);Peking University(北京大学);School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京大学行为与心理健康重点实验室);IDG/McGovern Institute for Brain Research, Peking University(北京大学脑科学研究院);Peking-Tsinghua Center for Life Sciences, Peking University(北京大学-清华大学生命科学中心);Key Laboratory of Machine Perception, Ministry of Education, China(教育部机器感知重点实验室)
From Prompt Optimization to Multi-Dimensional Credibility Evaluation: Enhancing Trustworthiness of Chinese LLM-Generated Liver MRI Reports -- with Preliminary Extension to Lung Cancer
Yu-Yue Pathology Research Center, Jinfeng Laboratory, Chongqing, China(渝粤病理研究所,金风实验室,重庆,中国);T Magnetic Resonance Imaging Translational Medical Center, Department of Radiology, Southwest Hospital, Army Medical University, Chongqing, China(7T磁共振成像转化医学中心,放射科,西南医院,中国人民解放军军医大学,重庆,中国)
"There Is Not Enough Information": On the Effects of Explanations on Perceptions of Informational Fairness and Trustworthiness in Automated Decision-Making