AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases, humans should be assisted by automated systems so that the two parties reach a joint decision, stemming out of their interaction. In this work we conduct an empirical study to identify how uncertainty estimates and model explanations affect users' reliance, understanding, and trust towards a model, looking for potential benefits of bringing the two together. Moreover, we seek to assess how users' behaviour is affected by their own self-confidence in their abilities to perform a certain task, while we also discuss how the latter may distort the outcome of an analysis based on agreement and switching percentages.
"It is there, and you need it, so why do you not use it?" Achieving better adoption of AI systems by domain experts, in the case study of natural science research
University of Edinburgh(爱丁堡大学);BBC Research and Development(BBC研发部)
Why Human Guidance Matters in Collaborative Vibe Coding
Cornell University(康奈尔大学);Princeton University(普林斯顿大学);Massachusetts Institute of Technology(麻省理工学院);University of Cambridge(剑桥大学);New York University(纽约大学)
Conservative Bias in Multi-Teacher Learning: Why Agents Prefer Low-Reward Advisors
School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);Escuela de Ingeniería, Universidad Central de Chile(智利中央大学工程学院)
Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosis
Northeastern University(东北大学);Massachusetts Institute of Technology(麻省理工学院);The Ohio State University(俄亥俄州立大学);Rensselaer Polytechnic Institute(伦斯勒理工学院);The Ohio State University Wexner Medical Center(俄亥俄州立大学韦克斯纳医学中心)
Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration
Ludwig-Maximilians-Universität (LMU) Munich(慕尼黑大学);John A. Paulson Harvard School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·保尔森工程与应用科学学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Wyss Institute for Biologically Inspired Engineering, Harvard University(哈佛大学怀斯生物启发工程研究所)