People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior descriptions, details of how AI systems perform on subgroups of instances. We tested the efficacy of behavior descriptions through user studies with 225 participants in three distinct domains: fake review detection, satellite image classification, and bird classification. We found that behavior descriptions can increase human-AI accuracy through two mechanisms: helping people identify AI failures and increasing people's reliance on the AI when it is more accurate. These findings highlight the importance of people's mental models in human-AI collaboration and show that informing people of high-level AI behaviors can significantly improve AI-assisted decision making.
Improving Trust Estimation in Human-Robot Collaboration Using Beta Reputation at Fine-grained Timescales
Robotics Institute, Faculty of Engineering and Information Technology, University of Technology Sydney(技术科技大学机器人研究所,工程与信息科技学院);Psychology Discipline, Graduate School of Health, Faculty of Health, University of Technology Sydney(技术科技大学健康研究生学院,健康学院);Australian Artificial Intelligence Institute, School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney(澳大利亚人工智能研究所,计算机科学学院,工程与信息科技学院,技术科技大学)
How Developers Interact with AI: A Taxonomy of Human-AI Collaboration in Software Engineering
School of Computing and Information Systems(计算与信息系统学院);Singapore Management University(新加坡管理大学);School of Informatics, Computing, and Cyber Systems(信息学、计算与网络系统学院);Northern Arizona University(北亚利桑那大学)
When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design Task
Southern University of Science and Technology(南方科技大学);Southeast University(东南大学);Hong Kong Polytechnic University(香港理工大学);City University of Hong Kong(香港城市大学)