arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.06937cs.HCcs.AI
收藏

利用AI行为描述改善人机协作

Improving Human-AI Collaboration With Descriptions of AI Behavior

Carnegie Mellon University(卡内基梅隆大学)

Ángel Alexander Cabrera, Adam Perer, Jason I. Hong

摘要:

人们使用人工智能系统来改善他们的决策,但通常会过度依赖人工智能预测,并且表现得比没有帮助的情况下更差。为了帮助人们适当地依赖AI辅助工具,我们建议向他们展示行为描述,即AI系统如何在子组实例上执行的细节。我们通过用户研究测试了行为描述的有效性,有225名参与者在三个不同的领域:虚假评论检测,卫星图像分类和鸟类分类。我们发现,行为描述可以通过两种机制来提高人工智能的准确性:帮助人们识别人工智能的失败,以及在人工智能更准确时增加人们对人工智能的依赖。这些发现强调了人类心理模型在人类与人工智能协作中的重要性,并表明向人们告知高级人工智能行为可以显着改善人工智能辅助决策。

英文摘要:

People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior descriptions, details of how AI systems perform on subgroups of instances. We tested the efficacy of behavior descriptions through user studies with 225 participants in three distinct domains: fake review detection, satellite image classification, and bird classification. We found that behavior descriptions can increase human-AI accuracy through two mechanisms: helping people identify AI failures and increasing people's reliance on the AI when it is more accurate. These findings highlight the importance of people's mental models in human-AI collaboration and show that informing people of high-level AI behaviors can significantly improve AI-assisted decision making.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑