arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.00900cs.CVcs.AIcs.HC
收藏

VQA模型中假设对AI胜任力预测的影响

The Impact of Explanations on AI Competency Prediction in VQA

UC San Diego(加州大学圣地亚哥分校);SRI International(SRI国际研究院)

Kamran Alipour, Arijit Ray, Xiao Lin, Jurgen P. Schulze, Yi Yao, Giedrius T. Burachas

摘要:

可解释性是在AI系统中建立信任的关键要素之一。在众多使人工智能可解释的尝试中,量化解释的效果仍然是进行人类-人工智能协作任务的挑战。除了预测人工智能整体行为的能力之外,在许多应用中,用户还需要了解人工智能智能体在任务域不同方面的能力。在本文中,我们评估的影响解释用户的心理模型的人工智能智能体能力内的任务视觉问答(VQA)。我们量化用户的理解能力,基于实际系统性能和用户排名之间的相关性。我们介绍了一个可解释的VQA系统,使用空间和对象的功能,并提供动力的BERT语言模型。每组用户只看到一种解释来对VQA模型的能力进行排名。该模型通过被试间实验进行评估,以探讨解释对用户能力感知的影响。两个VQA模型之间的比较表明,基于BERT的解释和使用对象的功能,提高了用户的预测模型的能力。

英文摘要:

Explainability is one of the key elements for building trust in AI systems. Among numerous attempts to make AI explainable, quantifying the effect of explanations remains a challenge in conducting human-AI collaborative tasks. Aside from the ability to predict the overall behavior of AI, in many applications, users need to understand an AI agent's competency in different aspects of the task domain. In this paper, we evaluate the impact of explanations on the user's mental model of AI agent competency within the task of visual question answering (VQA). We quantify users' understanding of competency, based on the correlation between the actual system performance and user rankings. We introduce an explainable VQA system that uses spatial and object features and is powered by the BERT language model. Each group of users sees only one kind of explanation to rank the competencies of the VQA model. The proposed model is evaluated through between-subject experiments to probe explanations' impact on the user's perception of competency. The comparison between two VQA models shows BERT based explanations and the use of object features improve the user's prediction of the model's competencies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑