回顾式终端用户走查:一种评估人们在决策系统中如何组合多个AI模型的方法
Retrospective End-User Walkthrough: A Method for Assessing How People Combine Multiple AI Models in Decision-Making Systems
AI总结:
本文提出一种回顾式终端用户走查方法,用于评估人机AI决策系统中用户如何组合多个AI模型,并通过29名参与者的定性研究验证其有效性,以揭示AI模型被忽略、使用或信任的原因。
摘要:
评估人机AI决策系统是一个新兴的挑战,因为每天都有新的将多个AI模型组合起来以实现特定目标的方法被提出。当人类在决策系统中与AI交互时,任务中可能存在多种因素,包括信任、可解释性和可说明性等。在此背景下,本研究提出了一种回顾式方法,以支持更全面地理解人们如何与多个AI模型交互、连接它们,并在人机AI决策系统中组合多个输出。该方法采用回顾式终端用户走查,旨在为HCI从业者提供支持,使他们能够理解所涉及的高阶认知过程以及AI模型输出在人机AI决策中所扮演的角色。该方法通过29名参与者(试点阶段4名参与者;主要用户研究25名参与者)在金融决策背景下与人机AI决策系统交互进行了定性评估。该系统结合了可视化分析、三个用于收入预测的AI模型、AI支持的类比分析,以及使用外部新闻和自然语言处理进行假设检验,以提供多种比较公司的方式。除了任务和可用性问题上的结果外,所呈现的发现表明,该方法在揭示AI模型为何被忽略、使用或信任,以及未来交互如何规划方面具有前景。我们建议,研究人机交互的HCI从业者可以在用户研究的汇报阶段增加这一步骤,就像应用回顾式出声思维协议一样,但重点是重新审视任务并理解参与者在执行任务时为何忽略或连接预测。
英文摘要:
Evaluating human-AI decision-making systems is an emerging challenge as new ways of combining multiple AI models towards a specific goal are proposed every day. As humans interact with AI in decision-making systems, multiple factors may be present in a task including trust, interpretability, and explainability, amongst others. In this context, this work proposes a retrospective method to support a more holistic understanding of how people interact with and connect multiple AI models and combine multiple outputs in human-AI decision-making systems. The method consists of employing a retrospective end-user walkthrough with the objective of providing support to HCI practitioners so that they may gain an understanding of the higher order cognitive processes in place and the role that AI model outputs play in human-AI decision-making. The method was qualitatively assessed with 29 participants (four participants in a pilot phase; 25 participants in the main user study) interacting with a human-AI decision-making system in the context of financial decision-making. The system combines visual analytics, three AI models for revenue prediction, AI-supported analogues analysis, and hypothesis testing using external news and natural language processing to provide multiple means for comparing companies. Beyond results on tasks and usability problems, outcomes presented suggest that the method is promising in highlighting why AI models are ignored, used, or trusted, and how future interactions are planned. We suggest that HCI practitioners researching human-AI interaction can benefit by adding this step to user studies in a debriefing stage as a retrospective Thinking-Aloud protocol would be applied, but with emphasis on revisiting tasks and understanding why participants ignored or connected predictions while performing a task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。