arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.21948cs.HCcs.AIcs.CV
收藏

追踪委托轨迹以研究与多模态AI交互中的人类监督

Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI

Politecnico di Milano(米兰理工大学)

Agnese Chiatti, Matteo Matteucci, Viola Schiaffonati

AI总结:

本研究通过56名AI素养参与者的392个视频问答试验,发现交互后信任度可强预测委托选择,委托还随任务顺序增加,提出实施委托轨迹作为多模态AI研究的方法论框架。

摘要:

随着多模态AI系统逐渐成为我们日常的思维伙伴,研究用户如何将控制权转移给这些系统的转变变得尤为紧迫。在本文中,我们报告了一项在线研究的发现概述,该研究包含56名具备AI知识的参与者和392个视频问答试验。在检查每个多模态AI的响应后,参与者对特定任务的信任度进行评分,并为类似的未来任务选择三种预期策略之一:拒绝AI协助、经验证后使用AI协助,或完全委托给AI。在参与者内部,交互后的信任度强烈预测用户的委托选择(优势比OR=14.97,95%置信区间CI [7.14,31.37])。然而,信任与委托仍然是不同的概念。验证是占主导地位的策略,且常与高信任度同时出现。在对瞬时信任和参与者层面信任进行调整后,委托还随任务顺序增加(OR=1.22,95% CI [1.02,1.45]),这表明存在与经验相关的成分,仅靠自我报告的信任评分无法捕捉。这些发现推动了从预期委托转向对协作人机任务中委托如何实施的非侵入式观察。因此,我们最后提出实施委托轨迹作为未来研究多模态和智能体AI使用的方法论框架。

英文摘要:

As multimodal AI systems are becoming our everyday thought partners, the shift towards studying how users transfer control to these systems becomes especially urgent. In this paper, we report an overview of findings from an online study with n=56 AI-literate participants and 392 Video Question Answering trials. After inspecting each multimodal AI response, participants rated task-specific trust and selected one of three intended policies for an analogous future task: reject AI assistance, use it with verification, or delegate fully to the AI. Within participants, post-interaction trust strongly predicted the user's delegation choices (OR=14.97, 95% CI [7.14,31.37]). Trust and delegation nevertheless remained distinct. Verification was the dominant policy and often co-occurred with high trust. Delegation also increased with task order after adjustment for momentary and participant-level trust (OR=1.22, 95% CI [1.02,1.45]), indicating an experience-related component that self-reported trust ratings alone could not capture. These findings motivate a shift from intended delegation to a non-intrusive observation of how delegation is enacted in collaborative human-AI tasks. We therefore conclude by proposing enacted delegation traces as a methodological framework for future studies of multimodal and agentic AI use.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑