随着多模态AI系统逐渐成为我们日常的思维伙伴,研究用户如何将控制权转移给这些系统的转变变得尤为紧迫。在本文中,我们报告了一项在线研究的发现概述,该研究包含56名具备AI知识的参与者和392个视频问答试验。在检查每个多模态AI的响应后,参与者对特定任务的信任度进行评分,并为类似的未来任务选择三种预期策略之一:拒绝AI协助、经验证后使用AI协助,或完全委托给AI。在参与者内部,交互后的信任度强烈预测用户的委托选择(优势比OR=14.97,95%置信区间CI [7.14,31.37])。然而,信任与委托仍然是不同的概念。验证是占主导地位的策略,且常与高信任度同时出现。在对瞬时信任和参与者层面信任进行调整后,委托还随任务顺序增加(OR=1.22,95% CI [1.02,1.45]),这表明存在与经验相关的成分,仅靠自我报告的信任评分无法捕捉。这些发现推动了从预期委托转向对协作人机任务中委托如何实施的非侵入式观察。因此,我们最后提出实施委托轨迹作为未来研究多模态和智能体AI使用的方法论框架。
英文摘要:
As multimodal AI systems are becoming our everyday thought partners, the shift towards studying how users transfer control to these systems becomes especially urgent. In this paper, we report an overview of findings from an online study with n=56 AI-literate participants and 392 Video Question Answering trials. After inspecting each multimodal AI response, participants rated task-specific trust and selected one of three intended policies for an analogous future task: reject AI assistance, use it with verification, or delegate fully to the AI. Within participants, post-interaction trust strongly predicted the user's delegation choices (OR=14.97, 95% CI [7.14,31.37]). Trust and delegation nevertheless remained distinct. Verification was the dominant policy and often co-occurred with high trust. Delegation also increased with task order after adjustment for momentary and participant-level trust (OR=1.22, 95% CI [1.02,1.45]), indicating an experience-related component that self-reported trust ratings alone could not capture. These findings motivate a shift from intended delegation to a non-intrusive observation of how delegation is enacted in collaborative human-AI tasks. We therefore conclude by proposing enacted delegation traces as a methodological framework for future studies of multimodal and agentic AI use.
Value-Sensitive Delegation in Everyday AI Agent Use: Evidence from OpenClaw
University of Cincinnati(辛辛那提大学);The Pennsylvania State University(宾夕法尼亚州立大学);University of Arizona(亚利桑那大学);University of South Carolina(南卡罗来纳大学);Florida International University(佛罗里达国际大学)
Leveraging Taxonomy and LLMs for Improved Multimodal Hierarchical Classification
University of New South Wales(新南威尔士大学);Deakin University(迪肯大学);University of Southampton(南安普顿大学);Macquarie University(麦考瑞大学);Technology Innovation Institute(技术创新研究院);MBZUAI(穆罕默德·本·扎耶德人工智能大学)
Volumetric Radiology AI in the Era of Multimodal Large Language Models
Fudan University(复旦大学);Northwestern Polytechnical University(西北工业大学);Xi’an Jiaotong University(西安交通大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Southern Medical University(南方医科大学);The Chinese University of Hong Kong(香港中文大学);University of British Columbia(不列颠哥伦比亚大学);Microsoft Research(微软研究院);Westlake University(西湖大学)
MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Models
The Chinese University of Hong Kong(香港中文大学);University of International Relations(国际关系大学);Jarvis Research Center, Tencent YouTu Lab(腾讯YouTu实验室);Westlake University(西湖大学)
Large Language Models Transform Organic Synthesis From Reaction Prediction to Automation
International Research Center for Complexity Sciences, Hangzhou International Innovation Institute, Beihang University(国际复杂科学研究中心,杭州创新研究院,北京航空航天大学);School of Computer Science and Engineering, University of Electronic Science and Technology of China(计算机科学与工程学院,电子科学与技术大学);Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China(长江三角洲地区研究所(湖州),电子科学与技术大学);Government Boys Higher Secondary School, Bukera Sharif, Tando Allahyar, Affiliated with BISE Hyderabad, Sindh, Pakistan(政府男生高级中学,布克里·沙里夫,塔ndo阿勒·耶尔,隶属于Hyderabad BISE,Sindh,巴基斯坦);School of Environment and Architecture, University of Shanghai for Science and Technology(环境与建筑学院,上海科学技术大学)