半自主信息物理系统的信息型接管请求设计:无人机控制器场景下口语与视觉图标结合的研究
The Design of Informative Take-Over Requests for Semi-Autonomous Cyber-Physical Systems: Combining Spoken Language and Visual Icons in a Drone-Controller Setting
AI总结:
本研究针对半自主信息物理系统的人机交互接管问题,结合语音与视觉高亮设计双模态信息型接管请求,经无人机控制场景线上实验验证其可提升用户决策准确率,但语音片段化、视听同步未带来额外增益。
摘要:
随着信息物理系统(cyber-physical systems)被应用于越来越广泛的任务领域,这类系统应如何与可接管控制权或履行监督职责的人类伙伴交互的问题正变得愈发紧迫。我们借鉴半自动驾驶场景下控制权交接以及人机交互领域的相关文献,提出了一种接管请求(take-over request,TOR)设计方案:该方案将抽象预告警与信息型TOR相结合,在控制器显示屏上高亮显示相关传感器信息,同时通过语音消息播报TOR的触发原因。我们以半自主无人机控制场景作为测试平台开展研究。本次线上研究的目标是更细致地评估基于语言的TOR应采用何种形式。具体而言,我们对比了完整句子条件与更短的片段条件,并测试了视觉高亮应与语音同步呈现还是异步呈现。实验结果显示,参与者在使用我们的双模态TOR时选择正确解决方案的准确率更高,且认为自己能更好地识别危急情况。仅使用语音片段而非完整句子的条件并未提升准确率或加快反应速度。此外,将视觉高亮与语音消息同步也未带来准确率的提升,该条件下的反应时间甚至有所增加。
英文摘要:
The question of how cyber-physical systems should interact with human partners that can take over control or exert oversight is becoming more pressing, as these systems are deployed for an ever larger range of tasks. Drawing on the literatures on handing over control during semi-autonomous driving and human-robot interaction, we propose a design of a take-over request that combines an abstract pre-alert with an informative TOR: Relevant sensor information is highlighted on the controller's display, while a spoken message verbalizes the reason for the TOR. We conduct our study in the context of a semi-autonomous drone control scenario as our testbed. The goal of our online study is to assess in more detail what form a language-based TOR should take. Specifically, we compare a full sentence condition to shorter fragments, and test whether the visual highlighting should be done synchronously or asynchronously with the speech. Participants showed a higher accuracy in choosing the correct solution with our bi-modal TOR and felt that they were better able to recognize the critical situation. Using only fragments in the spoken message rather than full sentences did not lead to improved accuracy or faster reactions. Also, synchronizing the visual highlighting with the spoken message did not result in better accuracy and response times were even increased in this condition.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。