在视野内还是视野外?一种推断并响应人类视野的视觉感知过滤器
In View or Out of View? A Vision-Aware Filter that Infers and Reacts to the Human's Field of View
AI总结:
该研究提出一种视觉感知过滤器,可推断人类视野并据此调整机器人动作,在协作烹饪和驾驶场景中,能提升人机交互的任务完成量并减少碰撞。
摘要:
在人机交互过程中,视觉发挥着重要作用。当人类看到机器人时,他们可以观察机器人的动作并更好地预测机器人的未来行为;相反,当人类看不到机器人时,他们会对机器人的意图和计划感到不确定。本文聚焦于人类的视野,现有的人类感知规划器要么忽略该视野,假设人类可以观察整个场景,要么刻意设计交互方式,使机器人始终处于人类的视野内。相比之下,我们让机器人在交互过程中推断人类已看到和未看到的内容,即人类的视野,随后将该估计作为视觉感知过滤器应用于机器人的动作。给定一个标称机器人策略和交互模型,我们在短时间范围内展开该策略,观察机器人状态如何更新,再根据动作对机器人预测可见性的影响对动作进行重新加权:将更高的权重分配给使机器人进入或远离人类视线的动作。在实践中,我们的框架提供了一种在线估计和过滤过程,该过程会反复更新对人类视野的理解,然后基于人类视觉局部调整机器人动作。我们在协助人类协作烹饪的机器人以及在驾驶环境中与人类协作的机器人上评估了该视觉感知过滤器。通过模拟和12名参与者的用户研究,我们发现该视觉感知过滤器既改变了性能又改变了偏好:参与者在烹饪时借助视野内的协助完成了三倍以上的子任务,在驾驶时与故意保持在视野外的汽车发生的碰撞更少。
英文摘要:
During human-robot interaction, sight plays an important role. When the human sees a robot, they can observe the robot's actions and better predict the robot's future behaviors. Conversely, when the human cannot see the robot, they become uncertain about the robot's intent and plans. In this paper, we focus on the human's field of view. Existing human-aware planners either ignore this field of view and assume the human can observe the entire scene, or intentionally design their interactions so the robot is always visible to the human. By contrast, we enable robots to infer what the human has and has not seen during interaction, i.e., the human's field of view. We then apply this estimate as a vision-aware filter on the robot's actions. Given a nominal robot policy and a model of the interaction, we roll out the policy over a short horizon to see how the robot's state updates. We then reweight the actions based on how those actions impact the robot's predicted visibility: higher weights are assigned to actions that bring the robot into (or away from) the human's line of sight. In practice, our framework provides an online estimation and filtering process that repeatedly updates its understanding of the human's field of view and then locally perturbs robot actions based on the human's vision. We evaluate our vision-aware filter on robots that assist humans in collaborative cooking and coordinate with them in driving environments. Across simulations and a 12-participant user study, we find that our vision-aware filter changes both performance and preference: participants completed over three times as many subtasks with in-view assistance while cooking, and had fewer collisions with cars that purposely stayed out of their view while driving.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。