PESAO:主动观察者的心理物理实验装置
PESAO: Psychophysical Experimental Setup for Active Observers
摘要:
大多数过去和现在的计算机视觉研究都涉及被动观察的数据。然而,人类是实验室之外的积极观察者;他们探索,搜索,选择看什么以及如何看。尽管如此,如何准确地在人类中进行主动观察,以便它可以为主动计算机视觉系统的设计提供信息,这是一个悬而未决的问题。PESAO旨在研究3D世界中的主动视觉观察。我们的目标是建立一个实验装置,用于各种主动感知任务,其中考虑到人类受试者(主动观察者)能够跟踪头部和凝视。虽然许多研究探索人类的表现,但通常,他们使用2D描绘的线条画,没有主动观察者参与。PESAO使我们能够将许多研究带到三维世界,甚至涉及主动观察者。在我们的实例中,它跨越400 cm x 300 cm的区域,可以以120 Hz的频率跟踪活跃的观察者。此外,PESAO提供跟踪和记录6D头部运动,凝视,眼睛运动类型,第一人称视频,头戴式IMU传感器,鸟瞰视频和实验者笔记。所有这些都以微秒级的分辨率同步。
英文摘要:
Most past and present research in computer vision involves passively observed data. Humans, however, are active observers outside the lab; they explore, search, select what and how to look. Nonetheless, how exactly active observation occurs in humans so that it can inform the design of active computer vision systems is an open problem. PESAO is designed for investigating active, visual observation in a 3D world. The goal was to build an experimental setup for various active perception tasks with human subjects (active observers) in mind that is capable of tracking the head and gaze. While many studies explore human performances, usually, they use line drawings portrayed in 2D, and no active observer is involved. PESAO allows us to bring many studies to the three-dimensional world, even involving active observers. In our instantiation, it spans an area of 400cm x 300cm and can track active observers at a frequency of 120Hz. Furthermore, PESAO provides tracking and recording of 6D head motion, gaze, eye movement-type, first-person video, head-mounted IMU sensor, birds-eye video, and experimenter notes. All are synchronized at microsecond resolution.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。