arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.13689cs.AI
收藏

从人类VR演示中自动获取操纵活动的结构化语义模型

Automated acquisition of structured, semantic models of manipulation activities from human VR demonstration

Institute for Artificial Intelligence, University of Bremen(不来梅大学人工智能研究所)

Andrei Haidu, Michael Beetz

摘要:

在本文中,我们提出了一个系统,能够收集和注释,人类执行,机器人理解,从虚拟环境中的日常活动。使用具有全身和眼动追踪能力的现成虚拟现实设备,将人类运动映射到模拟世界中。虚拟世界中的所有交互都是物理模拟的,因此运动及其效果与现实世界密切相关。在活动执行期间,子符号数据记录器以每帧为基础记录环境和人类注视,从而实现离线场景再现和回放。与物理引擎相结合,在线监视器(符号数据记录器)正在解析(使用各种语法)并记录事件,动作及其在模拟世界中的影响。

英文摘要:

In this paper we present a system capable of collecting and annotating, human performed, robot understandable, everyday activities from virtual environments. The human movements are mapped in the simulated world using off-the-shelf virtual reality devices with full body, and eye tracking capabilities. All the interactions in the virtual world are physically simulated, thus movements and their effects are closely relatable to the real world. During the activity execution, a subsymbolic data logger is recording the environment and the human gaze on a per-frame basis, enabling offline scene reproduction and replays. Coupled with the physics engine, online monitors (symbolic data loggers) are parsing (using various grammars) and recording events, actions, and their effects in the simulated world.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑