arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1701.02586cs.HC
收藏

使用眼镜计算机自动捕获和提供辅助任务指导:GlaciAR系统

Automated capture and delivery of assistive task guidance with an eyewear computer: The GlaciAR system

Teesid Leelasawassuk, Dima Damen, Walterio Mayol-Cuevas

摘要:

在本文中,我们描述和评估的混合现实系统,旨在增强用户的任务指导应用相结合的自动化和无监督的信息收集与微创视频指南。其结果是一个自包含的系统,我们称之为GlaciAR(用于增强现实的启用玻璃的上下文交互),该系统通过从观察用户执行的动作中提取上下文交互来运行。GlaciAR能够i)基于头部运动注意力模型自动确定相关时刻,ii)自动生成视频指导信息,iii)基于目标检测方法触发这些视频指导,iv)通过观察多个用户而无需监督地学习,以及v)完全在当前眼镜计算机(Google Glass)上运行。我们描述了GlaciAR的组成部分,以及对用户如何使用该系统实现三项任务的评估。我们认为这项工作是朝着开发系统的第一步,该系统旨在扩大指导系统中众所周知的困难创作问题,并通过微创视觉指导增强人们的自然能力。

英文摘要:

In this paper we describe and evaluate a mixed reality system that aims to augment users in task guidance applications by combining automated and unsupervised information collection with minimally invasive video guides. The result is a self-contained system that we call GlaciAR (Glass-enabled Contextual Interactions for Augmented Reality), that operates by extracting contextual interactions from observing users performing actions. GlaciAR is able to i) automatically determine moments of relevance based on a head motion attention model, ii) automatically produce video guidance information, iii) trigger these video guides based on an object detection method, iv) learn without supervision from observing multiple users and v) operate fully on-board a current eyewear computer (Google Glass). We describe the components of GlaciAR together with evaluations on how users are able to use the system to achieve three tasks. We see this work as a first step toward the development of systems that aim to scale up the notoriously difficult authoring problem in guidance systems and where people's natural abilities are enhanced via minimally invasive visual guidance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑