arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1609.01344cs.CV
收藏

虚拟现实中基于视觉的交战检测

Vision-based Engagement Detection in Virtual Reality

Konica Minolta Laboratory U.S.A., Inc.(柯尼卡美能达美国实验室公司);Stanford University(斯坦福大学)

Ghassem Tofighi, Kaamraan Raahemifar, Maria Frank, Haisong Gu

摘要:

基于视觉界面的用户交互行为建模是用户心理状态检测的重要研究课题之一。在虚拟现实环境中,使用摄像机传感器来识别人类活动,我们必须知道用户何时打算执行动作,何时不打算。如果没有一个合适的算法来识别参与状态,任何类型的活动都可以被解释为操纵行为,称为“点石成金”问题。解决这一问题的基本方法是使用一些焦点手势(如放弃或举手)来激活手势识别系统。然而,理想的自然用户界面应该能够自动地理解用户的心理状态。本文提出了一种新的多模态交战检测模型DAIA。使用DAIA,用于执行动作的精神状态的频谱被量化为有限数量的参与状态。为此,设计了有限状态传感器(FST)。该参与框架展示了如何整合来自用户生物特征数据流(如2D和3D成像)的多模态信息。FST是使用几个布尔表达式的组合,使状态过渡顺利。我们的FST真正的检测率是92.3%,在四个不同的国家。实验结果还表明,FST可以分割用户的手势更强大。

英文摘要:

User engagement modeling for manipulating actions in vision-based interfaces is one of the most important case studies of user mental state detection. In a Virtual Reality environment that employs camera sensors to recognize human activities, we have to know when user intends to perform an action and when not. Without a proper algorithm for recognizing engagement status, any kind of activities could be interpreted as manipulating actions, called "Midas Touch" problem. Baseline approach for solving this problem is activating gesture recognition system using some focus gestures such as waiving or raising hand. However, a desirable natural user interface should be able to understand user's mental status automatically. In this paper, a novel multi-modal model for engagement detection, DAIA, is presented. using DAIA, the spectrum of mental status for performing an action is quantized in a finite number of engagement states. For this purpose, a Finite State Transducer (FST) is designed. This engagement framework shows how to integrate multi-modal information from user biometric data streams such as 2D and 3D imaging. FST is employed to make the state transition smoothly using combination of several boolean expressions. Our FST true detection rate is 92.3% in total for four different states. Results also show FST can segment user hand gestures more robustly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑