arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.06875eess.SYcs.HCcs.SY
收藏

基于空间稀疏单像素探测器的光学视线跟踪

Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors

Richard Li, Eric Whitmire, Michael Stengel, Ben Boudaoud, Jan Kautz, David Luebke, Shwetak Patel, Kaan Akşit

摘要:

注视跟踪是用于虚拟现实和增强现实应用的下一代显示器的重要组成部分。已知在下一代显示器中使用的传统的基于相机的凝视跟踪器在以下度量中的一个或多个方面缺乏:功耗、成本、计算复杂度、估计准确度、延迟和形状因数。我们建议使用分立的光电二极管和发光二极管(LED)作为替代传统的基于相机的视线跟踪方法,同时考虑到所有这些指标。我们首先开发一个基于渲染的模拟框架,用于理解光源和虚拟模型眼球之间的关系。从这个框架的结果用于LED和光电二极管的位置。我们的第一个原型使用神经网络,在400 Hz下获得2.67°的平均误差率,同时只需16 mW。通过将实现简化为仅使用LED,作为光收发器,以及更小的机器学习模型,即轻量级监督高斯过程回归算法,我们表明我们的第二个原型能够在250 Hz使用800 mW时的平均错误率为1.57°。

英文摘要:

Gaze tracking is an essential component of next generation displays for virtual reality and augmented reality applications. Traditional camera-based gaze trackers used in next generation displays are known to be lacking in one or multiple of the following metrics: power consumption, cost, computational complexity, estimation accuracy, latency, and form-factor. We propose the use of discrete photodiodes and light-emitting diodes (LEDs) as an alternative to traditional camera-based gaze tracking approaches while taking all of these metrics into consideration. We begin by developing a rendering-based simulation framework for understanding the relationship between light sources and a virtual model eyeball. Findings from this framework are used for the placement of LEDs and photodiodes. Our first prototype uses a neural network to obtain an average error rate of 2.67° at 400Hz while demanding only 16mW. By simplifying the implementation to using only LEDs, duplexed as light transceivers, and more minimal machine learning model, namely a light-weight supervised Gaussian process regression algorithm, we show that our second prototype is capable of an average error rate of 1.57° at 250 Hz using 800 mW.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑