arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.11239cs.CV
收藏

HoloLens 2研究模式作为计算机视觉研究的工具

HoloLens 2 Research Mode as a Tool for Computer Vision Research

Microsoft(微软)
Dorin Ungureanu, Federica Bogo, Silvano Galliani, Pooja Sama, Xin Duan, Casey Meekhof, Jan Stühmer, Thomas J. Cashman, Bugra Tekin, Johannes L. Schönberger, Paw… 展开作者

Dorin Ungureanu, Federica Bogo, Silvano Galliani, Pooja Sama, Xin Duan, Casey Meekhof, Jan Stühmer, Thomas J. Cashman, Bugra Tekin, Johannes L. Schönberger, Pawel Olszta, Marc Pollefeys

摘要:

混合现实头戴设备,如微软HoloLens 2,是具有集成计算能力的强大传感设备,这使其成为计算机视觉研究的理想平台。在这份技术报告中,我们介绍了HoloLens 2研究模式,一个API和一组工具,可以访问原始传感器流。我们提供了API的概述,并解释了如何使用它来构建基于处理传感器数据的混合现实应用程序。我们还展示了如何将研究模式传感器数据与HoloLens 2提供的内置眼睛和手部跟踪功能相结合。通过发布研究模式API和一系列开源工具,我们的目标是促进计算机视觉和机器人领域的进一步研究,并鼓励研究界做出贡献。

英文摘要:

Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑