EyeNavGS:面向VR中真实世界3DGS场景的6自由度导航数据集与录制-回放软件
EyeNavGS: A 6-DoF Navigation Dataset and Record-n-Replay Software for Real-World 3DGS Scenes in VR
AI总结:
EyeNavGS发布了首个面向真实世界3DGS场景的VR 6自由度导航数据集,记录46名参与者的头部姿态与眼动数据,并配套开源录制-回放软件,为视口预测、自适应流媒体和注视点渲染等研究提供资源。
摘要:
3D高斯泼溅(3DGS)是一种新兴的媒体表示方法,能够高保真地重建真实世界3D场景,从而在虚拟现实(VR)中实现6自由度(6-DoF)导航。然而,开发和评估基于3DGS的应用并优化其渲染性能,需要真实的用户导航数据。目前,针对真实世界场景的真实感3DGS重建,此类数据尚不可用。本文介绍了EyeNavGS,这是首个公开可用的6自由度导航数据集,包含46名参与者在十二个多样化的真实世界3DGS场景中探索的轨迹。该数据集在两个地点采集,使用Meta Quest Pro头显,在自由站立式6自由度导航过程中记录每个渲染帧的头部姿态和眼动注视数据。对于这十二个场景中的每一个,我们都进行了细致的场景初始化,以校正场景倾斜和尺度,确保感知舒适的VR体验。我们还发布了开源的SIBR查看器软件分支,具备录制-回放功能,并提供一套用于数据处理、转换和可视化的实用工具。EyeNavGS数据集及其配套软件工具为推进3DGS场景中的6自由度视口预测、自适应流媒体、3D显著性和注视点渲染研究提供了宝贵资源。EyeNavGS数据集可在以下网址获取:https://symmru.github.io/EyeNavGS/。
英文摘要:
3D Gaussian Splatting (3DGS) is an emerging media representation that reconstructs real-world 3D scenes in high fidelity, enabling 6-degrees-of-freedom (6-DoF) navigation in virtual reality (VR). However, developing and evaluating 3DGS-enabled applications and optimizing their rendering performance, require realistic user navigation data. Such data is currently unavailable for photorealistic 3DGS reconstructions of real-world scenes. This paper introduces EyeNavGS (EyeNavGS), the first publicly available 6-DoF navigation dataset featuring traces from 46 participants exploring twelve diverse, real-world 3DGS scenes. The dataset was collected at two sites, using the Meta Quest Pro headsets, recording the head pose and eye gaze data for each rendered frame during free world standing 6-DoF navigation. For each of the twelve scenes, we performed careful scene initialization to correct for scene tilt and scale, ensuring a perceptually-comfortable VR experience. We also release our open-source SIBR viewer software fork with record-and-replay functionalities and a suite of utility tools for data processing, conversion, and visualization. The EyeNavGS dataset and its accompanying software tools provide valuable resources for advancing research in 6-DoF viewport prediction, adaptive streaming, 3D saliency, and foveated rendering for 3DGS scenes. The EyeNavGS dataset is available at: https://symmru.github.io/EyeNavGS/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。