超越单目观看：VR中3D高斯泼溅质量研究
Beyond Monoscopic Viewing: A Study on 3D Gaussian Splatting Quality in VR
- Linköping University（林雪平大学）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
本研究通过用户实验发现，立体观看下3DGS重建的感知质量优于单目，标准图像指标无法捕捉立体伪影，强调VR中需采用立体评估。
AI中文摘要：
立体视觉是虚拟现实（VR）的基础，通过双眼观看提供深度感知。3D高斯泼溅（3DGS）的最新进展实现了高质量的新视角合成，使其非常适合沉浸式VR。我们以立体方式渲染3DGS重建，并在头戴式显示器中评估它们，模拟它们在VR中的实际观看方式。真实世界捕捉仅提供有限数量的视角，在这种约束下，3DGS重建经常产生局部漂浮物和错位结构。标准指标忽略了这些局部伪影，而在立体观看下，这些伪影变得显著，因为几何被放置在错误的深度。我们研究了在减少捕捉的情况下，标准图像质量评估是否反映3DGS重建的感知质量。我们将仅使用SfM的基线与结合SfM和密集VGGT网络的联合初始化进行比较。所有其他训练组件保持固定，从而隔离初始化覆盖的影响。我们进行了一项用户研究，比较在单目和立体HMD观看下的偏好，并测试图像质量指标是否预测观察到的偏好。在单目观看下，对更一致重建的偏好较弱，总体达到58.4%。在立体观看下，相同的偏好上升到78.2%，并且在所有参与者中一致，而图像质量指标（PSNR、SSIM和LPIPS）和立体感知指标（iSQoe和StereoQA）仅显示出适度差异，未能惩罚这些伪影。我们的结果表明，单目评估和标准图像质量指标严重低估了VR中3DGS重建中观察到的感知伪影，使得立体评估对于VR中的3DGS质量评估至关重要。
英文摘要：
Stereoscopy is fundamental to virtual reality (VR), providing depth perception through binocular viewing. Recent advances in 3D Gaussian Splatting (3DGS) enable high-quality novel view synthesis, making it well suited to immersive VR. We render 3DGS reconstructions stereoscopically and evaluate them in a head-mounted display, replicating how they would actually be viewed in VR. Real-world capture provides only a limited number of views, and under this constraint 3DGS reconstruction often produces localized floaters and misplaced structures. Standard metrics miss these localized artifacts, which become salient under stereoscopic viewing, where geometry is placed at the wrong depth. We investigate whether standard image-quality evaluation reflects the perceptual quality of 3DGS reconstructions under reduced capture. We compare SfM-only baseline with a union initialization that combines SfM with a dense VGGT network. All other training components are held fixed, isolating the effect of initialization coverage. We conduct a user study comparing preferences under monoscopic and stereoscopic HMD viewing, and test whether image-quality metrics predict the observed preferences. Monoscopically, preference for the more consistent reconstruction is weak, reaching 58.4\% overall. Stereoscopically, the same preference rises to 78.2\% and is consistent across all participants, while image-quality metrics (PSNR, SSIM and LPIPS) and stereo-aware metrics (iSQoe and StereoQA) show only modest differences and fail to penalize them. Our results indicate that monoscopic evaluation and standard image-quality metrics substantially underestimate perceptual artifacts observed in 3DGS reconstructions for VR, making stereoscopic assessment essential for 3DGS quality evaluation in VR.
