GeoFovea-GS:用于无线空中VR的几何感知跨层高斯点渲染
GeoFovea-GS: Geometry-Aware Cross-Layer Gaussian Splatting for Wireless Aerial VR
AI总结:
针对无线空中VR中高分辨率视图生成和传输受限,3DGS有几何误差问题,本文提出GeoFovea-GS框架,开发失真度量,将渲染与传输联合选择设为跨层优化问题并设计调度器,实验证明其能降成本提渲染质量。
AI中文摘要:
无线空中虚拟现实(VR)旨在提供对大规模场景的沉浸式访问,但高分辨率视图生成和传输受到带宽、延迟和功率的限制。3D高斯点渲染(3DGS)可通过紧凑姿态信息渲染视图来减少负载,但其几何误差会导致VR质量严重下降。现有方案无法捕捉此类几何敏感失真。本文提出GeoFovea-GS作为通信高效的无线空中VR几何感知跨层框架。开发了一种中心凹几何感知失真度量来统一表征光度渲染误差、几何不一致和视图相关感知重要性。基于此度量,将仅姿态3DGS渲染和图像/瓦片校正传输的联合选择制定为无线约束下的跨层优化问题。还开发了轻量级信息价值调度器,将通信资源分配给几何关键且感知重要的区域。在真实3DGS场景上的实验表明,GeoFovea-GS在大幅降低传输成本的情况下实现了卓越的沉浸式渲染质量。
英文摘要:
Wireless aerial virtual reality (VR) aims to provide immersive access to large-scale scenes, but high-resolution view generation and delivery are jointly constrained by limited bandwidth, latency, and power. 3D Gaussian Splatting (3DGS) can reduce the payload by rendering views from compact pose information, yet its geometry errors may cause severe VR quality degradation. Existing channel-aware or pixel-level resource allocation schemes fail to capture such geometry-sensitive distortion. To address this issue, this paper proposes GeoFovea-GS as a geometry-aware cross-layer framework for communication-efficient wireless aerial VR. A foveated geometry-aware distortion metric is developed to characterize photometric rendering error, geometric inconsistency, and view-dependent perceptual importance in a unified form. Based on this metric, the joint selection of pose-only 3DGS rendering and image/tile correction transmission is formulated as a cross-layer optimization problem under wireless constraints. A lightweight value-of-information scheduler is further developed to allocate communication resources to regions that are both geometry-critical and perceptually important. Experiments on real-world 3DGS scenes demonstrate that GeoFovea-GS achieves superior immersive rendering quality with substantially reduced transmission cost.