arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.03390cs.CVcs.GR

TemporalGS:通过时间先验实现无训练即插即用的3D高斯点渲染加速

TemporalGS: Training-Free Plug-and-Play Acceleration for 3D Gaussian Splatting Rendering via Temporal Priors

McGill University(麦吉尔大学);University of Waterloo(滑铁卢大学);Concordia University(康考迪亚大学);University of Toronto(多伦多大学)

Yuhongze Zhou, Zihao Yang, Xinxin Zuo, Juwei Lu

AI总结:

研究针对3D高斯点渲染在高帧率和低延迟方面的挑战,提出TemporalGS,利用时间先验减少连续帧高斯预处理等操作冗余,有动态剔除和选择性渲染策略,可加速渲染且无需训练。

摘要:

3D高斯点渲染(3DGS)凭借快速且高保真的渲染革新了新视图合成。然而,在各种场景下实现高帧率和低延迟渲染仍是挑战。我们引入TemporalGS,这是首个无训练即插即用算法,在基于瓦片的软件光栅化之上实现,利用时间先验减少高斯预处理等操作冗余,提出两种加速策略,实验表明其能显著提升渲染速度。

英文摘要:

3D Gaussian Splatting (3DGS) has revolutionized novel-view synthesis with its fast and high-fidelity rendering. However, rendering at high FPS and low latency across various scenes remains a challenge, especially when large amounts of 3D Gaussian ellipsoids appear in the scene. To address this issue, we introduce TemporalGS, to the best of our knowledge, the first training-free plug-and-play algorithmic approach to accelerate 3DGS rendering without any post-training or post-processing, implemented on top of tile-based software rasterization. The key idea is that, instead of rendering frames independently as 3DGS, we leverage the temporal priors, represented by novel geometry and appearance buffers, etc., to reduce redundancy of Gaussian preprocessing, sorting, and rasterization operations of consecutive frames. Specifically, we propose two acceleration strategies: (1) temporal dynamic culling, which filters out Gaussians that contribute less to current frame rendering; (2) selective rendering, which renders only a small portion of tiles that cannot be approximated by the temporal priors. By adapting and interleaving these two strategies, TemporalGS yields a simple but effective plug-and-play solution for 3DGS rendering speed-up without any training. Extensive experiments show that TemporalGS achieves comparable or even better performance compared to existing state-of-the-art post-training or post-processing-based 3DGS rendering acceleration approaches. TemporalGS can significantly enhance the rendering speed of various 3DGS methods, achieving up to $1.48\times$ acceleration, while maintaining competitive rendering quality. We further extend our TemporalGS to hardware rasterization-based 3DGS to show the portability of our algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑