arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.06608cs.ARcs.GR
收藏

Potamoi:通过统一流式架构加速神经渲染

Potamoi: Accelerating Neural Rendering via a Unified Streaming Architecture

Yu Feng, Weikai Lin, Zihan Liu, Jingwen Leng, Minyi Guo, Han Zhao, Xiaofeng Hou, Jieru Zhao, Yuhao Zhu

AI总结:

本研究针对NeRF在资源受限设备上难以实时渲染的问题,提出统一架构Potamoi,结合即插即用算法SpaRW与定制硬件优化存储效率,实现53.1倍提速与67.7倍节能,且画质损失极小。

摘要:

神经辐射场(Neural Radiance Field, NeRF)已成为实现照片级真实感渲染的一种极具前景的替代方案。尽管近年来算法层面取得了诸多进展,但在当前资源受限的设备上实现实时性能仍颇具挑战。本文明确了现有NeRF算法的主要瓶颈,并提出了一种算法与架构协同设计的统一框架Potamoi,旨在适配多种NeRF算法。具体而言,我们设计了一套运行时系统,搭载即插即用算法SpaRW,可大幅降低每帧计算负载并缓解计算效率低下的问题。此外,我们的统一流式流水线搭配定制化硬件支持,通过最大限度减少重复DRAM访问并彻底消除SRAM体冲突,有效解决了SRAM与DRAM的效率问题。与采用专用DNN加速器的基线方案相比,我们的框架实现了53.1倍的速度提升与67.7倍的能耗降低,同时保持了高视觉质量,峰值信噪比下降幅度不足1.0 dB。

英文摘要:

Neural Radiance Field (NeRF) has emerged as a promising alternative for photorealistic rendering. Despite recent algorithmic advancements, achieving real-time performance on today's resource-constrained devices remains challenging. In this paper, we identify the primary bottlenecks in current NeRF algorithms and introduce a unified algorithm-architecture co-design, Potamoi, designed to accommodate various NeRF algorithms. Specifically, we introduce a runtime system featuring a plug-and-play algorithm, SpaRW, which significantly reduces the per-frame computational workload and alleviates compute inefficiencies. Furthermore, our unified streaming pipeline coupled with customized hardware support effectively tames both SRAM and DRAM inefficiencies by minimizing repetitive DRAM access and completely eliminating SRAM bank conflicts. When evaluated against a baseline utilizing a dedicated DNN accelerator, our framework demonstrates a speed-up and energy reduction of 53.1$\times$ and 67.7$\times$, respectively, all while maintaining high visual quality with less than a 1.0 dB reduction in peak signal-to-noise ratio.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑