arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.00441cs.GRcs.HC
收藏

利用人类颜色辨别能力实现虚拟现实中节省内存与能耗的图像编码

Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality

Nisarg Ujjainkar, Ethan Shahan, Kenneth Chen, Budmonde Duinkharjav, Qi Sun, Yuhao Zhu

AI总结:

本文提出一种感知无损、数值有损的 VR 帧缓冲压缩方法,利用人类中央与周边视觉的颜色辨别局限调整像素颜色,并结合轻量硬件支持实时降低 DRAM 流量与能耗。

摘要:

虚拟现实(VR)有潜力成为下一个普适计算平台。这一新兴领域的持续发展在很大程度上依赖高效的计算基础。尤其是,众所周知 DRAM 访问能耗在系统能耗中占据相当大的比例。当前的帧缓冲压缩系统通过采用数值无损压缩算法来缓解 DRAM 流量。然而,为保持人类的感知质量,数值无损并非必要。本文提出一种感知无损但数值有损的系统,用于压缩 DRAM 流量。我们的思路建立在长期以来的心理物理学研究之上:这些研究表明,人类无法辨别彼此接近的颜色。在周边视觉中,这种辨别能力会变得更弱,即更多颜色在感知上不可区分。利用颜色辨别能力(或其局限性),我们提出一种算法,通过调整像素颜色来最小化比特编码成本,同时不引入可见伪影。该算法与轻量级架构支持相结合,可实时将 DRAM 流量降低 66.9%,并且相比现有帧缓冲压缩机制最高提升 20.4%。针对人类参与者的心理物理学研究表明,我们的系统几乎不会造成感知保真度下降。

英文摘要:

Virtual Reality (VR) has the potential of becoming the next ubiquitous computing platform. Continued progress in the burgeoning field of VR depends critically on an efficient computing substrate. In particular, DRAM access energy is known to contribute to a significant portion of system energy. Today's framebuffer compression system alleviates the DRAM traffic by using a numerically lossless compression algorithm. Being numerically lossless, however, is unnecessary to preserve perceptual quality for humans. This paper proposes a perceptually lossless, but numerically lossy, system to compress DRAM traffic. Our idea builds on top of long-established psychophysical studies that show that humans cannot discriminate colors that are close to each other. The discrimination ability becomes even weaker (i.e., more colors are perceptually indistinguishable) in our peripheral vision. Leveraging the color discrimination (in)ability, we propose an algorithm that adjusts pixel colors to minimize the bit encoding cost without introducing visible artifacts. The algorithm is coupled with lightweight architectural support that, in real-time, reduces the DRAM traffic by 66.9\% and outperforms existing framebuffer compression mechanisms by up to 20.4\%. Psychophysical studies on human participants show that our system introduce little to no perceptual fidelity degradation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑