VoLUT: 通过基于LUT的超分辨率提升体积流效率
VoLUT: Efficient Volumetric streaming enhanced by LUT-based super-resolution
AI总结：
VoLUT通过基于LUT的超分辨率算法，在移动设备上实现高效体积视频流媒体，减少带宽使用并提升用户体验。
摘要：
三维体积视频提供了沉浸式体验，并在数字媒体中日益受到关注。尽管其受欢迎程度不断上升，但体积视频内容的流媒体却因高数据带宽需求而带来了显著挑战。一种缓解带宽问题的自然方法是在传输前通过下采样减少体积视频的数据率。视频可以在接收端使用超分辨率（SR）算法进行上采样，以重建高分辨率细节。虽然超分辨率技术已被广泛研究并应用于2D视频内容，但针对体积视频的SR算法却研究较少。为解决这一差距和对高效体积视频流媒体的日益增长的需求，我们开发了VoLUT，其中包含一种专门为体积内容设计的新SR算法。我们的算法独特地利用了查找表（LUTs）的功率，以实现低分辨率体积数据的高效准确上采样。LUTs的使用使我们的算法能够快速参考预先计算的高分辨率值，从而显著降低上采样的计算复杂度和时间。我们进一步应用自适应视频比特率算法（ABR）来根据网络状况动态确定下采样率，并将所选视频速率流式传输到接收端。与相关工作相比，VoLUT是首个能够在消费级移动设备上以线速率实现高质量3D SR的方案。我们的评估显示，VoLUT可以将带宽使用减少70%，提升体积视频流媒体的QoE 36.7%，并实现无质量妥协的3D SR加速。
英文摘要：
3D volumetric video provides immersive experience and is gaining traction in digital media. Despite its rising popularity, the streaming of volumetric video content poses significant challenges due to the high data bandwidth requirement. A natural approach to mitigate the bandwidth issue is to reduce the volumetric video's data rate by downsampling the content prior to transmission. The video can then be upsampled at the receiver's end using a super-resolution (SR) algorithm to reconstruct the high-resolution details. While super-resolution techniques have been extensively explored and advanced for 2D video content, there is limited work on SR algorithms tailored for volumetric videos. To address this gap and the growing need for efficient volumetric video streaming, we have developed VoLUT with a new SR algorithm specifically designed for volumetric content. Our algorithm uniquely harnesses the power of lookup tables (LUTs) to facilitate the efficient and accurate upscaling of low-resolution volumetric data. The use of LUTs enables our algorithm to quickly reference precomputed high-resolution values, thereby significantly reducing the computational complexity and time required for upscaling. We further apply adaptive video bit rate algorithm (ABR) to dynamically determine the downsampling rate according to the network condition and stream the selected video rate to the receiver. Compared to related work, VoLUT is the first to enable high-quality 3D SR on commodity mobile devices at line-rate. Our evaluation shows VoLUT can reduce bandwidth usage by 70% , boost QoE by 36.7% for volumetric video streaming and achieve 3D SR speed-up with no quality compromise.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
