DeformStream：基于变形的自适应体积视频流传输
DeformStream: Deformation-based Adaptive Volumetric Video Streaming
AI总结：
提出DeformStream框架，利用嵌入式变形从帧间运动重建后续帧，并设计QoE模型与动态规划算法优化网络适应性与质量带宽权衡，显著提升了体积视频流传输的带宽效率和视觉质量。
摘要：
体积视频流传输提供了沉浸式的3D体验，但由于实时传输详细内容面临高带宽需求和延迟问题，这带来了重大挑战。传统的点云流传输方法在放大时会损害视觉质量，而神经渲染技术对于实时应用来说计算量过大。尽管基于网格的流传输因保留表面细节和连通性而脱颖而出，为3D内容提供了更精细的表示，但传统的网格流传输方法通常基于逐帧传输数据，未能充分利用帧间的时间冗余。这导致了带宽使用效率低下且对波动的网络条件适应性差。我们引入了基于变形的自适应体积视频流传输，这是一种新颖的框架，通过利用基于网格表示的固有可变形性来增强体积视频流传输性能。DeformStream使用嵌入式变形从帧间运动中重建后续帧，在确保帧间视觉连贯性的同时显著减少了带宽使用。为了解决帧重建开销和网络适应性问题，我们制定了一个新的QoE模型，该模型考虑了客户端的变形延迟，并设计了一种动态规划算法，以在不断变化的网络条件下优化视觉质量和带宽消耗之间的权衡。我们的评估表明，基于变形的自适应体积视频流传输在带宽效率和视觉质量方面均优于现有的基于网格的流传输系统，为实时体积视频应用提供了稳健的解决方案。
英文摘要：
Volumetric video streaming offers immersive 3D experiences but faces significant challenges due to high bandwidth requirements and latency issues in transmitting detailed content in real time. Traditional methods like point cloud streaming compromise visual quality when zoomed in, and neural rendering techniques are too computationally intensive for real-time use. Though mesh-based streaming stands out by preserving surface detail and connectivity, offering a more refined representation for 3D content, traditional mesh streaming methods typically transmit data on a per-frame basis, failing to take full advantage of temporal redundancies across frames. This results in inefficient bandwidth usage and poor adaptability to fluctuating network conditions. We introduce Deformation-based Adaptive Volumetric Video Streaming, a novel framework that enhances volumetric video streaming performance by leveraging the inherent deformability of mesh-based representations. DeformStream uses embedded deformation to reconstruct subsequent frames from inter-frame motion, significantly reducing bandwidth usage while ensuring visual coherence between frames. To address frame reconstruction overhead and network adaptability, we formulate a new QoE model that accounts for client-side deformation latency and design a dynamic programming algorithm to optimize the trade-off between visual quality and bandwidth consumption under varying network conditions. Our evaluation demonstrates that Deformation-based Adaptive Volumetric Video Streaming outperforms existing mesh-based streaming systems in both bandwidth efficiency and visual quality, offering a robust solution for real-time volumetric video applications.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
