在解码器处具有非复杂导航的交互式多视图视频系统
Interactive multiview video system with non-complex navigation at the decoder
摘要:
在接收器处具有交互式和平滑视图切换的多视图视频是具有挑战性的应用,在存储和带宽资源的有效使用、系统的反应性、观看体验的质量和系统复杂性方面存在若干问题。用于生成虚拟视图的经典解码系统首先将参考或编码帧投影到给定视点,然后填充由于潜在遮挡而导致的孔。这最后一步仍然构成了在接收机处使用特定软件或硬件的复杂操作,并且需要来自相邻帧的一定量的信息以确保虚拟图像之间的一致性。在这项工作中,我们提出了一种新的方法,转移大部分的负担,由于从解码器到编码器的交互性,通过预期的解码器的导航和发送辅助信息,保证时间和采访的一致性。这导致了额外的成本,在传输速率和存储,我们最大限度地减少使用基于用户行为建模的优化技术。我们通过实验表明,该系统是一个有效的解决方案,交互式多视图系统与经典的解码器。
英文摘要:
Multiview video with interactive and smooth view switching at the receiver is a challenging application with several issues in terms of effective use of storage and bandwidth resources, reactivity of the system, quality of the viewing experience and system complexity. The classical decoding system for generating virtual views first projects a reference or encoded frame to a given viewpoint and then fills in the holes due to potential occlusions. This last step still constitutes a complex operation with specific software or hardware at the receiver and requires a certain quantity of information from the neighboring frames for insuring consistency between the virtual images. In this work we propose a new approach that shifts most of the burden due to interactivity from the decoder to the encoder, by anticipating the navigation of the decoder and sending auxiliary information that guarantees temporal and interview consistency. This leads to an additional cost in terms of transmission rate and storage, which we minimize by using optimization techniques based on the user behavior modeling. We show by experiments that the proposed system represents a valid solution for interactive multiview systems with classical decoders.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。