一种基于真实光场可伸缩混合分层表示的裸眼3D显示分层编码方案
A Hierarchical Coding Scheme for Glasses-free 3D Displays Based on Scalable Hybrid Layered Representation of Real-World Light Fields
摘要：
提出了一种基于低秩乘法层和傅立叶视差层透射模式的分层光场编码方案。该方案从不同扫描顺序确定的光场视图的子集中学习堆叠的乘法层。乘法层使用快速数据驱动的卷积神经网络（CNN）进行优化。利用层模式的空间相关性，在Krylov子空间上通过奇异值分解得到的因子分解中具有不同的低秩。此外，利用HEVC进行编码有效地去除了低秩近似层中的视图内和视图间相关性。来自乘法表示的近似解码视图的初始子集用于构造傅立叶视差层（FDL）表示。FDL模型合成由预定义的分层预测顺序识别的视图的第二子集。通过对残差信号进行编码，进一步消除了合成视图的预测残差之间的相关性。采用从解码残差获得的视图的集合，以便改进FDL模型并且以改进的准确度预测视图的下一子集。重复该分层过程，直到所有光场视图都被编码。建议的混合分层表示和编码方案的关键优点是，它不仅利用空间和时间冗余，但有效地利用了强大的内在相似性相邻子孔径图像在水平和垂直方向上指定的不同的预测顺序。此外，该方案是灵活的，以实现在一个单一的集成系统中的解码器的多个比特率的范围。与真实光场的压缩性能分析表明，大量的比特率节省，保持良好的重建质量。
英文摘要：
This paper presents a novel hierarchical coding scheme for light fields based on transmittance patterns of low-rank multiplicative layers and Fourier disparity layers. The proposed scheme learns stacked multiplicative layers from subsets of light field views determined from different scanning orders. The multiplicative layers are optimized using a fast data-driven convolutional neural network (CNN). The spatial correlation in layer patterns is exploited with varying low ranks in factorization derived from singular value decomposition on a Krylov subspace. Further, encoding with HEVC efficiently removes intra-view and inter-view correlation in low-rank approximated layers. The initial subset of approximated decoded views from multiplicative representation is used to construct Fourier disparity layer (FDL) representation. The FDL model synthesizes second subset of views which is identified by a pre-defined hierarchical prediction order. The correlations between the prediction residue of synthesized views is further eliminated by encoding the residual signal. The set of views obtained from decoding the residual is employed in order to refine the FDL model and predict the next subset of views with improved accuracy. This hierarchical procedure is repeated until all light field views are encoded. The critical advantage of proposed hybrid layered representation and coding scheme is that it utilizes not just spatial and temporal redundancies, but efficiently exploits the strong intrinsic similarities among neighboring sub-aperture images in both horizontal and vertical directions as specified by different predication orders. Besides, the scheme is flexible to realize a range of multiple bitrates at the decoder within a single integrated system. The compression performance analyzed with real light field shows substantial bitrate savings, maintaining good reconstruction quality.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
