arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0711.2104cs.ITcs.CVmath.ITmath.PR
收藏

关于全光函数的信息率

On the Information Rates of the Plenoptic Function

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Ecole Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院);UC Berkeley(加州大学伯克利分校)

Arthur Cunha, Minh Do, Martin Vetterli

摘要:

{ \it全光函数}(Adelson and Bergen,91)描述了观察者在空间和时间中的任何点处可用的视觉信息。全光函数(POF)的样本在视频和一般视觉内容中可见,并且表示大量信息。在本文中,我们提出了一个随机模型来研究全光函数的压缩极限。在建议的框架中,我们隔离的两个基本来源的信息POF:一个代表的摄像机运动和其他代表的信息复杂性的“现实”被收购和传输。信息源被组合在一起,产生了一个我们详细研究的随机过程。我们首先提出一个不随时间变化的现实集合模型。所提出的模型是简单的,因为它使我们能够得到精确的编码界的信息理论意义上的尖锐的实际利益的情况下。对于这个简单的情况下,静态的现实和摄像机运动,我们的研究结果表明,编码的做法是按照最佳编码从信息理论的角度来看。该模型进一步扩展,以考虑随着时间的推移而变化的视觉现实。我们推导出这个动态现实模型的无损和有损的信息速率的界限,说明条件下的界限是紧的。与合成源的例子表明,在场景动态的存在下,简单的混合编码使用运动/位移估计与DPCM执行相当次优相对于真实的率失真界。

英文摘要:

The {\it plenoptic function} (Adelson and Bergen, 91) describes the visual information available to an observer at any point in space and time. Samples of the plenoptic function (POF) are seen in video and in general visual content, and represent large amounts of information. In this paper we propose a stochastic model to study the compression limits of the plenoptic function. In the proposed framework, we isolate the two fundamental sources of information in the POF: the one representing the camera motion and the other representing the information complexity of the "reality" being acquired and transmitted. The sources of information are combined, generating a stochastic process that we study in detail. We first propose a model for ensembles of realities that do not change over time. The proposed model is simple in that it enables us to derive precise coding bounds in the information-theoretic sense that are sharp in a number of cases of practical interest. For this simple case of static realities and camera motion, our results indicate that coding practice is in accordance with optimal coding from an information-theoretic standpoint. The model is further extended to account for visual realities that change over time. We derive bounds on the lossless and lossy information rates for this dynamic reality model, stating conditions under which the bounds are tight. Examples with synthetic sources suggest that in the presence of scene dynamics, simple hybrid coding using motion/displacement estimation with DPCM performs considerably suboptimally relative to the true rate-distortion bound.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑