arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0705.3644cs.ITcs.HCmath.IT
收藏

主观信息测度与速率保真度理论

Subjective Information Measure and Rate Fidelity Theory

Chenguang Lu

摘要:

本文利用鱼覆盖模型,直观地说明了如何将Hartley的信息量公式逐步推广为广义信息量公式,以度量主观信息:度量信息(如温度计所传达的信息)、感觉信息(如颜色视觉所传达的信息)和语义信息(如天气预报所传达的信息)。关键的一步是区分消息的条件概率和逻辑条件概率。本文论证了广义信息公式的合理性,讨论了广义信息公式与波普尔知识进化理论的一致性。为了优化数据压缩,本文在Kolmogorov复杂度理论的基础上,讨论了限差错率及其与复杂度失真的相似性,并将率失真理论改进为率保真度理论,用主观互信息代替Shannon失真。证明了率失真函数和率保真度函数都等价于一个以模糊集为限制条件的误差率限制函数,并且对于有损编码可以用广义互信息公式表示,对于无损编码可以用广义熵公式表示。通过分析与视觉分辨力相关的率-保真度函数和图像像素的数字化比特数,得出主观信息小于或等于客观信息的结论(香农)信息;存在一个最佳匹配点,在该点上两种信息相等;匹配信息随着视觉辨别力的增加而增加(由混淆概率定义)上升;对于给定的视觉辨别,过高的图像分辨率或过多的客观信息是浪费的。

英文摘要:

Using fish-covering model, this paper intuitively explains how to extend Hartley's information formula to the generalized information formula step by step for measuring subjective information: metrical information (such as conveyed by thermometers), sensory information (such as conveyed by color vision), and semantic information (such as conveyed by weather forecasts). The pivotal step is to differentiate condition probability and logical condition probability of a message. The paper illustrates the rationality of the formula, discusses the coherence of the generalized information formula and Popper's knowledge evolution theory. For optimizing data compression, the paper discusses rate-of-limiting-errors and its similarity to complexity-distortion based on Kolmogorov's complexity theory, and improves the rate-distortion theory into the rate-fidelity theory by replacing Shannon's distortion with subjective mutual information. It is proved that both the rate-distortion function and the rate-fidelity function are equivalent to a rate-of-limiting-errors function with a group of fuzzy sets as limiting condition, and can be expressed by a formula of generalized mutual information for lossy coding, or by a formula of generalized entropy for lossless coding. By analyzing the rate-fidelity function related to visual discrimination and digitized bits of pixels of images, the paper concludes that subjective information is less than or equal to objective (Shannon's) information; there is an optimal matching point at which two kinds of information are equal; the matching information increases with visual discrimination (defined by confusing probability) rising; for given visual discrimination, too high resolution of images or too much objective information is wasteful.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑