信息与熵
Information and Entropy
摘要:
什么是信息?是身体上的吗?我们认为,在贝叶斯理论的信息的概念必须定义在理性代理人的信念的影响。信息是限制理性信念的东西,因此它是促使我们改变想法的力量。这个问题的更新,从一个先验的后验概率分布是通过消除归纳过程,挑出对数相对熵作为唯一的推理工具。最大相对熵(ME),这是专为更新从任意先验信息的形式为任意约束,包括作为特殊情况的MaxEnt(允许任意约束)和贝叶斯规则(允许任意先验)。因此,ME将这些研讨会的两个主题-最大熵和贝叶斯方法-统一为一个单一的一般推理方案,使我们能够分别处理两种方法中任何一种方法都无法解决的问题。最后,我举几个简单的例子来说明。
英文摘要:
What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops -- the Maximum Entropy and the Bayesian methods -- into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。