Jaynes & Shannon的受约束的无知和惊讶
Jaynes & Shannon's Constrained Ignorance and Surprise
摘要:
在这篇简单的文章中,在理论和应用物理中可能的应用,我们提出了一个原始的方法来推导香农熵的表达从一个纯粹的变分方法,使用约束。在Edwin T. Jaynes,我们的结果从根本上说并不是新的,但是它们导出的背景可能会导致一个非常一致的形式主义,其中最大熵原理自然出现。在此框架中给出了“无知”的一般定义之后,我们使用两种方法推导出熵的某种一般预期表达式。在第一种情况下,人们是有偏见的,对熵函数的形状有一个模糊的概念。在第二种情况下,我们考虑的一般情况下,没有什么是先验已知的。比较了两种思维方式的优点。
英文摘要:
In this simple article, with possible applications in theoretical and applied physics, we suggest an original way to derive the expression of Shannon's entropy from a purely variational approach,using constraints. Based on the work of Edwin T. Jaynes, our results are not fundamentally new but the context in which they are derived might, however, lead to a remarkably consistent formalism,where the maximum entropy principle appears naturally. After having given a general definition of "ignorance" in this framework, we derive the somehow general expected expression for the entropy using two approaches. In the first, one is biased and has a vague idea of the shape of the entropy function. In the second, we consider the general case, where nothing is a priori known. The merits of both ways of thinking are compared.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。