arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1706.07735cond-mat.stat-mech
收藏

香农熵的再解释

Shannon Entropy Reinterpreted

Laurent Truffet

摘要:

在本文中,我们注意到Shannon熵可以表示为自信息(即对数)的函数和Lambert $W$函数的逆。这意味着我们认为Shannon熵具有迹形式:$-k \sum_{i} W^{-1} \circ \mathsf{ln}(p_{i})$。基于这一点,我们定义了一个广义熵,它具有香农熵的极限。为了便于推理,这个广义熵是通过对数函数的单参数变形获得的。引入两个系统独立性的新概念,用一个非交换非结合律代替Shannon可加性,其极限是通常的加法。建立了与广义熵相关的主要性质,特别是与统计系综相关的性质。Boltzmann-Gibbs统计量被恢复为极限。同时也研究了它与热力学的联系。为系统地定义极限为经典线性代数的变形代数提供了指导。作为一个说明性的例子,我们研究了基于Tsallis自信息的广义熵。我们指出变形代数和模糊逻辑之间可能的联系。最后,注意到独立性的新概念是基于t-范数的,对数的单参数变形被解释为t-范数的加性生成元。

英文摘要:

In this paper we remark that Shannon entropy can be expressed as a function of the self-information (i.e. the logarithm) and the inverse of the Lambert $W$ function. It means that we consider that Shannon entropy has the trace form: $-k \sum_{i} W^{-1} \circ \mathsf{ln}(p_{i})$. Based on this remark we define a generalized entropy which has as a limit the Shannon entropy. In order to facilitate the reasoning this generalized entropy is obtained by a one-parameter deformation of the logarithmic function. Introducing a new concept of independence of two systems the Shannon additivity is replaced by a non-commutative and non-associative law which limit is the usual addition. The main properties associated with the generalized entropy are established, particularly those corresponding to statistical ensembles. The Boltzmann-Gibbs statistics is recovered as a limit. The connection with thermodynamics is also studied. We also provide a guideline for systematically defining a deformed algebra which limit is the classical linear algebra. As an illustrative example we study a generalized entropy based on Tsallis self-information. We point out possible connections between deformed algebra and fuzzy logics. Finally, noticing that the new concept of independence is based on t-norm the one-parameter deformation of the logarithm is interpreted as an additive generator of t-norms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑