逻辑与信息论的统一
Towards a Unification of Logic and Information Theory
AI总结:
本文提出一种结合逻辑推理与信息论的通信理论,形式化建模接收方的演绎能力,在Alice与Bob的通信场景中提供精确上下界及渐近最优算法,实验证明其相比经典系统具有显著增益。
摘要:
如今,世界上绝大多数的数字信息都是基于Claude Shannon在1948年引入的基本假设来表示的,即“……通信的语义方面与(通信系统设计的)工程问题无关……”。然而,考虑到我们经常将一条消息与其他信息结合起来以推导出新事实,从而提升该消息的价值这一观察结果。值得注意的是,迄今为止,尚未提出一种严谨的通信理论来假设接收方具有演绎能力。本文的目的正是提出这样一种理论。我们使用逻辑推理对这些演绎能力进行形式化建模,并提出了一种严谨的理论,涵盖以下通用场景:Alice和Bob各自了解某些逻辑句子,他们希望尽可能高效地进行通信,其共同目标是:在通信之后,Bob能够推导出Alice已知为真但Bob目前无法证明的特定逻辑句子。本文考虑了这种通用设置的多种变体;在所有情况下,我们都能提供精确的上下界。我们的贡献包括明确了对逻辑及相关逻辑语言所设定的最基本要求,我们的所有结果均基于这些要求。我们提供了在某些情况下具有渐近最优性的实用算法,并通过实验结果展示了在接收方引入演绎能力假设的通信系统设计的潜在实用价值,这些结果表明与经典系统相比可能获得显著的收益。
英文摘要:
Today, the vast majority of the world's digital information is represented using the fundamental assumption, introduced by Claude Shannon in 1948, that ``...the semantic aspects of communication are irrelevant to the engineering problem (of the design of communication systems)...''. Consider, nonetheless, the observation that we often combine a message with other information in order to deduce new facts, thereby expanding the value of such a message. It is noteworthy that to-date, no rigorous theory of communication has been put forth which postulates the existence of deductive capabilities on the receiver's side. The purpose of this paper is to present such a theory. We formally model such deductive capabilities using logic reasoning, and present a rigorous theory which covers the following generic scenario: Alice and Bob each have knowledge of some logic sentence, and they wish to communicate as efficiently as possible with the shared goal that, following their communication, Bob should be able to deduce a particular logic sentence that Alice knows to be true, but that Bob currently cannot prove. Many variants of this general setup are considered in this article; in all cases we are able to provide sharp upper and lower bounds. Our contribution includes the identification of the most fundamental requirements that we place on a logic and associated logical language for all of our results to apply. Practical algorithms that are in some cases asymptotically optimal are provided, and we illustrate the potential practical value of the design of communication systems that incorporate the assumption of deductive capabilities at the receiver using experimental results that suggest significant possible gains compared to classical systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。