发现、主观美、选择性注意、好奇心和创造力的简单数学原理
Simple Algorithmic Principles of Discovery, Subjective Beauty, Selective Attention, Curiosity & Creativity
摘要：
我假设人类或其他智能体的功能或应该功能如下。它们储存了所有感官观察--数据是神圣的。在任何时候，给定一些代理的当前编码能力，部分数据可以通过简短且希望快速的程序/描述/解释/世界模型压缩。在代理人的主观眼中，这样的数据比其他数据更有规律、更“美丽”。众所周知，规律性和可重复性的知识可以提高代理人计划导致外部奖励的行动的能力。然而，如果没有这样的奖励，已知的美是无聊的。然后，“有趣性”成为主观美的第一衍生物：随着学习代理改进其压缩算法，以前明显随机的数据部分在主观上变得更加规则和美丽。这种可压缩性的进步是通过好奇心驱动来测量和最大化的：创建扩展观察历史的动作序列，并产生以前未知/不可预测但可快速学习的算法规律。我们讨论了如何自然地在计算机上实现上述所有内容，通过将被动无监督学习扩展到主动数据选择的情况：我们奖励一般的强化学习器（可以访问自适应压缩器），以提高增长数据的主观压缩性。在压缩性方面的一个不寻常的大突破配得上“发现”这个名字。艺术家、舞蹈家、音乐家、纯数学家的“创造力”可以被看作是这一原则的副产品。一些定性的例子支持这一假设。
英文摘要：
I postulate that human or other intelligent agents function or should function as follows. They store all sensory observations as they come - the data is holy. At any time, given some agent's current coding capabilities, part of the data is compressible by a short and hopefully fast program / description / explanation / world model. In the agent's subjective eyes, such data is more regular and more "beautiful" than other data. It is well-known that knowledge of regularity and repeatability may improve the agent's ability to plan actions leading to external rewards. In absence of such rewards, however, known beauty is boring. Then "interestingness" becomes the first derivative of subjective beauty: as the learning agent improves its compression algorithm, formerly apparently random data parts become subjectively more regular and beautiful. Such progress in compressibility is measured and maximized by the curiosity drive: create action sequences that extend the observation history and yield previously unknown / unpredictable but quickly learnable algorithmic regularity. We discuss how all of the above can be naturally implemented on computers, through an extension of passive unsupervised learning to the case of active data selection: we reward a general reinforcement learner (with access to the adaptive compressor) for actions that improve the subjective compressibility of the growing data. An unusually large breakthrough in compressibility deserves the name "discovery". The "creativity" of artists, dancers, musicians, pure mathematicians can be viewed as a by-product of this principle. Several qualitative examples support this hypothesis.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
