In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these measures are not independent of the way in which an object, such as a graph, can be described or observed. From observations that can reconstruct the same graph and are therefore essentially translations of the same description, we will see that when applying a computable measure such as Shannon Entropy, not only is it necessary to pre-select a feature of interest where there is one, and to make an arbitrary selection where there is not, but also that more general properties, such as the causal likelihood of a graph as a measure (opposed to randomness), can be largely misrepresented by computable measures such as Entropy and Entropy rate. We introduce recursive and non-recursive (uncomputable) graphs and graph constructions based on these integer sequences, whose different lossless descriptions have disparate Entropy values, thereby enabling the study and exploration of a measure's range of applications and demonstrating the weaknesses of computable measures of complexity.
A Simplicity Bubble Problem in Formal-Theoretic Learning Systems
University of Campinas (UNICAMP)(坎皮纳斯大学);National Laboratory for Scientific Computing (LNCC)(国家科学计算实验室);Laboratoire de Recherche Scientifique (LABORES) for the Natural and Digital Sciences(自然与数字科学科学研究实验室(LABORES));The University of Cambridge(剑桥大学);Oxford Immune Algorithmics(牛津免疫算法公司);Karolinska Institute(卡罗林斯卡学院)
Tighter Bounds for Algorithmic Complexity Estimation Using a Reusable Code-Based Block Decomposition Method
Algorithmic Dynamics Lab, Karolinska Institute & King’s College London(算法动力学实验室,卡罗林斯卡学院与伦敦国王学院);School of Electrical and Computer Engineering, University of Campinas (UNICAMP)(坎皮纳斯大学电气与计算机工程学院);Oxford Immune Algorithmics, Oxford University Innovation & London Institute for Healthcare Engineering(牛津免疫算法公司,牛津大学创新部与伦敦医疗工程研究所);Centre for Logic, Epistemology and the History of Science, University of Campinas (UNICAMP)(坎皮纳斯大学逻辑、认识论与科学史中心);DEXL, National Laboratory for Scientific Computing (LNCC)(DEXL,巴西国家科学计算实验室);Departments of Biomedical Computing and Digital Twins, School of Biomedical Engineering and Medical Sciences, King’s Faculty of Life Sciences and Medicine, King’s College London(伦敦国王大学生物医学与医学科学学院生物医学计算与数字孪生系);King’s Institute for Artificial Intelligence, King’s College London(伦敦国王学院人工智能研究所)