Artificial intelligence has made great strides since the deep learning revolution, but AI systems still struggle to extrapolate outside of their training data and adapt to new situations. For inspiration we look to the domain of science, where scientists have been able to develop theories which show remarkable ability to extrapolate and sometimes predict the existence of phenomena which have never been observed before. According to David Deutsch, this type of extrapolation, which he calls "reach", is due to scientific theories being hard to vary. In this work we investigate Deutsch's hard-to-vary principle and how it relates to more formalized principles in deep learning such as the bias-variance trade-off and Occam's razor. We distinguish internal variability, how much a model/theory can be varied internally while still yielding the same predictions, with external variability, which is how much a model must be varied to accurately predict new, out-of-distribution data. We discuss how to measure internal variability using the size of the Rashomon set and how to measure external variability using Kolmogorov complexity. We explore what role hard-to-vary explanations play in intelligence by looking at the human brain and distinguish two learning systems in the brain. The first system operates similar to deep learning and likely underlies most of perception and motor control while the second is a more creative system capable of generating hard-to-vary explanations of the world. We argue that figuring out how replicate this second system, which is capable of generating hard-to-vary explanations, is a key challenge which needs to be solved in order to realize artificial general intelligence. We make contact with the framework of Popperian epistemology which rejects induction and asserts that knowledge generation is an evolutionary process which proceeds through conjecture and refutation.
Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systems
Department of AI and Robotics, IGNITE Pathways(人工智能与机器人系,IGNITE路径);Department of Youth Wellness and Research, Neuro Health Alliance(青年健康与研究系,神经健康联盟);Medical Director of JFK Neuroscience Sleep Center, HMH-JFK Neuroscience Institute(JFK神经睡眠中心医疗总监,HMH-JFK神经科学研究所)
Modular Object-Oriented Games: A Task Framework for Reinforcement Learning, Psychology, and Neuroscience
Massachusetts Institute of Technology(麻省理工学院);Center for Brains, Minds and Machines, MIT(麻省理工学院脑、心智与机器中心);McGovern Institute of Brain Research, MIT(麻省理工学院麦戈文脑科学研究所)
Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective
School of EEE, Nanyang Technological University(南洋理工大学电子工程系);Department of Civil Engineering, Tsinghua University(清华大学土木工程系);Dr. B. R. Ambedkar National Institute of Technology, Jalandhar(B.R.阿姆贝卡尔国家理工学院,贾兰德赫);KTH Royal Institute of Technology(皇家理工学院);College of AI, Tsinghua University(清华大学人工智能学院);CCDS, Nanyang Technological University(南洋理工大学CCDS)
Bridging Cognitive Neuroscience and Graph Intelligence: Hippocampus-Inspired Multi-View Hypergraph Learning for Web Finance Fraud
School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);School of Computer Science and Technology, Donghua University(东华大学计算机科学与技术学院)
Digital twin brain: a bridge between biological intelligence and artificial intelligence
Brainnetome Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑网络组研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Research Center for Augmented Intelligence, Zhejiang Lab(之江实验室增强智能研究中心)
Artificial Intelligence without Restriction Surpassing Human Intelligence with Probability One: Theoretical Insight into Secrets of the Brain with AI Twins of the Brain
Southeast University(东南大学);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);Harvard Medical School(哈佛医学院);National Neuroscience Institute(国立神经科学研究所);First Affiliated Hospital of Sun Yat-Sen University(中山大学附属第一医院);Duke-NUS Medical School(杜克-新加坡国立大学医学院);National University of Singapore(新加坡国立大学);Mind PointEye;Tsinghua University(清华大学);Nanyang Technological University(南洋理工大学);Singapore AI Safety Institute(新加坡人工智能安全研究所);Lingnan University(岭南大学);University of Birmingham(伯明翰大学);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Centre(新加坡国家眼科中心)
University of California, San Diego(加州大学圣地亚哥分校);University of Maryland, College Park(马里兰大学帕克分校);Zurich University of Applied Sciences(苏黎世应用科学大学);The Salk Institute for Biological Studies(索尔克生物研究所)
Neural Brain: A Neuroscience-inspired Framework for Embodied Agents
School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院);School of Artificial Intelligence and Robotics, Hunan University(湖南大学人工智能与机器人学院);School of Intelligence Science and Engineering, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)智能科学与工程学院);Department of Information and Communication Technology, University of Agder(阿格德大学信息与通信技术系);Department of Information Engineering and Computer Science, University of Trento(特伦特大学信息工程与计算机科学系);Elm Company(Elm公司);Division of Computational Science and Technology, KTH Royal Institute of Technology(皇家理工学院计算科学与技术系);School of Artificial Intelligence and Data Science, Sejong University(世宗大学人工智能与数据科学学院);Department of Computer Science of the University of Western Australia(西澳大学计算机科学系);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
A Heuristic Search Algorithm Using the Stability of Learning Algorithms in Certain Scenarios as the Fitness Function: An Artificial General Intelligence Engineering Approach
Huawei 2012 Lab Central Software Institute(华为2012实验室中央软件院)
Brain-inspired Computational Intelligence via Predictive Coding
VERSES AI Research Lab(VERSES AI研究实验室);Institute of Logic and Computation(逻辑与计算研究所);University of South Florida(佛罗里达州立大学);Sussex AI Group(Sussex人工智能小组);Department of Computer Science(计算机科学系);University of Oxford(牛津大学);Paul G. Allen School of Computer Science and Engineering(保罗·G·阿伦计算机科学与工程学院);University of Washington(华盛顿大学);The Wellcome Centre for Human Neuroimaging(Wellcome人类神经成像中心);Institute of Neurology University College London(神经学研究所伦敦大学学院);Rochester Institute of Technology(罗切斯特理工学院)