Advancing our knowledge of how the brain processes information remains a key challenge in neuroscience. This thesis combines three different approaches to the study of the dynamics of neural networks and their encoding representations: a computational approach, that builds upon basic biological features of neurons and their networks to construct effective models that can simulate their structure and dynamics; a machine-learning approach, which draws a parallel with the functional capabilities of brain networks, allowing us to infer the dynamical and encoding properties required to solve certain input-processing tasks; and a final, theoretical treatment, which will take us into the fascinating hypothesis of the "critical" brain as the mathematical foundation that can explain the emergent collective properties arising from the interactions of millions of neurons. Hand in hand with physics, we venture into the realm of neuroscience to explain the existence of quasi-universal scaling properties across brain regions, setting out to quantify the distance of their dynamics from a critical point. Next, we move into the grounds of artificial intelligence, where the very same theory of critical phenomena will prove very useful for explaining the effects of biologically-inspired plasticity rules in the forecasting ability of Reservoir Computers. Halfway into our journey, we explore the concept of neural representations of external stimuli, unveiling a surprising link between the dynamical regime of neural networks and the optimal topological properties of such representation manifolds. The thesis ends with the singular problem of representational drift in the process of odor encoding carried out by the olfactory cortex, uncovering the potential synaptic plasticity mechanisms that could explain this recently observed phenomenon.
Bio-inspired AI: Integrating Biological Complexity into Artificial Intelligence
McGovern Institute for Brain Research, MIT(麻省理工学院麦戈文脑科学研究所);Allen Discovery Center at Tufts University(塔夫茨大学艾伦发现中心);Center for Brains, Minds, and Machines, MIT(麻省理工学院脑、心智与机器中心);Wyss Institute for Biologically Inspired Engineering, Harvard University(哈佛大学威斯生物启发工程研究所)
Digital twin brain: a bridge between biological intelligence and artificial intelligence
Brainnetome Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑网络组研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Research Center for Augmented Intelligence, Zhejiang Lab(之江实验室增强智能研究中心)
Replay in Deep Learning: Current Approaches and Missing Biological Elements
Rochester Institute of Technology(罗切斯特理工学院);University of California at San Diego(加州大学圣地亚哥分校);Salk Institute for Biological Studies(索尔克生物研究所);Paige;Cornell Tech(康奈尔理工学院)
Same Compression Principle, Different Geometry: Rate-Distortion Signatures Dissociate Biological and Artificial Visual Systems
Windreich Department of AI;Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA;Department of Computing, Imperial College London, London, UK;Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, USA;Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, USA;Berkman Klein Center for Internet \& Society, Harvard University, Cambridge, MA, USA
Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neuroscience
University of Cambridge(剑桥大学);University of Oxford(牛津大学);Imperial College London(帝国理工学院);Massachusetts Institute of Technology(麻省理工学院);Georgia Institute of Technology(佐治亚理工学院);New York University(纽约大学);Princeton University(普林斯顿大学)
Adversarially trained neural representations may already be as robust as corresponding biological neural representations
McGovern Institute for Brain Research, MIT(麻省理工学院麦戈文脑研究所);MIT(麻省理工学院);Department of Brain and Cognitive Sciences, MIT(麻省理工学院脑与认知科学系);Center for Brains, Minds and Machines, MIT(麻省理工学院脑、心智与机器中心);Computer Science and Artificial Intelligence Laboratory, MIT(麻省理工学院计算机科学与人工智能实验室);School of Engineering and Applied Sciences, Harvard University(哈佛大学工程与应用科学学院);Harvard University(哈佛大学);Purdue University(普渡大学);Department of Electrical Engineering and Computer Science, MIT(麻省理工学院电气工程与计算机科学系)
Starting a Synthetic Biological Intelligence Lab from Scratch
Rensselaer Polytechnic Institute(伦斯勒理工学院);Albany Medical College(奥尔巴尼医学院);University of California Santa Cruz(加州大学圣克鲁兹分校);Cortical Labs;University of Melbourne(墨尔本大学)
Brain-inspired learning in artificial neural networks: a review
Johns Hopkins University(约翰斯·霍普金斯大学);University of Cambridge(剑桥大学);Intel Labs(英特尔实验室);ML Collective(机器学习联盟);The Swiss AI Lab IDSIA(瑞士人工智能实验室IDSIA);University of Maryland, College Park(马里兰大学帕克分校);University of California, Santa Cruz(加州大学圣克鲁兹分校)
Groningen Institute for Evolutionary Life Sciences, University of Groningen(格罗宁根进化生命科学研究所,格罗宁根大学);Bernoulli Institute, University of Groningen(伯努利研究所,格罗宁根大学)
Fault-Tolerant Neural Networks from Biological Error Correction Codes
Center for Theoretical Physics, Massachusetts Institute of Technology(麻省理工学院理论物理中心);Department of Physics, Massachusetts Institute of Technology(麻省理工学院物理系);Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology(麻省理工学院电气工程与计算机科学系)
Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry
Gatsby Computational Neuroscience Unit, UCL(伦敦大学学院盖茨比计算神经科学单元);KUIS AI Center, Koc University(科奇大学KUIS人工智能中心);EEE Department, Koc University(科奇大学电气与电子工程系);John A. Paulson School of Engineering & Applied Sciences and Center for Brain Science, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院及脑科学中心);Kempner Institute for the Study of Natural and Artificial Intelligence(肯普纳自然与人工智能研究所)