We investigate the dynamics of two models of biological networks with purely suppressive interactions between the units; species interacting via niche competition and neurons via inhibitory synaptic coupling. In both of these cases, power-law scaling of the density of states with probability arises without any fine-tuning of the model parameters. These results argue against the increasingly popular notion that non-equilibrium living systems operate at special critical points, driven by there by evolution so as to enable adaptive processing of input data.
In self-organized criticality (SOC) models, as well as in standard phase transitions, criticality is only present for vanishing external fields $h \to 0$. Considering that this is rarely the case for natural systems, such a restriction poses a challenge to the explanatory power of these models. Besides that, in models of dissipative systems like earthquakes, forest fires, and neuronal networks, there is no true critical behavior, as expressed in clean power laws obeying finite-size scaling, but a scenario called "dirty" criticality or self-organized quasi-criticality (SOqC). Here, we propose s…
Many systems in Nature exhibit avalanche dynamics with scale-free features. A general scaling theory has been proposed for critical avalanche profiles in crackling noise, predicting the collapse onto a universal avalanche shape, as well as the scaling behaviour of the activity power spectrum as Brown noise. Recently, much attention has been given to the profile of neuronal avalanches, measured in neuronal systems in vitro and in vivo. Although a universal profile was evidenced, confirming the validity of the general scaling theory, the parallel study of the power spectrum scaling under the sam…
The model of the current paper is an extension of a previous publication, wherein we used the leaky integrate-and-fire model on a regular lattice with periodic boundary conditions, and introduced the temporal complexity as a genuine signature of criticality. In that work, the power-law distribution of neural avalanches was manifestation of supercriticality rather than criticality. Here, however, we show that continuous solution of the model and replacing the stochastic noise with a Gaussian zero-mean noise leads to the coincidence of power-law display of temporal complexity and spatiotemporal …
Motivated by recent experiments in neuroscience which indicate that neuronal avalanches exhibit scale invariant behavior similar to self-organized critical systems, we study the role of noisy (non-conservative) local dynamics on the critical behavior of a sandpile model which can be taken to mimic the dynamics of neuronal avalanches. We find that despite the fact that noise breaks the strict local conservation required to attain criticality, our system exhibit true criticality for a wide range of noise in various dimensions, given that conservation is respected \textit{on the average}. Althoug…
The critical brain hypothesis states that there are information processing advantages for neuronal networks working close to the critical region of a phase transition. If this is true, we must ask how the networks achieve and maintain this critical state. Here we review several proposed biological mechanisms that turn the critical region into an attractor of a dynamics in network parameters like synapses, neuronal gains and firing thresholds. Since neuronal networks (biological and models) are nonconservative but dissipative, we expect not exact criticality but self-organized quasicriticality …
Experiments in various neural systems found avalanches: bursts of activity with characteristics typical for critical dynamics. A possible explanation for their occurrence is an underlying network that self-organizes into a critical state. We propose a simple spiking model for developing neural networks, showing how these may "grow into" criticality. Avalanches generated by our model correspond to clusters of widely applied Hawkes processes. We analytically derive the cluster size and duration distributions and find that they agree with those of experimentally observed neuronal avalanches.
Recently, neuronal avalanches have been observed to display oscillations, a phenomenon regarded as the co-existence of a scale-free behaviour (the avalanches close to criticality) and scale-dependent dynamics (the oscillations). Ordinary continuous-time branching processes with constant extinction and branching rates are commonly used as models of neuronal activity, yet they lack any such time-dependence. In the present work, we extend a basic branching process by allowing the extinction rate to oscillate in time as a new model to describe cortical dynamics. By means of a perturbative field th…
Massively parallel recordings of spiking activity in cortical networks show that covariances vary widely across pairs of neurons. Their low average is well understood, but an explanation for the wide distribution in relation to the static (quenched) disorder of the connectivity in recurrent random networks was so far elusive. We here derive a finite-size mean-field theory that reduces a disordered to a highly symmetric network with fluctuating auxiliary fields. The exposed analytical relation between the statistics of connections and the statistics of pairwise covariances shows that both, aver…
The repertoire of neural activity patterns that a cortical network can produce constrains the network's ability to transfer and process information. Here, we measured activity patterns obtained from multi-site local field potential (LFP) recordings in cortex cultures, urethane anesthetized rats, and awake macaque monkeys. First, we quantified the information capacity of the pattern repertoire of ongoing and stimulus-evoked activity using Shannon entropy. Next, we quantified the efficacy of information transmission between stimulus and response using mutual information. By systematically changi…
Recent studies on the complex systems have shown that the synchronization of oscillators including neuronal ones is faster, stronger, and more efficient in the small-world networks than in the regular or the random networks, and many studies are based on the assumption that the brain may utilize the small-world and scale-free network structure. We show that the functional structures in the brain are self-organized to both the small-world and the scale-free networks by synaptic re-organization by the spike timing dependent synaptic plasticity (STDP), which is hardly achieved with conventional H…
Thermodynamic criticality describes emergent phenomena in a wide variety of complex systems. In the mammalian brain, the complex dynamics that spontaneously emerge from neuronal interactions have been characterized as neuronal avalanches, a form of critical branching dynamics. Here, we show that neuronal avalanches also reflect that the brain dynamics are organized close to a thermodynamic critical point. We recorded spontaneous cortical activity in monkeys and humans at rest using high-density intracranial microelectrode arrays and magnetoencephalography, respectively. By numerically changing…
Networks and systems which exhibit brain-like behavior can analyze information from intrinsically noisy and unstructured data with very low power consumption. Such characteristics arise due to the critical nature and complex interconnectivity of the brain and its neuronal network. We demonstrate that a system comprising of multilayer hexagonal Boron Nitride (hBN) films contacted with Silver (Ag), that can uniquely host two different self-assembled networks, which are self-organized at criticality (SOC). This system shows bipolar resistive switching between high resistance (HRS) and low resista…
Neurons in the brain are wired into adaptive networks that exhibit a range of collective dynamics. Oscillations, for example, are paradigmatic synchronous patterns of neural activity with a defined temporal scale. Neuronal avalanches, in contrast, are scale-free cascades of neural activity, often considered as evidence of brain tuning to criticality. While models have been developed to account for oscillations or avalanches separately, they typically do not explain both phenomena, are too complex to analyze analytically, or intractable to infer from data rigorously. Here we propose a non-equil…
We consider a simple Markovian class of the stochastic Wilson-Cowan type models of neuronal network dynamics, which incorporates stochastic delay caused by the existence of a refractory period of neurons. From the point of view of the dynamics of the individual elements, we are dealing with a network of non-Markovian stochastic two-state oscillators with memory which are coupled globally in a mean-field fashion. This interrelation of a higher-dimensional Markovian and lower-dimensional non-Markovian dynamics is discussed in its relevance to the general problem of the network dynamics of comple…
Cortical neural circuits display highly irregular spiking in individual neurons but variably sized collective firing, oscillations and critical avalanches at the population level, all of which have functional importance for information processing. Theoretically, the balance of excitation and inhibition inputs is thought to account for spiking irregularity and critical avalanches may originate from an underlying phase transition. However, the theoretical reconciliation of these multilevel dynamic aspects in neural circuits remains an open question. Herein, we study excitation-inhibition (E-I) b…
The concept of the brain as a critical system is very attractive because systems close to criticality are thought to maximise their dynamic range of information processing and communication. To date, there have been two key experimental observations supporting this hypothesis: i) neuronal avalanches with power law distribution of size and ii) long-range temporal correlations (LRTCs) in the amplitude of neural oscillations. The case for how these maximise dynamic range of information processing and communication is still being made and because a significant substrate for information coding and …
Recent experiments on cortical neural networks have revealed the existence of well-defined avalanches of electrical activity. Such avalanches have been claimed to be generically scale-invariant -- i.e. power-law distributed -- with many exciting implications in Neuroscience. Recently, a self-organized model has been proposed by Levina, Herrmann and Geisel to justify such an empirical finding. Given that (i) neural dynamics is dissipative and (ii) there is a loading mechanism "charging" progressively the background synaptic strength, this model/dynamics is very similar in spirit to forest-fire …
Psychophysics try to relate physical input magnitudes to psychological or neural correlates. Microscopic models to account for macroscopic psychophysical laws, in the sense of statistical physics, are an almost unexplored area. Here we examine a sensory epithelium composed of two connected square lattices of stochastic integrate-and-fire cells. With one square lattice we obtain a Stevens's law $ρ\propto h^m$ with Stevens's exponent $m = 0.254$ and a sigmoidal saturation, where $ρ$ is the neuronal network activity and $h$ is the input intensity (external field). We relate Stevens's power law ex…
A certain degree of inhibition is a common trait of dynamical networks in nature, ranging from neuronal and biochemical networks, to social and technological networks. We study here the role of inhibition in a representative dynamical network model, characterizing the dynamics of random threshold networks with both excitatory and inhibitory links. Varying the fraction of excitatory links has a strong effect on the network's population activity and its sensitivity to perturbation. The average degree $K$, known to have a strong effect on the dynamics when small, loses its influence on the dynami…
CEA, DRF, Joliot, NeuroSpin, Paris-Saclay University（法国原子能委员会，DRF，若利奥中心，NeuroSpin，巴黎萨克雷大学）；Inria MIND team, Paris-Saclay University（法国国家信息与自动化研究所，MIND团队，巴黎萨克雷大学）；Department of Neuroscience and Biomedical Engineering, Aalto University（阿尔托大学，神经科学与生物医学工程系）；Neuroscience Center, Helsinki Institute of Life Science, Helsinki University（赫尔辛基大学生命科学研究所，神经科学中心）；School of Psychology & Neuroscience, University of Glasgow（格拉斯哥大学，心理学与神经科学学院）
Avalanches of electrochemical activity in brain networks have been empirically reported to obey scale-invariant behavior --characterized by power-law distributions up to some upper cut-off-- both in vitro and in vivo. Elucidating whether such scaling laws stem from the underlying neural dynamics operating at the edge of a phase transition is a fascinating possibility, as systems poised at criticality have been argued to exhibit a number of important functional advantages. Here we employ a well-known model for neural dynamics with synaptic plasticity, to elucidate an alternative scenario in whi…
While criticality is widely observed in neural networks, its underlying neural mechanism is not known well. We consider a network of $N$ excitatory leaky integrated and fire (LIF) neurons that reside on a regular lattice with periodic boundary conditions. The cooperation between neurons, $K$, plays the role of the control parameter that is expected to generate criticality when the critical cooperation strength, $K_c$, is adopted. We show that the coupling between spike timing and the phase of temporal fluctuations of a cooperative activity of the network, i.e. population-averaged voltage (PAV)…
Networks of excitable nodes have recently attracted much attention particularly in regards to neuronal dynamics, where criticality has been argued to be a fundamental property. Refractory behavior, which limits the excitability of neurons is thought to be an important dynamical property. We therefore consider a simple model of excitable nodes which is known to exhibit a transition to instability at a critical point ($λ=1$), and introduce refractory period into its dynamics. We use mean-field analytical calculations as well as numerical simulations to calculate the activity dependent branching …
Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may corresponds to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask: What is t…
Self-Organising Memristive Networks as Physical Learning Systems
Theoretical Division (Condensed Matter and Complex Systems, T-4)（洛斯阿拉莫斯国家实验室理论部）；Advanced Materials Metrology and Life Sciences Division, INRiM (Istituto Nazionale di Ricerca Metrologica)（先进材料计量与生命科学部，INRiM（意大利国家计量研究院））；University of California, Los Angeles, California NanoSystems Institute（加州大学洛杉矶分校，加州纳米系统研究所）；Department of Applied Science and Technology, Politecnico di Torino（托里尼 Politecnico 工程技术系）；The MacDiarmid Institute for Advanced Materials and Nanotechnology, School of Physical and Chemical Sciences, Te Kura Mate, University of Canterbury（麦克迪尔马特高级材料与纳米技术研究所，坎特伯雷大学物理与化学科学学院，Te Kura Mate）；School of Physics, Sydney Nano Institute and Centre for Complex Systems, University of Sydney（悉尼大学物理学院，悉尼纳米研究所和复杂系统中心）
