Localized persistent cortical neural activity is a validated neural substrate of parametric working memory. Such activity `bumps' represent the continuous location of a cue over several seconds. Pyramidal (excitatory) and interneuronal (inhibitory) subpopulations exhibit tuned bumps of activity, linking neural dynamics to behavioral inaccuracies observed in memory recall. However, many bump attractor models collapse these subpopulations into a single joint excitatory/inhibitory (lateral inhibitory) population, and do not consider the role of interpopulation neural architecture and noise correlations. Both factors have a high potential to impinge upon the stochastic dynamics of these bumps, ultimately shaping behavioral response variance. In our study, we consider a neural field model with separate excitatory/inhibitory (E/I) populations and leverage asymptotic analysis to derive a nonlinear Langevin system describing E/I bump interactions. While the E bump attracts the I bump, the I bump stabilizes but can also repel the E bump, which can result in prolonged relaxation dynamics when both bumps are perturbed. Furthermore, the structure of noise correlations within and between subpopulations strongly shapes the variance in bump position. Surprisingly, higher interpopulation correlations reduce variance.
We study the dynamics of networks with inhibitory and excitatory leaky-integrate-and-fire neurons with short-term synaptic plasticity in the presence of depressive and facilitating mechanisms. The dynamics is analyzed by a Heterogeneous Mean-Field approximation, that allows to keep track of the effects of structural disorder in the network. We describe the complex behavior of different classes of excitatory and inhibitory components, that give rise to a rich dynamical phase-diagram as a function of the fraction of inhibitory neurons. By the same mean field approach, we study and solve a global…
Maximum Entropy models can be inferred from large data-sets to uncover how collective dynamics emerge from local interactions. Here, such models are employed to investigate neurons recorded by multielectrode arrays in the human and monkey cortex. Taking advantage of the separation of excitatory and inhibitory neuron types, we construct a model including this distinction. This approach allows to shed light upon differences between excitatory and inhibitory activity across different brain states such as wakefulness and deep sleep, in agreement with previous findings. Additionally, Maximum Entrop…
We develop an extension of the Ott-Antonsen method that allows obtaining the mean activity (spiking rate) of a population of excitable units. By means of the Ott-Antonsen method, equations for the dynamics of the order parameters of coupled excitatory and inhibitory populations of excitable units are obtained, and their mean activities are computed. Two different excitable systems are studied: Adler units and theta neurons. The resulting bifurcation diagrams are compared to those obtained from studying the phenomenological Wilson-Cowan model in some regions of the parameter space. Compatible b…
We developed a model of cortical computation that implements key features of cortical circuitry and is capable of describing propagation of neural signals between cortical locations in response to spatially distributed stimuli. The model is based on the canonical neural circuit that consists of excitatory and inhibitory cells interacting through reciprocal connections, with recurrent feedback. The canonical circuit is used as a node in a distributed network with nearest neighbor coupling between the nodes. We find that this system is characterized by intrinsic preference for spatial frequency.…
It is widely appreciated that well-balanced excitation and inhibition are necessary for proper function in neural networks. However, in principle, such balance could be achieved by many possible configurations of excitatory and inhibitory strengths, and relative numbers of excitatory and inhibitory neurons. For instance, a given level of excitation could be balanced by either numerous inhibitory neurons with weak synapses, or few inhibitory neurons with strong synapses. Among the continuum of different but balanced configurations, why should any particular configuration be favored? Here we add…
Probabilistic inference offers a principled framework for understanding both behaviour and cortical computation. However, two basic and ubiquitous properties of cortical responses seem difficult to reconcile with probabilistic inference: neural activity displays prominent oscillations in response to constant input, and large transient changes in response to stimulus onset. Here we show that these dynamical behaviours may in fact be understood as hallmarks of the specific representation and algorithm that the cortex employs to perform probabilistic inference. We demonstrate that a particular fa…
This paper introduces a rate-based nonlinear neural network in which excitatory (E) neurons receive feedforward excitation from sensory (S) neurons, and inhibit each other through disynaptic pathways mediated by inhibitory (I) interneurons. Correlation-based plasticity of disynaptic inhibition serves to incompletely decorrelate E neuron activity, pushing the E neurons to learn distinct sensory features. The plasticity equations additionally contain "extra" terms fostering competition between excitatory synapses converging onto the same postsynaptic neuron and inhibitory synapses diverging from…
Complexity in the temporal organization of neural systems may be a reflection of the diversity of its neural constituents. These constituents, excitatory and inhibitory neurons, comprise an invariant ratio in vivo and form the substrate for rhythmic oscillatory activity. To begin to elucidate the dynamical mechanisms that underlie this balance, we construct novel neural circuits not ordinarily found in nature. We culture several networks of neurons composed of excitatory and inhibitory cells and use a multi-electrode array to study their temporal dynamics as the balance is modulated. We use th…
Neural network models comprising elements which have exclusively excitatory or inhibitory synapses are capable of a wide range of dynamic behavior, including chaos. In this paper, a simple excitatory-inhibitory neural pair, which forms the building block of larger networks, is subjected to external stimulation. The response shows transition between various types of dynamics, depending upon the magnitude of the stimulus. Coupling such pairs over a local neighborhood in a two-dimensional plane, the resultant network can achieve a satisfactory segmentation of an image into ``object'' and ``backgr…
We investigate the collective dynamics of excitatory-inhibitory excitable networks in response to external stimuli. How to enhance dynamic range, which represents the ability of networks to encode external stimuli, is crucial to many applications. We regard the system as a two-layer network (E-Layer and I-Layer) and explore the criticality and dynamic range on diverse networks. Interestingly, we find that phase transition occurs when the dominant eigenvalue of E-layer's weighted adjacency matrix is exactly one, which is only determined by the topology of E-Layer. Meanwhile, it is shown that dy…
The elapsed time model has been widely studied in the context of mathematical neuroscience with many open questions left. The model consists of an age-structured equation that describes the dynamics of interacting neurons structured by the elapsed time since their last discharge. Our interest lies in highly connected networks leading to strong nonlinearities where perturbation methods do not apply. To deal with this problem, we choose a particular case which can be reduced to delay equations. We prove a general convergence result to a stationary state in the inhibitory and the weakly excitator…
For studying how dynamical responses to external stimuli depend on the synaptic-coupling type, we consider two types of excitatory and inhibitory synchronization (i.e., synchronization via synaptic excitation and inhibition) in complex small-world networks of excitatory regular spiking (RS) pyramidal neurons and inhibitory fast spiking (FS) interneurons. For both cases of excitatory and inhibitory synchronization, effects of synaptic couplings on dynamical responses to external time-periodic stimuli $S(t)$ (applied to a fraction of neurons) are investigated by varying the driving amplitude $A$…
Recurrent networks of non-linear units display a variety of dynamical regimes depending on the structure of their synaptic connectivity. A particularly remarkable phenomenon is the appearance of strongly fluctuating, chaotic activity in networks of deterministic, but randomly connected rate units. How this type of intrinsi- cally generated fluctuations appears in more realistic networks of spiking neurons has been a long standing question. To ease the comparison between rate and spiking networks, recent works investigated the dynami- cal regimes of randomly-connected rate networks with segrega…
The construction of biologically plausible models of neural circuits is crucial for understanding the computational properties of the nervous system. Constructing functional networks composed of separate excitatory and inhibitory neurons obeying Dale's law presents a number of challenges. We show how a target-based approach, when combined with a fast online constrained optimization technique, is capable of building functional models of rate and spiking recurrent neural networks in which excitation and inhibition are balanced. Balanced networks can be trained to produce complicated temporal pat…
Synaptic delays modulate population phase and amplitude responses in oscillatory excitatory-inhibitory networks
Institute for Advanced Studies in Basic Sciences (IASBS)（基础科学高等研究院）；Institute for Research in Fundamental Sciences (IPM)（基本科学研究院）；Pasargad Institute for Advanced Innovative Solutions (PIAIS)（帕萨尔加德先进创新解决方案研究所）；The Zapata-Briceño Institute of Neuroscience（萨帕塔-布里斯尼奥神经科学研究所）
The impact of inhibitory and excitatory synapses in delay-coupled Hodgkin--Huxley neurons that are driven by noise is studied. If both synaptic types are used for coupling, appropriately tuned delays in the inhibition feedback induce multiple firing coherence resonances at sufficiently strong coupling strengths, thus giving rise to tongues of coherency in the corresponding delay-strength parameter plane. If only inhibitory synapses are used, however, appropriately tuned delays also give rise to multiresonant responses, yet the successive delays warranting an optimal coherence of excitations ob…
Collective oscillations and their suppression by external stimulation are analyzed in a large-scale neural network consisting of two interacting populations of excitatory and inhibitory quadratic integrate-and-fire neurons. In the limit of an infinite number of neurons, the microscopic model of this network can be reduced to an exact low-dimensional system of mean-field equations. Bifurcation analysis of these equations reveals three different dynamic modes in a free network: a stable resting state, a stable limit cycle, and bistability with a coexisting resting state and a limit cycle. We sho…
A companion paper introduces a nonlinear network with Hebbian excitatory (E) neurons that are reciprocally coupled with anti-Hebbian inhibitory (I) neurons and also receive Hebbian feedforward excitation from sensory (S) afferents. The present paper derives the network from two normative principles that are mathematically equivalent but conceptually different. The first principle formulates unsupervised learning as a constrained optimization problem: maximization of S-E correlations subject to a copositivity constraint on E-E correlations. A combination of Legendre and Lagrangian duality yield…
An inverse procedure is developed and tested to recover functional and structural information from global signals of brains activity. The method assumes a leaky-integrate and fire model with excitatory and inhibitory neurons, coupled via a directed network. Neurons are endowed with a heterogenous current value, which sets their associated dynamical regime. By making use of a heterogenous mean-field approximation, the method seeks to reconstructing from global activity patterns the distribution of in-coming degrees, for both excitatory and inhibitory neurons, as well as the distribution of the …
The branching process is the minimal model for propagation dynamics, avalanches and criticality, broadly used in neuroscience. A simple extension of it, adding inhibitory nodes, induces a much-richer phenomenology, including, an intermediate phase, between quiescence and saturation, that exhibits the key features of "asynchronous states" in cortical networks. Remarkably, in the inhibition-dominated case, it exhibits an extremely-rich phase diagram, that captures a wealth of non-trivial features of spontaneous brain activity, such as collective excitability, hysteresis, tilted avalanche shapes,…
Neural coding is a key problem in neuroscience, which can promote people's understanding of the mechanism that brain processes information. Among the classical theories of neural coding, the population rate coding has been studied widely in many works. Most computational studies considered the neurons and the corresponding presynaptic synapses as pre-determined excitatory or inhibitory types. According to physiological evidence, however, that the real effect of a synapse is inhibitory or excitatory is determined by the type of the activated receptors. The co-release of excitatory and inhibitor…
A stochastic model of excitatory and inhibitory interactions which bears universality traits is introduced and studied. The endogenous component of noise, stemming from finite size corrections, drives robust inter-nodes correlations, that persist at large large distances. Anti-phase synchrony at small frequencies is resolved on adjacent nodes and found to promote the spontaneous generation of long-ranged stochastic patterns, that invade the network as a whole. These patterns are lacking under the idealized deterministic scenario, and could provide novel hints on how living systems implement an…
Characterizing the relation between weight structure and input/output statistics is fundamental for understanding the computational capabilities of neural circuits. In this work, I study the problem of storing associations between analog signals in the presence of correlations, using methods from statistical mechanics. I characterize the typical learning performance in terms of the power spectrum of random input and output processes. I show that optimal synaptic weight configurations reach a capacity of 0.5 for any fraction of excitatory to inhibitory weights and have a peculiar synaptic distr…
In this work, we study the dynamic range of a neuronal network of excitable neurons with excitatory and inhibitory synapses. We obtain an analytical expression for the critical point as a function of the excitatory and inhibitory synaptic intensities. We also determine an analytical expression that gives the critical point value in which the maximal dynamic range occurs. Depending on the mean connection degree and coupl\-ing weights, the critical points can exhibit ceasing or ceaseless dynamics. However, the dynamic range is equal in both cases. We observe that the external stimulus mask some …
The statistical analysis of the collective neural activity known as avalanches provides insight into the proper behavior of brains across many species. We consider a neural network model based on the work of Lombardi, Herrmann, De Arcangelis et al. that captures the relevant dynamics of neural avalanches, and we show how tuning the fraction of inhibitory neurons in this model alters the connectivity of the network over time, removes exponential cut-offs present in the distributions of avalanche strength and duration, and transitions the power spectral density of the network into an `epileptic'…
Local patterns of excitation and inhibition that can generate neural waves are studied as a computational mechanism underlying the organization of neuronal tunings. Sparse coding algorithms based on networks of excitatory and inhibitory neurons are proposed that exhibit topographic maps as the receptive fields are adapted to input stimuli. Motivated by a leaky integrate-and-fire model of neural waves, we propose an activation model that is more typical of artificial neural networks. Computational experiments with the activation model using both natural images and natural language text are pres…
The Network of Noisy Leaky Integrate and Fire (NNLIF) model describes the behavior of a neural network at mesoscopic level. It is one of the simplest self-contained mean-field models considered for that purpose. Even so, to study the mathematical properties of the model some simplifications were necessary Cáceres-Carrillo-Perthame(2011), Cáceres-Perthame(2014), Cáceres-Schneider(2017), which disregard crucial phenomena. In this work we deal with the general NNLIF model without simplifications. It involves a network with two populations (excitatory and inhibitory), with transmission delays betw…
Excitation-inhibition (E-I) balance is ubiquitously observed in the cortex. Recent studies suggest an intriguing link between balance on fast timescales, tight balance, and efficient information coding with spikes. We further this connection by taking a principled approach to optimal balanced networks of excitatory (E) and inhibitory (I) neurons. By deriving E-I spiking neural networks from greedy spike-based optimizations of constrained minimax objectives, we show that tight balance arises from correcting for deviations from the minimax optima. We predict specific neuron firing rates in the n…
We investigate the performance of sparsely-connected networks of integrate-and-fire neurons for ultra-short term information processing. We exploit the fact that the population activity of networks with balanced excitation and inhibition can switch from an oscillatory firing regime to a state of asynchronous irregular firing or quiescence depending on the rate of external background spikes. We find that in terms of information buffering the network performs best for a moderate, non-zero, amount of noise. Analogous to the phenomenon of stochastic resonance the performance decreases for higher a…
Directed information transmission is paramount for many social, physical, and biological systems. For neural systems, scientists have studied this problem under the paradigm of feedforward networks for decades. In most models of feedforward networks, activity is exclusively driven by excitatory neurons and the wiring patterns between them, while inhibitory neurons play only a stabilizing role for the network dynamics. Motivated by recent experimental discoveries of hippocampal circuitry, cortical circuitry, and the diversity of inhibitory neurons throughout the brain, here we illustrate that o…
The aim of the present paper is to study the effects of Hebbian learning in random recurrent neural networks with biological connectivity, i.e. sparse connections and separate populations of excitatory and inhibitory neurons. We furthermore consider that the neuron dynamics may occur at a (shorter) time scale than synaptic plasticity and consider the possibility of learning rules with passive forgetting. We show that the application of such Hebbian learning leads to drastic changes in the network dynamics and structure. In particular, the learning rule contracts the norm of the weight matrix a…
Sequential chaotic oscillations in excitatory-inhibitory threshold-linear networks
Division of Applied Mathematics, Brown University（布朗大学应用数学系）；Robert J. and Nancy D. Carney Institute for Brain Science, Brown University（布朗大学罗伯特·J和南希·D·卡尼脑科学研究所）
The interaction between excitation and inhibition is crucial for brain computation. To understand synaptic mechanisms underlying brain function, it is important to separate excitatory and inhibitory inputs to a target neuron. In the traditional method, after applying somatic current or voltage clamp, the excitatory and inhibitory conductances are determined from the synaptic current-voltage (I-V) relation --- the slope corresponds to the total conductance and the intercept corresponds to the reversal current. Because of the space clamp effect, the measured conductance in general deviates subst…
Research on network mechanisms and coding properties of grid cells assume that the firing rate of a grid cell in each of its fields is the same. Furthermore, proposed network models predict spatial regularities in the firing of inhibitory interneurons that are inconsistent with experimental data. In this paper, by analyzing the response of grid cells recorded from rats during free navigation, we first show that there are strong variations in the mean firing rate of the fields of individual grid cells and thus show that the data is inconsistent with the theoretical models that predict similar p…
Correlations in spike-train ensembles can seriously impair the encoding of information by their spatio-temporal structure. An inevitable source of correlation in finite neural networks is common presynaptic input to pairs of neurons. Recent theoretical and experimental studies demonstrate that spike correlations in recurrent neural networks are considerably smaller than expected based on the amount of shared presynaptic input. By means of a linear network model and simulations of networks of leaky integrate-and-fire neurons, we show that shared-input correlations are efficiently suppressed by …
We investigate the synchronization properties between two excitatory coupled neurons in the presence of an inhibitory loop mediated by an interneuron. Dynamical inhibition together with noise independently applied to each neuron provide phase diversity in the dynamics of the neuronal motif. We show that the interplay between the coupling strengths and external noise controls the phase relations between the neurons in a counter-intuitive way. For a master-slave configuration (unidirectional coupling) we find that the slave can anticipate the master, on average, if the slave is subject to the in…
Advances in neural recording methods enable sampling from populations of thousands of neurons during the performance of behavioral tasks, raising the question of how recorded activity relates to the theoretical models of computations underlying performance. In the context of decision making in rodents, patterns of functional connectivity between choice-selective cortical neurons, as well as broadly distributed choice information in both excitatory and inhibitory populations, were recently reported [1]. The straightforward interpretation of these data suggests a mechanism relying on specific pa…
Firing Rate Models as Associative Memory: Excitatory-Inhibitory Balance for Robust Retrieval
Department of Information Engineering（信息工程系）；Università degli Studi di Padova（帕多瓦大学）；Center for Control, Dynamical Systems and Computation（控制、动态系统与计算中心）；University of California at Santa Barbara（加州大学圣巴巴拉分校）
Phase- and amplitude-dependent control of synchronization in excitatory-inhibitory networks via pulsed stimulation
Department of Physics, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, Iran（巴斯研究学院物理系）；School of Biological Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran（基础科学研究所生物科学学院）；Pasargad Institute for Advanced Innovative Solutions (PIAIS), Tehran, Iran（帕萨加德先进创新解决方案研究所）；The Zapata-Briceño Institute of Neuroscience, Madrid, Spain（萨帕塔-布里斯涅奥神经科学研究所）
A great deal of research has been devoted on the investigation of neural dynamics in various network topologies. However, only a few studies have focused on the influence of autapses, synapses from a neuron onto itself via closed loops, on neural synchronisation. Here, we build a random network with adaptive exponential integrate-and-fire neurons coupled with chemical synapses, equipped with autapses, to study the effect of the latter on synchronous behaviour. We consider time delay in the conductance of the pre-synaptic neuron for excitatory and inhibitory connections. Interestingly, in neura…
Many experiments have evidenced that electrical and chemical synapses -- hybrid synapses -- coexist in most organisms and brain structures. The role of electrical and chemical synapse connection in diversity of neural activity generation has been investigated separately in networks of varying complexities. Nevertheless, theoretical understanding of hybrid synapses in diverse dynamical states of neural networks for self-organization and robustness still has not been fully studied. Here, we present a model of neural network built with hybrid synapses to investigate the emergence of global and co…
We consider clustered small-world networks with both inhibitory (I) and excitatory (E) populations. This I-E neuronal network has adaptive dynamic I to E and E to I interpopulation synaptic strengths, governed by interpopulation spike-timing-dependent plasticity (STDP). In previous works without STDPs, fast sparsely synchronized rhythms, related to diverse cognitive functions, were found to appear in a range of noise intensity $D$ for static synaptic strengths. By varying $D$, we investigate the effect of interpopulation STDPs on diverse population and individual properties of fast sparsely sy…
This article is devoted to the theoretical and numerical analysis of a network of excitatory and inhibitory neurons of Hodgkin-Huxley (HH) type, for which the topology is inspired by that of a single local layer of visual cortex V1. Our model is related to the recent CSY model and therefore differs from other classical models in the field. It combines a driven stochastic drive -- which may be interpreted as an ambient drive for each neuron -- with recurrent inputs resulting from the network activity. After a review of the dynamics of a single HH equation for both the deterministic and the stoc…
We present a study on the emergence of a variety of spatio temporal patterns among neurons that are connected in a multiplex framework, with neurons on two layers with different functional couplings. With the Hindmarsh-Rose model for the dynamics of single neurons, we analyze the possible patterns of dynamics in each layer separately and report emergent patterns of activity like in-phase synchronized oscillations and amplitude death for excitatory coupling and anti-phase mixed-mode oscillations in multi-clusters with phase regularities when the connections are inhibitory. When they are multipl…
We study synaptically coupled neuronal networks to identify the role of coupling delays in network's synchronized behaviors. We consider a network of excitable, relaxation oscillator neurons where two distinct populations, one excitatory and one inhibitory, are coupled and interact with each other. The excitatory population is uncoupled, while the inhibitory population is tightly coupled. A geometric singular perturbation analysis yields existence and stability conditions for synchronization states under different firing patterns between the two populations, along with formulas for the periods…
