The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons. One particular requirement of this approach is that the neural response function closely follows a logistic curve.
Analytical approaches to calculating neural response functions have been the subject of many theoretical studies. In order to make the problem tractable, particular assumptions regarding the neural or synaptic parameters are usually made. However, biologically significant activity regimes exist which are not covered by these approaches: Under strong synaptic bombardment, as is often the case in cortex, the neuron is shifted into a high-conductance state (HCS) characterized by a small membrane time constant. In this regime, synaptic time constants and refractory periods dominate membrane dynamics.
The core idea of our approach is to separately consider two different "modes" of spiking dynamics: burst spiking and transient quiescence, in which the neuron does not spike for longer periods. We treat the former by propagating the PDF of the effective membrane potential from spike to spike within a burst, while using a diffusion approximation for the latter. We find that our prediction of the neural response function closely matches simulation data. Moreover, in the HCS scenario, we show that the neural response function becomes symmetric and can be well approximated by a logistic function, thereby providing the correct dynamics in order to perform neural sampling. We hereby provide not only a normative framework for Bayesian inference in cortex, but also powerful applications of low-power, accelerated neuromorphic systems to relevant machine learning tasks.
The highly variable dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference but stand in apparent contrast to the deterministic response of neurons measured in vitro. Based on a propagation of the membrane autocorrelation across spike bursts, we provide an analytical derivation of the neural activation function that holds for a large parameter space, including the high-conductance state. On this basis, we show how an ensemble of leaky integrate-and-fire neurons with conductance-based synapses embedded in a spiking enviro…
Recent in vitro data show that neurons respond to input variance with varying sensitivities. Here, we demonstrate that Hodgkin-Huxley (HH) neurons can operate in two computational regimes, one that is more sensitive to input variance (differentiating) and one that is less sensitive (integrating). A boundary plane in the 3D conductance space separates these two regimes. For a reduced HH model, this plane can be derived analytically from the V nullcline, thus suggesting a means of relating biophysical parameters to neural computation by analyzing the neuron's dynamical system.
Reduced models of neuronal activity such as Integrate-and-Fire models allow a description of neuronal dynamics in simple, intuitive terms and are easy to simulate numerically. We present a method to fit an Integrate-and-Fire-type model of neuronal activity, namely a modified version of the Spike Response Model, to a detailed Hodgkin-Huxley-type neuron model driven by stochastic spike arrival. In the Hogkin-Huxley model, spike arrival at the synapse is modeled by a change of synaptic conductance. For such conductance spike input, more than 70% of the postsynaptic action potentials can be predic…
Centre for Theoretical Neuroscience, University of Waterloo（滑铁卢大学理论神经科学中心）
The mathematical model underlying the Neural Engineering Framework (NEF) expresses neuronal input as a linear combination of synaptic currents. However, in biology, synapses are not perfect current sources and are thus nonlinear. Detailed synapse models are based on channel conductances instead of currents, which require independent handling of excitatory and inhibitory synapses. This, in particular, significantly affects the influence of inhibitory signals on the neuronal dynamics. In this technical report we first summarize the relevant portions of the NEF and conductance-based synapse model…
NMDA receptors are ion channels activated by the neurotransmitter glutamate in the mammalian brain and are important in synaptic function and plasticity, but are also found in extrasynaptic locations and influence neuronal excitability. There are different NMDA receptor subtypes which differ in their single-channel conductance. Recently, synaptic plasticity has been studied in mouse barrel cortex, the primary sensory cortex for input from the animal's whiskers. Pharmacological data imply the presence of low-conductance NMDA receptors in spiny stellate neurons of cortical layer 4, but of high-c…
We compute the firing rate of a leaky integrate-and-fire (LIF) neuron with stochastic conductance-based inputs in the limit when synaptic decay times are much shorter than the membrane time constant. A comparison of our analytical results to numeric simulations is presented for a range of biophysically-realistic parameters.
Cortical neurons are characterized by irregular firing and a broad distribution of rates. The balanced state model explains these observations with a cancellation of mean excitatory and inhibitory currents, which makes fluctuations drive firing. In networks of neurons with current-based synapses, the balanced state emerges dynamically if coupling is strong, i.e. if the mean number of synapses per neuron $K$ is large and synaptic efficacy is of order $1/\sqrt{K}$. When synapses are conductance-based, current fluctuations are suppressed when coupling is strong, questioning the applicability of t…
Behavioral control over stressful stimuli induces resilience to future conditions when control is lacking. The medial prefrontal cortex(mPFC) is a critically important brain region required for plasticity of stress resilience. We found that control over stress induces plasticity of the intrinsic voltage-gated conductances of pyramidal neurons in the PFC. To gain insight into the underlying biophysical mechanisms of this plasticity we used the conductance- based neural simulation software tool, NEURON, to model the increase in membrane excitability associated with resilience to stress. A ball a…
In a neuron with hyperpolarization activated current ($I_h$), the correct input frequency leads to an enhancement of the output response. This behavior is known as resonance and is well described by the neuronal impedance. In a simple neuron model we derive equations for the neuron's resonance and we link its frequency and existence with the biophysical properties of $I_h$. For a small voltage change, the component of the ratio of current change to voltage change ($dI/dV$) due to the voltage-dependent conductance change ($dg/dV$) is known as derivative conductance ($G_h^{Der}$). We show that b…
The interaction between excitation and inhibition is crucial for brain computation. To understand synaptic mechanisms underlying brain function, it is important to separate excitatory and inhibitory inputs to a target neuron. In the traditional method, after applying somatic current or voltage clamp, the excitatory and inhibitory conductances are determined from the synaptic current-voltage (I-V) relation --- the slope corresponds to the total conductance and the intercept corresponds to the reversal current. Because of the space clamp effect, the measured conductance in general deviates subst…
The interplay between excitatory and inhibitory neurons imparts rich functions of the brain. To understand the underlying synaptic mechanisms, a fundamental approach is to study the dynamics of excitatory and inhibitory conductances of each neuron. The traditional method of determining conductance employs the synaptic current-voltage (I-V) relation obtained via voltage clamp. Using theoretical analysis, electrophysiological experiments, and realistic simulations, here we demonstrate that the traditional method conceptually fails to measure the conductance due to the neglect of a nonlinear inte…
Cortical neurons are subject to sustained and irregular synaptic activity which causes important fluctuations of the membrane potential (Vm). We review here different methods to characterize this activity and its impact on spike generation. The simplified, fluctuating point-conductance model of synaptic activity provides the starting point of a variety of methods for the analysis of intracellular Vm recordings. In this model, the synaptic excitatory and inhibitory conductances are described by Gaussian-distributed stochastic variables, or colored conductance noise. The matching of experimental…
Neuronal spiking exhibits an exquisite combination of modulation and robustness properties, rarely matched in artificial systems. We exploit the particular interconnection structure of conductance based models to investigate this remarkable property. We find that much of neuronal modulation and robustness can be explained by separating the total transmembrane current into three different components corresponding to the three time scales of neuronal bursting. Each equivalent current aggregates many ionic contributions into an equivalent voltage-dependent conductance, which defines a key modulat…
Voltage-sensitive dye imaging (VSDi) has revealed fundamental properties of neocortical processing at mesoscopic scales. Since VSDi signals report the average membrane potential, it seems natural to use a mean-field formalism to model such signals. Here, we investigate a mean-field model of networks of Adaptive Exponential (AdEx) integrate-and-fire neurons, with conductance-based synaptic interactions. The AdEx model can capture the spiking response of different cell types, such as regular-spiking (RS) excitatory neurons and fast-spiking (FS) inhibitory neurons. We use a Master Equation formal…
Cue integration, the combination of different sources of information to reduce uncertainty, is a fundamental computational principle of brain function. Starting from a normative model we show that the dynamics of multi-compartment neurons with conductance-based dendrites naturally implement the required probabilistic computations. The associated error-driven plasticity rule allows neurons to learn the relative reliability of different pathways from data samples, approximating Bayes-optimal observers in multisensory integration tasks. Additionally, the model provides a functional interpretation…
The voltage-conductance kinetic model for the collective behavior of neurons has been studied by scientists and mathematicians for two decades, but the rigorous analysis of its solution structure has been only partially obtained in spite of plenty of numerical evidence in various scenarios. In this work, we consider a simplified voltage-conductance model in which the velocity field in the voltage variable is in a separable form. The long time behavior of the simplified model is fully investigated leading to the following dichotomy: either the density function converges to the global equilibriu…
We present an unsupervised, local activation-dependent learning rule for intrinsic plasticity (IP) which affects the composition of ion channel conductances for single neurons in a use-dependent way. We use a single-compartment conductance-based model for medium spiny striatal neurons in order to show the effects of parametrization of individual ion channels on the neuronal activation function. We show that parameter changes within the physiological ranges are sufficient to create an ensemble of neurons with significantly different activation functions. We emphasize that the effects of intrins…
Measured responses from visual cortical neurons show that spike times tend to be correlated rather than exactly Poisson distributed. Fano factors vary and are usually greater than 1 due to the tendency of spikes being clustered into bursts. We show that this behavior emerges naturally in a balanced cortical network model with random connectivity and conductance-based synapses. We employ mean field theory with correctly colored noise to describe temporal correlations in the neuronal activity. Our results illuminate the connection between two independent experimental findings: high conductance s…
We investigate the dynamics of large-scale interacting neural populations, composed of conductance based, spiking model neurons with modifiable synaptic connection strengths, which are possibly also subjected to external noisy currents. The network dynamics is controlled by a set of neural population probability distributions ($\mathrm{PPD}$)which are constructed along the same lines as in the Klimontovich approach to the kinetic theory of plasmas. An exact non-closed, nonlinear, system of integro-partial differential equations is derived for the $\mathrm{PPD}$s. As is customary, a closing pro…
Working memory (WM) has been intensively used to enable the temporary storing of information for processing purposes, playing an important role in the execution of various cognitive tasks. Recent studies have shown that information in WM is not only maintained through persistent recurrent activity but also can be stored in activity-silent states such as in short-term synaptic plasticity (STSP). Motivated by important applications of the STSP mechanisms in WM, the main focus of the present work is on the analysis of the effects of random inputs on a leaky integrate-and-fire (LIF) synaptic condu…
In awake animals, the activity of the cerebral cortex is highly complex, with neurons firing irregularly with apparent Poisson statistics. One way to characterize this complexity is to take advantage of the high interconnectivity of cerebral cortex and use intracellular recordings of cortical neurons, which contain information about the activity of thousands of other cortical neurons. Identifying the membrane potential (Vm) to a stochastic process enables the extraction of important statistical signatures of this complex synaptic activity. Typically, one estimates the total synaptic conductanc…
Since the first experimental evidences of active conductances in dendrites, most neurons have been shown to exhibit dendritic excitability through the expression of a variety of voltage-gated ion channels. However, despite experimental and theoretical efforts undertaken in the last decades, the role of this excitability for some kind of dendritic computation has remained elusive. Here we show that, owing to very general properties of excitable media, the average output of a model of active dendritic trees is a highly non-linear function of their afferent rate, attaining extremely large dynamic…
We present a method of estimating the gradient of an objective function with respect to the synaptic weights of a spiking neural network. The method works by measuring the fluctuations in the objective function in response to dynamic perturbation of the membrane conductances of the neurons. It is compatible with recurrent networks of conductance-based model neurons with dynamic synapses. The method can be interpreted as a biologically plausible synaptic learning rule, if the dynamic perturbations are generated by a special class of ``empiric'' synapses driven by random spike trains from an ext…
We study the time delay in the synaptic conductance for suppression of spike synchronisation in a random network of Hodgkin Huxley neurons coupled by means of chemical synapses. In the first part, we examine in detail how the time delay acts over the network during the synchronised and desynchronised neuronal activities. We observe a relation between the neuronal dynamics and the syaptic conductance distributions. We find parameter values in which the time delay has high effectiveness in promoting the suppression of spike synchronisation. In the second part, we analyse how the delayed neuronal…
Central neurons operate in a regime of constantly fluctuating conductances, induced by thousands of presynaptic cells. Channelrhodopsins have been almost exclusively used to imprint a fixed spike pattern by sequences of brief depolarizations. Here we introduce continuous dynamic photostimulation (CoDyPs), a novel approach to mimic in-vivo like input fluctuations noninvasively in cells transfected with the weakly inactivating channelrhodopsin variant ChIEF. Even during long-term experiments, cultured neurons subjected to CoDyPs generate seemingly random, but reproducible spike patterns. In volt…
The optimal patterns of synaptic conductances for spike generation in central neurons is a subject of considerable interest. Ideally, such conductance time courses should be extracted from membrane potential (Vm) activity, but this is difficult because the nonlinear contribution of conductances to the Vm renders their estimation from the membrane equation extremely sensitive. We outline here a solution to this problem based on a discretization of the time axis. This procedure can extract the time course of excitatory and inhibitory conductances solely from the analysis of Vm activity. We test …
Artificial neural networks (ANNs) have been extensively used for the description of problems arising from biological systems and for constructing neuromorphic computing models. The third generation of ANNs, namely, spiking neural networks (SNNs), inspired by biological neurons enable a more realistic mimicry of the human brain. A large class of the problems from these domains is characterized by the necessity to deal with the combination of neurons, spikes and synapses via integrate-and-fire neuron models. Motivated by important applications of the integrate-and-fire of neurons in neuromorphic…
We investigate the efficient transmission and processing of weak, subthreshold signals in a realistic neural medium in the presence of different levels of the underlying noise. Assuming Hebbian weights for maximal synaptic conductances -- that naturally balances the network with excitatory and inhibitory synapses -- and considering short-term synaptic plasticity affecting such conductances, we found different dynamic phases in the system. This includes a memory phase where population of neurons remain synchronized, an oscillatory phase where transitions between different synchronized populatio…
We review two examples where the linear response of a neuronal network submitted to an external stimulus can be derived explicitely, including network parameters dependence. This is done in a statistical physics-like approach where one associates to the spontaneous dynamics of the model a natural notion of Gibbs distribution inherited from ergodic theory or stochastic processes. These two examples are the Amari-Wilson-Cowan model and a conductance based Integrate and Fire model.
The main contribution to the local field potential (LFP) is thought to stem from synaptic input to neurons and the ensuing subthreshold dendritic processing. The role of active dendritic conductances in shaping the LFP has received little attention, even though such ion channels are known to affect the subthreshold neuron dynamics. Here we used a modeling approach to investigate the effects of subthreshold dendritic conductances on the LFP. Using a biophysically detailed, experimentally constrained model of a cortical pyramidal neuron, we identified conditions under which subthreshold active c…
We present an optimized conductance-based retina microcircuit simulator which transforms light stimuli into a series of graded and spiking action potentials through photo transduction. We use discrete retinal neuron blocks based on a collation of single-compartment models and morphologically realistic formulations, and successfully achieve a biologically real-time simulator. This is done by optimizing the numerical methods employed to solve the system of over 270 nonlinear ordinary differential equations and parameters. Our simulator includes some of the most recent advances in compartmental m…
We investigate the effect of electric synapses (gap junctions) on collective neuronal dynamics and spike statistics in a conductance-based Integrate-and-Fire neural network, driven by a Brownian noise, where conductances depend upon spike history. We compute explicitly the time evolution operator and show that, given the spike-history of the network and the membrane potentials at a given time, the further dynamical evolution can be written in a closed form. We show that spike train statistics is described by a Gibbs distribution whose potential can be approximated with an explicit formula, whe…
We investigate the stimulus-dependent tuning properties of a noisy ionic conductance model for intrinsic subthreshold oscillations in membrane potential and associated spike generation. On depolarization by an applied current, the model exhibits subthreshold oscillatory activity with occasional spike generation when oscillations reach the spike threshold. We consider how the amount of applied current, the noise intensity, variation of maximum conductance values and scaling to different temperature ranges alter the responses of the model with respect to voltage traces, interspike intervals and …
An analytical description of the response properties of simple but realistic neuron models in the presence of noise is still lacking. We determine completely up to the second order the firing statistics of a single and a pair of leaky integrate-and-fire neurons (LIFs) receiving some common slowly filtered white noise. In particular, the auto- and cross-correlation functions of the output spike trains of pairs of cells are obtained from an improvement of the adiabatic approximation introduced in \cite{Mor+04}. These two functions define the firing variability and firing synchronization between …
We demonstrate numerically that a brief burst consisting of two to six spikes can propagate in a stable manner through a one-dimensional homogeneous feedforward chain of non-bursting neurons with excitatory synaptic connections. Our results are obtained for two kinds of neuronal models, leaky integrate-and-fire (LIF) neurons and Hodgkin-Huxley (HH) neurons with five conductances. Over a range of parameters such as the maximum synaptic conductance, both kinds of chains are found to have multiple attractors of propagating bursts, with each attractor being distinguished by the number of spikes an…
Strong inhibitory input to neurons, which occurs in balanced states of neural networks, increases synaptic current fluctuations. This has led to the assumption that inhibition contributes to the high spike-firing irregularity observed in vivo. We used single compartment neuronal models with time-correlated (due to synaptic filtering) and state-dependent (due to reversal potentials) input to demonstrate that inhibitory input acts to decrease membrane potential fluctuations, a result that cannot be achieved with simplified neural input models. To clarify the effects on spike-firing regularity, w…
We study temporal correlations of interspike intervals (ISIs), quantified by the network-averaged serial correlation coefficient (SCC), in networks of both current- and conductance-based purely inhibitory integrate-and-fire neurons. Numerical simulations reveal transitions to negative SCCs at intermediate values of bias current drive and network size. As bias drive and network size are increased past these values, the SCC returns to zero. The SCC is maximally negative at an intermediate value of the network oscillation strength. The dependence of the SCC on two canonical schemes for synaptic c…
The baroreceptor neurons serve as the primary transducers of blood pressure for the autonomic nervous system and are thus critical in enabling the body to respond effectively to changes in blood pressure. These neurons can be separated into two types (A and C) based on the myelination of their axons and their distinct firing patterns elicited in response to specific pressure stimuli. This study has developed a comprehensive model of the afferent baroreceptor discharge built on physiological knowledge of arterial wall mechanics, firing rate responses to controlled pressure stimuli, and ion chan…
The Hodgkin-Huxley model describes the conduction of the nervous impulse through the axon, whose membrane's electric response can be described employing multiple connected electric circuits containing capacitors, voltage sources, and conductances. These conductances depend on previous depolarizing membrane voltages, which can be identified with a memory resistive element called memristor. Inspired by the recent quantization of the memristor, a simplified Hodgkin-Huxley model including a single ion channel has been studied in the quantum regime. Here, we study the quantization of the complete H…
The voltage-conductance kinetic equation for integrate and fire neurons has been used in neurosciences since a decade and describes the probability density of neurons in a network. It is used when slow conductance receptors are activated and noticeable applications to the visual cortex have been worked-out. In the simplest case, the derivation also uses the assumption of fully excitatory and moderately all-to-all coupled networks; this is the situation we consider here. We study properties of solutions of the kinetic equation for steady states and time evolution and we prove several global a p…
Networks of excitatory and inhibitory neurons display asynchronous irregular (AI) states, where the activities of the two populations are balanced. At the single cell level, it was shown that neurons subject to balanced and noisy synaptic inputs can display enhanced responsiveness. We show here that this enhanced responsiveness is also present at the network level, but only when single neurons are in a conductance state and fluctuation regime consistent with experimental measurements. In such states, the entire population of neurons is globally influenced by the external input. We suggest that…
Many cognitive processes rely on the ability of the brain to hold sequences of events in short-term memory. Recent studies have revealed that such memory can be read out from the transient dynamics of a network of neurons. However, the memory performance of such a network in buffering past information has only been rigorously estimated in networks of linear neurons. When signal gain is kept low, so that neurons operate primarily in the linear part of their response nonlinearity, the memory lifetime is bounded by the square root of the network size. In this work, I demonstrate that it is possib…
We present an array of leaky integrate-and-fire (LIF) neuron circuits designed for the second-generation BrainScaleS mixed-signal 65-nm CMOS neuromorphic hardware. The neuronal array is embedded in the analog network core of a scaled-down prototype HICANN-DLS chip. Designed as continuous-time circuits, the neurons are highly tunable and reconfigurable elements with accelerated dynamics. Each neuron integrates input current from a multitude of incoming synapses and evokes a digital spike event output. The circuit offers a wide tuning range for synaptic and membrane time constants, as well as fo…
The leaky integrate and fire (LIF) neuron represents standard neuronal model used for numerical simulations. The leakage is implemented in the model as exponential decay of trans-membrane voltage towards its resting value. This makes inevitable the usage of machine floating point numbers in the course of simulation. It is known that machine floating point arithmetic is subjected to small inaccuracies, which prevent from exact comparison of floating point quantities. In particular, it is incorrect to decide whether two separate in time states of a simulated system composed of LIF neurons are ex…
The nonlinear properties of the dendrites in prepositus hypoglossi neurons are involved in maintenance of eye position. The biophysical properties of these neurons are essential for the operation of the vestibular neural integrator that converts a head velocity signal to one that controls eye position. A novel method named QSA (quadratic sinusoidal analysis) for voltage clamped neurons was used to quantify nonlinear responses that are dominated by dendrites. The voltage clamp currents were measured at harmonic and interactive frequencies using specific stimulation frequencies, which act as fre…
The temporal dynamics of membrane voltage changes in neurons is controlled by ionic currents. These currents are characterized by two main properties: conductance and kinetics. The hyperpolarization-activated current ($I_{\rm h}$) strongly modulates subthreshold potential changes by shortening the excitatory postsynaptic potentials and decreasing their temporal summation. Whereas the shortening of the synaptic potentials caused by the $I_{\rm h}$ conductance is well understood, the role of the $I_{\rm h}$ kinetics remains unclear. Here, we use a model of the $I_{\rm h}$ current model with eith…
This review gives a short historical account of the excitable maps approach for modeling neurons and neuronal networks. Some early models, due to Pasemann (1993), Chialvo (1995) and Kinouchi and Tragtenberg (1996), are compared with more recent proposals by Rulkov (2002) and Izhikevich (2003). We also review map-based schemes for electrical and chemical synapses and some recent findings as critical avalanches in map-based neural networks. We conclude with suggestions for further work in this area like more efficient maps, compartmental modeling and close dynamical comparison with conductance-b…
We study a network model of two conductance-based pacemaker neurons of differing natural frequency, coupled with either mutual excitation or inhibition, and receiving shared random inhibitory synaptic input. The networks may phase-lock spike-to-spike for strong mutual coupling. But the shared input can desynchronize the locked spike-pairs by selectively eliminating the lagging spike or modulating its timing with respect to the leading spike depending on their separation time window. Such loss of synchrony is also found in a large network of sparsely coupled heterogeneous spiking neurons receiv…
Over the past decade there has been a growing interest in the development of parallel hardware systems for simulating large-scale networks of spiking neurons. Compared to other highly-parallel systems, GPU-accelerated solutions have the advantage of a relatively low cost and a great versatility, thanks also to the possibility of using the CUDA-C/C++ programming languages. NeuronGPU is a GPU library for large-scale simulations of spiking neural network models, written in the C++ and CUDA-C++ programming languages, based on a novel spike-delivery algorithm. This library includes simple LIF (leak…
The information transfer in the thalamus is blocked dynamically during sleep, in conjunction with the occurence of spindle waves. As the theoretical understanding of the mechanism remains incomplete, we analyze two modeling approaches for a recent experiment by Le Masson {\sl et al}. on the thalamocortical loop. In a first step, we use a conductance-based neuron model to reproduce the experiment computationally. In a second step, we model the same system by using an extended Hindmarsh-Rose model, and compare the results with the conductance-based model. In the framework of both models, we inve…
This paper deals with the problem of inferring the signals and parameters that cause neural activity to occur. The ultimate challenge being to unveil brain's connectivity, here we focus on a microscopic vision of the problem, where single neurons (potentially connected to a network of peers) are at the core of our study. The sole observation available are noisy, sampled voltage traces obtained from intracellular recordings. We design algorithms and inference methods using the tools provided by stochastic filtering, that allow a probabilistic interpretation and treatment of the problem. Using p…
Limitations in processing capabilities and memory of today's computers make spiking neuron-based (human) whole-brain simulations inevitably characterized by a compromise between bio-plausibility and computational cost. It translates into brain models composed of a reduced number of neurons and a simplified neuron's mathematical model, leading to the search for new simulation strategies. Taking advantage of the sparse character of brain-like computation, the event-driven technique could represent a way to carry out efficient simulation of large-scale Spiking Neural Networks (SNN). The recent Le…
