Synapses are information efficient in the sense that their natural conductance values convey as many bits per Joule as possible, but efficiency falls rapidly if the conductance is forced to deviate from its natural value (Harris et al, 2015. However, the exact manner in which efficiency falls as conductance deviates from its natural value remains unexplained. Recently, Malkin et al (2026) showed that synaptic noise is minimised given the available energy, consistent with a minimal energy boundary. This minimal energy boundary is a necessary, but not sufficient, condition for maximising information efficiency. By expressing the minimal energy boundary in terms of Shannon's information theory (Shannon, 1949), we show that synapses operate at signal-to-noise ratios which maximise information efficiency, and that this accurately predicts the decrease in efficiency values observed in Harris et al (2015) across a wide range of synaptic conductances. Crucially, the proposed model contains no free parameters because it is derived from the biophysics of the synapse. The results reported here are consistent with the general principle that neuronal systems in the brain have evolved to be as efficient as possible in terms of the number of bits per Joule.
The optimal patterns of synaptic conductances for spike generation in central neurons is a subject of considerable interest. Ideally, such conductance time courses should be extracted from membrane potential (Vm) activity, but this is difficult because the nonlinear contribution of conductances to the Vm renders their estimation from the membrane equation extremely sensitive. We outline here a solution to this problem based on a discretization of the time axis. This procedure can extract the time course of excitatory and inhibitory conductances solely from the analysis of Vm activity. We test …
Previous experimental work has shown high-frequency Poisson-distributed trains of combined excitatory and inhibitory conductance- and current-based synaptic inputs reduce amplitude of subthreshold oscillations of SCs. In this paper, we investigate the mechanism underlying these phenomena in the context of the model. More specially, we studied the effects of both conductance- and current-based synaptic inputs at various maximal conductance values on a SC model. Our numerical simulations show that conductance-based synaptic inputs reduce the amplitude of SC's subthreshold oscillations for low en…
We compute the firing rate of a leaky integrate-and-fire (LIF) neuron with stochastic conductance-based inputs in the limit when synaptic decay times are much shorter than the membrane time constant. A comparison of our analytical results to numeric simulations is presented for a range of biophysically-realistic parameters.
A pre-synaptic neuron releases diffusing neurotransmitters such as glutamate that activate post-synaptic receptors. The amplitude of the post-synaptic current, mostly mediated by glutamatergic (AMPARs) receptors, is a fundamental signal that may generate an action potential. However, although various simulation results \cite{kullman,Barbour,Raghavachari} have addressed how synapses control the post-synaptic current, it is still unclear how this current depends analytically on factors such as the synaptic cleft geometry, the distribution, the number and the multi-conductance state of receptors,…
Cortical neurons are subject to sustained and irregular synaptic activity which causes important fluctuations of the membrane potential (Vm). We review here different methods to characterize this activity and its impact on spike generation. The simplified, fluctuating point-conductance model of synaptic activity provides the starting point of a variety of methods for the analysis of intracellular Vm recordings. In this model, the synaptic excitatory and inhibitory conductances are described by Gaussian-distributed stochastic variables, or colored conductance noise. The matching of experimental…
The interplay between excitatory and inhibitory neurons imparts rich functions of the brain. To understand the underlying synaptic mechanisms, a fundamental approach is to study the dynamics of excitatory and inhibitory conductances of each neuron. The traditional method of determining conductance employs the synaptic current-voltage (I-V) relation obtained via voltage clamp. Using theoretical analysis, electrophysiological experiments, and realistic simulations, here we demonstrate that the traditional method conceptually fails to measure the conductance due to the neglect of a nonlinear inte…
Working memory (WM) has been intensively used to enable the temporary storing of information for processing purposes, playing an important role in the execution of various cognitive tasks. Recent studies have shown that information in WM is not only maintained through persistent recurrent activity but also can be stored in activity-silent states such as in short-term synaptic plasticity (STSP). Motivated by important applications of the STSP mechanisms in WM, the main focus of the present work is on the analysis of the effects of random inputs on a leaky integrate-and-fire (LIF) synaptic condu…
Latency reduction of postsynaptic spikes is a well-known effect of Synaptic Time-Dependent Plasticity. We expand this notion for long postsynaptic spike trains, showing that, for a fixed input spike train, STDP reduces the number of postsynaptic spikes and concentrates the remaining ones. Then we study the consequences of this phenomena in terms of coding, finding that this mechanism improves the neural code by increasing the signal-to-noise ratio and lowering the metabolic costs of frequent stimuli. Finally, we illustrate that the reduction of postsynaptic latencies can lead to the emergence …
In awake animals, the activity of the cerebral cortex is highly complex, with neurons firing irregularly with apparent Poisson statistics. One way to characterize this complexity is to take advantage of the high interconnectivity of cerebral cortex and use intracellular recordings of cortical neurons, which contain information about the activity of thousands of other cortical neurons. Identifying the membrane potential (Vm) to a stochastic process enables the extraction of important statistical signatures of this complex synaptic activity. Typically, one estimates the total synaptic conductanc…
The main contribution to the local field potential (LFP) is thought to stem from synaptic input to neurons and the ensuing subthreshold dendritic processing. The role of active dendritic conductances in shaping the LFP has received little attention, even though such ion channels are known to affect the subthreshold neuron dynamics. Here we used a modeling approach to investigate the effects of subthreshold dendritic conductances on the LFP. Using a biophysically detailed, experimentally constrained model of a cortical pyramidal neuron, we identified conditions under which subthreshold active c…
We present a method of estimating the gradient of an objective function with respect to the synaptic weights of a spiking neural network. The method works by measuring the fluctuations in the objective function in response to dynamic perturbation of the membrane conductances of the neurons. It is compatible with recurrent networks of conductance-based model neurons with dynamic synapses. The method can be interpreted as a biologically plausible synaptic learning rule, if the dynamic perturbations are generated by a special class of ``empiric'' synapses driven by random spike trains from an ext…
The interaction between excitation and inhibition is crucial for brain computation. To understand synaptic mechanisms underlying brain function, it is important to separate excitatory and inhibitory inputs to a target neuron. In the traditional method, after applying somatic current or voltage clamp, the excitatory and inhibitory conductances are determined from the synaptic current-voltage (I-V) relation --- the slope corresponds to the total conductance and the intercept corresponds to the reversal current. Because of the space clamp effect, the measured conductance in general deviates subst…
We consider a classical space-clamped Hodgkin-Huxley model neuron stimulated by synaptic excitation and inhibition with conductances represented by Ornstein-Uhlenbeck processes. Using numerical solutions of the stochastic model system obtained by an Euler method, it is found that with excitation only there is a critical value of the steady state excitatory conductance for repetitive spiking without noise and for values of the conductance near the critical value small noise has a powerfully inhibitory effect. For a given level of inhibition there is also a critical value of the steady state exc…
NMDA receptors are ion channels activated by the neurotransmitter glutamate in the mammalian brain and are important in synaptic function and plasticity, but are also found in extrasynaptic locations and influence neuronal excitability. There are different NMDA receptor subtypes which differ in their single-channel conductance. Recently, synaptic plasticity has been studied in mouse barrel cortex, the primary sensory cortex for input from the animal's whiskers. Pharmacological data imply the presence of low-conductance NMDA receptors in spiny stellate neurons of cortical layer 4, but of high-c…
Sparse coding algorithms trained on natural images can accurately predict the features that excite visual cortical neurons, but it is not known whether such codes can be learned using biologically realistic plasticity rules. We have developed a biophysically motivated spiking network, relying solely on synaptically local information, that can predict the full diversity of V1 simple cell receptive field shapes when trained on natural images. This represents the first demonstration that sparse coding principles, operating within the constraints imposed by cortical architecture, can successfully …
Biological neural networks face a formidable task: performing reliable computations in the face of intrinsic stochasticity in individual neurons, imprecisely specified synaptic connectivity, and nonnegligible delays in synaptic transmission. A common approach to combatting such biological heterogeneity involves averaging over large redundant networks of $N$ neurons resulting in coding errors that decrease classically as $1/\sqrt{N}$. Recent work demonstrated a novel mechanism whereby recurrent spiking networks could efficiently encode dynamic stimuli, achieving a superclassical scaling in whic…
Neural coding is a key problem in neuroscience, which can promote people's understanding of the mechanism that brain processes information. Among the classical theories of neural coding, the population rate coding has been studied widely in many works. Most computational studies considered the neurons and the corresponding presynaptic synapses as pre-determined excitatory or inhibitory types. According to physiological evidence, however, that the real effect of a synapse is inhibitory or excitatory is determined by the type of the activated receptors. The co-release of excitatory and inhibitor…
Artificial neural networks (ANNs) have been extensively used for the description of problems arising from biological systems and for constructing neuromorphic computing models. The third generation of ANNs, namely, spiking neural networks (SNNs), inspired by biological neurons enable a more realistic mimicry of the human brain. A large class of the problems from these domains is characterized by the necessity to deal with the combination of neurons, spikes and synapses via integrate-and-fire neuron models. Motivated by important applications of the integrate-and-fire of neurons in neuromorphic…
We demonstrate numerically that a brief burst consisting of two to six spikes can propagate in a stable manner through a one-dimensional homogeneous feedforward chain of non-bursting neurons with excitatory synaptic connections. Our results are obtained for two kinds of neuronal models, leaky integrate-and-fire (LIF) neurons and Hodgkin-Huxley (HH) neurons with five conductances. Over a range of parameters such as the maximum synaptic conductance, both kinds of chains are found to have multiple attractors of propagating bursts, with each attractor being distinguished by the number of spikes an…
Two elements of neural information processing have primarily been proposed: firing rate and spike timing of neurons. In the case of synaptic plasticity, although spike-timing-dependent plasticity (STDP) depending on presynaptic and postsynaptic spike times had been considered the most common rule, recent studies have shown the inhibitory nature of the brain in vivo for precise spike timing, which is key to the STDP. Thus, the importance of the firing frequency in synaptic plasticity in vivo has been recognized again. However, little is understood about how the frequency-dependent synaptic plas…
Experimental observations on synaptic plasticity at individual glutamatergic synapses from the CA3 Shaffer collateral pathway onto CA1 pyramidal cells in the hippocampus suggest that the transitions in synaptic strength occur among discrete levels at individual synapses (~\cite{Peter} and S. S.-H. Wang, unpublished data used with the authors' permission). This happens for both long term potentiation (LTP) and long term depression (LTD) induction protocols. O'Connor, Wittenberg, and Wang have argued that three states would account for their observations on individual synapses in the CA3-CA1 pat…
We present an unsupervised, local activation-dependent learning rule for intrinsic plasticity (IP) which affects the composition of ion channel conductances for single neurons in a use-dependent way. We use a single-compartment conductance-based model for medium spiny striatal neurons in order to show the effects of parametrization of individual ion channels on the neuronal activation function. We show that parameter changes within the physiological ranges are sufficient to create an ensemble of neurons with significantly different activation functions. We emphasize that the effects of intrins…
We investigate from a computational perspective the efficiency of the Willshaw synaptic update rule in the context of familiarity discrimination, a binary-answer, memory-related task that has been linked through psychophysical experiments with modified neural activity patterns in the prefrontal and perirhinal cortex regions. Our motivation for recovering this well-known learning prescription is two-fold: first, the switch-like nature of the induced synaptic bonds, as there is evidence that biological synaptic transitions might occur in a discrete stepwise fashion. Second, the possibility that …
Here we analyze synaptic transmission from an information-theoretic perspective. We derive closed-form expressions for the lower-bounds on the capacity of a simple model of a cortical synapse under two explicit coding paradigms. Under the ``signal estimation'' paradigm, we assume the signal to be encoded in the mean firing rate of a Poisson neuron. The performance of an optimal linear estimator of the signal then provides a lower bound on the capacity for signal estimation. Under the ``signal detection'' paradigm, the presence or absence of the signal has to be detected. Performance of the opt…
The temporal dynamics of membrane voltage changes in neurons is controlled by ionic currents. These currents are characterized by two main properties: conductance and kinetics. The hyperpolarization-activated current ($I_{\rm h}$) strongly modulates subthreshold potential changes by shortening the excitatory postsynaptic potentials and decreasing their temporal summation. Whereas the shortening of the synaptic potentials caused by the $I_{\rm h}$ conductance is well understood, the role of the $I_{\rm h}$ kinetics remains unclear. Here, we use a model of the $I_{\rm h}$ current model with eith…
The timing of individual neuronal spikes is essential for biological brains to make fast responses to sensory stimuli. However, conventional artificial neural networks lack the intrinsic temporal coding ability present in biological networks. We propose a spiking neural network model that encodes information in the relative timing of individual neuron spikes. In classification tasks, the output of the network is indicated by the first neuron to spike in the output layer. This temporal coding scheme allows the supervised training of the network with backpropagation, using locally exact derivati…
Cortical neurons are characterized by irregular firing and a broad distribution of rates. The balanced state model explains these observations with a cancellation of mean excitatory and inhibitory currents, which makes fluctuations drive firing. In networks of neurons with current-based synapses, the balanced state emerges dynamically if coupling is strong, i.e. if the mean number of synapses per neuron $K$ is large and synaptic efficacy is of order $1/\sqrt{K}$. When synapses are conductance-based, current fluctuations are suppressed when coupling is strong, questioning the applicability of t…
Changes in brain states, as found in many neurological diseases such as epilepsy, are often described as bifurcations in mesoscopic neural models. Nearly all of these models rely on a mathematically convenient, but biophysically inaccurate, description of the synaptic input to neurons called current-based synapses. We develop a novel analytical framework to analyze the effects of a more biophysically realistic description, known as conductance-based synapses. These are implemented in a mesoscopic neural model and compared to the standard approximation via a single parameter homotopic mapping. …
In this work we study, analytically and employing Monte Carlo simulations, the influence of the competition between several activity-dependent synaptic processes, such as short-term synaptic facilitation and depression, on the maximum memory storage capacity in a neural network. In contrast with the case of synaptic depression, which drastically reduces the capacity of the network to store and retrieve "static" activity patterns, synaptic facilitation enhances the storage capacity in different contexts. In particular, we found optimal values of the relevant synaptic parameters (such as the neu…
The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons. One particular requirement of this approach is that the neural response function closely follows a logistic curve. Analytical approaches to calculating neural response functions have been the subject of many theoretical studies. In order to make the problem tractable, particular…
The purpose of this paper is trifold -- to serve as an instructive resource and a reference catalog for biologically plausible modeling with i) conductance-based models, coupled with ii) strength-varying slow synapse models, culminating in iii) two canonical pair-wise rhythm-generating networks. We document the properties of basic network components: cell models and synaptic models, which are prerequisites for proper network assembly. Using the slow-fast decomposition we present a detailed analysis of the cellular dynamics including a discussion of the most relevant bifurcations. Several appro…
Centre for Theoretical Neuroscience, University of Waterloo（滑铁卢大学理论神经科学中心）
The mathematical model underlying the Neural Engineering Framework (NEF) expresses neuronal input as a linear combination of synaptic currents. However, in biology, synapses are not perfect current sources and are thus nonlinear. Detailed synapse models are based on channel conductances instead of currents, which require independent handling of excitatory and inhibitory synapses. This, in particular, significantly affects the influence of inhibitory signals on the neuronal dynamics. In this technical report we first summarize the relevant portions of the NEF and conductance-based synapse model…
There is evidence that biological synapses have only a fixed number of discrete weight states. Memory storage with such synapses behaves quite differently from synapses with unbounded, continuous weights as old memories are automatically overwritten by new memories. We calculate the storage capacity of discrete, bounded synapses in terms of Shannon information. For optimal learning rules, we investigate how information storage depends on the number of synapses, the number of synaptic states and the coding sparseness.
Replicating the computational functionalities and performances of the brain remains one of the biggest challenges for the future of information and communication technologies. Such an ambitious goal requires research efforts from the architecture level to the basic device level (i.e., investigating the opportunities offered by emerging nanotechnologies to build such systems). Nanodevices, or, more precisely, memory or memristive devices, have been proposed for the implementation of synaptic functions, offering the required features and integration in a single component. In this paper, we demon…
We present a mathematical analysis of a networks with Integrate-and-Fire neurons and adaptive conductances. Taking into account the realistic fact that the spike time is only known within some \textit{finite} precision, we propose a model where spikes are effective at times multiple of a characteristic time scale $δ$, where $δ$ can be \textit{arbitrary} small (in particular, well beyond the numerical precision). We make a complete mathematical characterization of the model-dynamics and obtain the following results. The asymptotic dynamics is composed by finitely many stable periodic orbits, wh…
Recent experimental studies indicate that synaptic changes induced by neuronal activity are discrete jumps between a small number of stable states. Learning in systems with discrete synapses is known to be a computationally hard problem. Here, we study a neurobiologically plausible on-line learning algorithm that derives from Belief Propagation algorithms. We show that it performs remarkably well in a model neuron with binary synapses, and a finite number of `hidden' states per synapse, that has to learn a random classification task. Such system is able to learn a number of associations close …
We study temporal correlations of interspike intervals (ISIs), quantified by the network-averaged serial correlation coefficient (SCC), in networks of both current- and conductance-based purely inhibitory integrate-and-fire neurons. Numerical simulations reveal transitions to negative SCCs at intermediate values of bias current drive and network size. As bias drive and network size are increased past these values, the SCC returns to zero. The SCC is maximally negative at an intermediate value of the network oscillation strength. The dependence of the SCC on two canonical schemes for synaptic c…
