The past decade has seen great advances in our understanding of the role of noise in gene regulation and the physical limits to signaling in biological networks. Here we introduce the spectral method for computation of the joint probability distribution over all species in a biological network. The spectral method exploits the natural eigenfunctions of the master equation of birth-death processes to solve for the joint distribution of modules within the network, which then inform each other and facilitate calculation of the entire joint distribution. We illustrate the method on a ubiquitous case in nature: linear regulatory cascades. The efficiency of the method makes possible numerical optimization of the input and regulatory parameters, revealing design properties of, e.g., the most informative cascades. We find, for threshold regulation, that a cascade of strong regulations converts a unimodal input to a bimodal output, that multimodal inputs are no more informative than bimodal inputs, and that a chain of up-regulations outperforms a chain of down-regulations. We anticipate that this numerical approach may be useful for modeling noise in a variety of small network topologies in biology.
The set of regulatory interactions between genes, mediated by transcription factors, forms a species' transcriptional regulatory network (TRN). By comparing this network with measured gene expression data one can identify functional properties of the TRN and gain general insight into transcriptional control. We define the subnet of a node as the subgraph consisting of all nodes topologically downstream of the node, including itself. Using a large set of microarray expression data of the bacterium Escherichia coli, we find that the gene expression in different subnets exhibits a structured patt…
We investigate the structural and dynamical properties of the transcriptional regulatory network of the yeast {\it Saccharomyces cerevisiae} and compare it with two unbiased ensembles: one obtained by reshuffling the edges and the other generated by mimicking the transcriptional regulation mechanism within the cell. Both ensembles reproduce the degree distributions (the first -by construction- exactly and the second approximately), degree-degree correlations and the $k$-core structure observed in Yeast. An exceptionally large dynamically relevant core network found in Yeast in comparison with …
Dynamical properties of the transcriptional regulatory network of {\it Escherichia coli} and {\it Saccharomyces cerevisiae} are studied within the framework of random Boolean functions. The dynamical response of these networks to a single point mutation is characterized by the number of mutated elements as a function of time and the distribution of the relaxation time to a new stationary state, which turn out to be different in both networks. Comparison with the behavior of randomized networks reveals relevant structural characteristics other than the mean connectivity, namely the organization…
The transcriptional regulation of gene expression is orchestrated by complex networks of interacting genes. Increasing evidence indicates that these transcriptional regulatory networks (TRNs) in bacteria have an inherently hierarchical architecture, although the design principles and the specific advantages offered by this type of organization have not yet been fully elucidated. In this study, we focussed on the hierarchical structure of the TRN of the gram-positive bacterium Bacillus subtilis and performed a comparative analysis with the TRN of the gram-negative bacterium Escherichia coli. Us…
BACKGROUND. Signal recognition and information processing is a fundamental cellular function, which in part involves comprehensive transcriptional regulatory (TR) mechanisms carried out in response to complex environmental signals in the context of the cell's own internal state. However, the network topological basis of developing such integrated responses remains poorly understood. RESULTS. By studying the TR network of the yeast Saccharomyces cerevisiae we show that an intermediate layer of transcription factors naturally segregates into distinct subnetworks. In these topological units trans…
Robust systems, like the molecular networks of living cells are often resistant to single hits such as those caused by high-specificity drugs. Here we show that partial weakening of the Escherichia coli and Saccharomyces cerevisiae transcriptional regulatory networks at a small number (3-5) selected nodes can have a greater impact than the complete elimination of a single selected node. In both cases, the targeted nodes have the greatest possible impact; still the results suggest that in some cases broad specificity compounds or multitarget drug therapies may be more effective than individual …
In the simplest view of transcriptional regulation, the expression of a gene is turned on or off by changes in the concentration of a transcription factor (TF). We use recent data on noise levels in gene expression to show that it should be possible to transmit much more than just one regulatory bit. Realizing this optimal information capacity would require that the dynamic range of TF concentrations used by the cell, the input/output relation of the regulatory module, and the noise levels of binding and transcription satisfy certain matching relations. This parameter-free prediction is in goo…
Gene expression is controlled primarily by interactions between transcription factor proteins (TFs) and the regulatory DNA sequence, a process that can be captured well by thermodynamic models of regulation. These models, however, neglect regulatory crosstalk: the possibility that non-cognate TFs could initiate transcription, with potentially disastrous effects for the cell. Here we estimate the importance of crosstalk, suggest that its avoidance strongly constrains equilibrium models of TF binding, and propose an alternative non-equilibrium scheme that implements kinetic proofreading to suppr…
Gene transcriptional regulatory is an inherently noisy process. In this paper, the study of fluctuations in a gene transcriptional regulatory system is extended to the case of Lévy noise, a kind of non-Gaussian noises which can describe unpredictable jump changes of the random environment. The stationary probability density is given to explore the key roles of Lévy noise in the gene regulatory networks. The results demonstrate that the parameters of Lévy noise, including noise intensity, stability index and skewness parameter can induce switches between distinct gene-expression states. A furth…
We have compared a recently developed module-based algorithm LeMoNe for reverse-engineering transcriptional regulatory networks to a mutual information based direct algorithm CLR, using benchmark expression data and databases of known transcriptional regulatory interactions for Escherichia coli and Saccharomyces cerevisiae. A global comparison using recall versus precision curves hides the topologically distinct nature of the inferred networks and is not informative about the specific subtasks for which each method is most suited. Analysis of the degree distributions and a regulator specific c…
We have performed a statistical analysis of the spatial distribution of operons in the transcriptional regulation network of Escherichia coli. The analysis reveals that operons that regulate each other and operons that are coregulated tend to lie next to each other on the genome. Moreover, these pairs of operons tend to be transcribed in diverging directions. This spatial arrangement of operons allows the upstream regulatory regions to interfere with each other. This affords additional regulatory control, as illustrated by a mean-field analysis of a feed-forward loop. Our results suggest that …
Identification of genes that initiate cell anomalies and cause cancer in humans is among the important fields in the oncology researches. The mutation and development of anomalies in these genes are then transferred to other genes in the cell and therefore disrupt the normal functionality of the cell. These genes are known as cancer driver genes (CDGs). Various methods have been proposed for predicting CDGs, most of which based on genomic data and based on computational methods. Therefore, some researchers have developed novel bioinformatics approaches. In this study, we propose an algorithm, …
We introduce a minimal model description for the dynamics of transcriptional regulatory networks. It is studied within a mean-field approximation, i.e., by deterministic ode's representing the reaction kinetics, and by stochastic simulations employing the Gillespie algorithm. We elucidate the different results both approaches can deliver, depending on the network under study, and in particular depending on the level of detail retained in the respective description. Two examples are addressed in detail: the repressilator, a transcriptional clock based on a three-gene network realized experiment…
In this work, we describe a computational framework for the genome-wide identification and characterization of mixed transcriptional/post-transcriptional regulatory circuits in humans. We concentrated in particular on feed-forward loops (FFL), in which a master transcription factor regulates a microRNA, and together with it, a set of joint target protein coding genes. The circuits were assembled with a two step procedure. We first constructed separately the transcriptional and post-transcriptional components of the human regulatory network by looking for conserved over-represented motifs in hu…
The promise of discovering a functional blueprint of a cellular system from large-scale and high-throughput sequence and experimental data is predicated on the belief that the same top-down investigative approach that proved successful in other biological problems (e.g. DNA sequencing) will be as effective when it comes to inferring more complex intracellular processes. The results in this paper address this fundamental issue in the specific context of transcription regulatory networks. Although simple recurring regulatory motifs have been identified in the past, due to the size and complexity…
Microsoft Research（微软研究院）；Massachusetts Institute of Technology（麻省理工学院）；University of California Irvine（加州大学尔湾分校）；University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；Morgridge Institute for Research（莫格里奇研究所）
Gene expression is a readily-observed quantification of transcriptional activity and cellular state that enables the recovery of the relationships between regulators and their target genes. Reconstructing transcriptional regulatory networks from gene expression data is a problem that has attracted much attention, but previous work often makes the simplifying (but unrealistic) assumption that regulator activity is represented by mRNA levels. We use a latent tree graphical model to analyze gene expression without relying on transcription factor expression as a proxy for regulator activity. The l…
Identity, response to external stimuli, and spatial architecture of a living system are central topics of molecular biology. Presently, they are largely seen as a result of the interplay between a gene repertoire and the regulatory machinery of the cell. At the transcriptional level, the cis-regulatory regions establish sets of interdependencies between transcription factors and genes, including other transcription factors. These ``transcription networks'' are too large to be approached globally with a detailed dynamical model. In this paper, we describe an approach to this problem that focuse…
A scalable gene network model of regulatory dynamics in single cells
Mila, the Quebec AI Institute（米拉魁北克人工智能研究所）；Université de Montréal（蒙特利尔大学）；Institute of Computational Biology, Helmholtz Munich（亥姆霍兹慕尼黑计算生物学研究所）；Technical University of Munich（慕尼黑工业大学）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；TUM School of Life Sciences Weihenstephan, Technical University of Munich（慕尼黑工业大学魏恩施蒂芬生命科学学院）
Gene regulatory networks present a wide variety of dynamical responses to intrinsic and extrinsic perturbations. Arguably, one of the most important of such coordinated responses is the one of amplification cascades, in which activation of a few key-responsive transcription factors (termed master regulators, MRs) lead to a large series of transcriptional activation events. This is so since master regulators are transcription factors controlling the expression of other transcription factor molecules and so on. MRs hold a central position related to transcriptional dynamics and control of gene r…
We present a general methodology in order to build mathematical models of genetic regulatory networks. This approach is based on the mass action law and on the Jacob and Monod operon model. The mathematical models are built symbolically by the \emph{Mathematica} software package \emph{GeneticNetworks}. This package accepts as input the interaction graphs of the transcriptional activators and repressors and, as output, gives the mathematical model in the form of a system of ordinary differential equations. All the relevant biological parameters are chosen automatically by the software. Within t…
A novel information-theoretic method for reconstruction of interaction networks is introduced. We prove that the method is exact for some class of networks. Performance tests on large synthetic transcriptional regulatory networks produce very encouraging results.
Increased biological complexity is generally associated with the addition of new genetic information, which must be integrated into the existing regulatory network that operates within the cell. General arguments on network control, as well as several recent genomic observations, indicate that regulatory gene number grows disproportionally fast with increasing genome size. We present two models for the growth of regulatory networks. Both predict that the number of transcriptional regulators will scale quadratically with total gene number. This appears to be in good quantitative agreement with …
MERLIN-SUITE: Probabilistic modular GRN inference from multi-omics data integrating regulatory priors and transcription factor activity
Wisconsin Institute for Discovery, University of Wisconsin-Madison（威斯康星发现研究所，威斯康星大学麦迪逊分校）；Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison（威斯康星大学麦迪逊分校生物统计与医学信息学系）
"Module networks" are a framework to learn gene regulatory networks from expression data using a probabilistic model in which coregulated genes share the same parameters and conditional distributions. We present a method to infer ensembles of such networks and an averaging procedure to extract the statistically most significant modules and their regulators. We show that the inferred probabilistic models extend beyond the data set used to learn the models.
The intrinsic stochasticity of gene expression is usually mitigated in higher eukaryotes by post-transcriptional regulation channels that stabilise the output layer, most notably protein levels. The discovery of small non-coding RNAs (miRNAs) in specific motifs of the genetic regulatory network has led to identifying noise buffering as the possible key function they exert in regulation. Recent in vitro} and in silico studies have corroborated this hypothesis. It is however also known that miRNA-mediated noise reduction is hampered by transcriptional bursting in simple topologies. Here, using s…
Genetically encoded regulatory circuits control biological function. A major focus of systems biology is to understand these circuits by establishing the relationship between specific structures and functions. Of special interest are multifunctional circuits that are capable of performing distinct behaviors without changing their topology. A particularly simple example of such a system is the AC-DC circuit. Found in multiple regulatory processes, this circuit consists of three genes connected in a combination of a toggle switch and a repressilator. Using dynamical system theory we analyze the …
Recently, there has been a lot of effort in understanding sRNA mediated regulation of gene expression and how this mode of regulation differs from transcriptional regulation.In E.coli, in the presence of oxidative stress, the synthesis of sigma^s is regulated through an interesting mechanism involving both transcriptional and sRNA-mediated translational regulation. The key regulatory factors involved in transcriptional and translational regulation are ArcA and ArcB proteins and ArcZ sRNA, respectively. Phosphorylated ArcA, in a feedforward mechanism, represses the transcriptions sigma^s and Ar…
The precision of biochemical signaling is limited by randomness in the diffusive arrival of molecules at their targets. For proteins binding to the specific sites on the DNA and regulating transcription, the ability of the proteins to diffuse in one dimension by sliding along the length of the DNA, in addition to their diffusion in bulk solution, would seem to generate a larger target for DNA binding, consequently reducing the noise in the occupancy of the regulatory site. Here we show that this effect is largely cancelled by the enhanced temporal correlations in one dimensional diffusion. Wit…
Gene regulatory networks (GRNs) control cellular function and decision making during tissue development and homeostasis. Mathematical tools based on dynamical systems theory are often used to model these networks, but the size and complexity of these models mean that their behaviour is not always intuitive and the underlying mechanisms can be difficult to decipher. For this reason, methods that simplify and aid exploration of complex networks are necessary. To this end we develop a broadly applicable form of the Zwanzig-Mori projection. By first converting a thermodynamic state ensemble model …
Despite the significant progress made in recent years, the computation of the complete set of elementary flux modes of large or even genome-scale metabolic networks is still impossible. We introduce a novel approach to speed up the calculation of elementary flux modes by including transcriptional regulatory information into the analysis of metabolic network. Taking into account gene regulation dramatically reduces the solution space and allows the presented algorithm to constantly eliminate biologically infeasible modes at an early stage of the computation procedure. Thereby, the computational…
Mixed feedback loops combining transcriptional and post-transcriptional regulations are common in cellular regulatory networks. They consist of two genes, encoding a transcription factor and a small non-coding RNA (sRNA), which mutually regulate each other's expression. We present a theoretical and numerical study of coherent mixed feedback loops of this type, in which both regulations are negative. Under suitable conditions, these feedback loops are expected to exhibit bistability, namely two stable states, one dominated by the transcriptional repressor and the other dominated by the sRNA. We…
We investigate the ability of algorithms developed for reverse engineering of transcriptional regulatory networks to reconstruct metabolic networks from high-throughput metabolite profiling data. For this, we generate synthetic metabolic profiles for benchmarking purposes based on a well-established model for red blood cell metabolism. A variety of data sets is generated, accounting for different properties of real metabolic networks, such as experimental noise, metabolite correlations, and temporal dynamics. These data sets are made available online. We apply ARACNE, a mainstream transcriptio…
Cancer disease occurs because of a disorder in the cellular regulatory mechanism, Which causes cellular malformation. The genes that start the malformation are called Cancer driver genes (CDGs) . Numerous computational methods have been introduced to identify cancer driver genes that use the concept of mutation.Regarding abnormalities spread in human cell and tumor development, CDGs are likely to be the potential types of gene with high influence in the network. This increases the importance of influence diffusion concept for the identification of CDGs.recently developed a method based on infl…
To regulate a particular gene, a transcription factor (TF) needs to bind a specific genome location. How is this genome address specified amid the presence of ~10^6-10^9 decoy sites? Our analysis of 319 known TF binding motifs clearly demonstrates that prokaryotes and eukaryotes use strikingly different strategies to target TFs to specific genome locations; eukaryotic TFs exhibit widespread nonfunctional binding and require clustering of sites in regulatory regions for specificity.
Over the past few years, microRNAs (miRNAs) have emerged as a new prominent class of gene regulatory factors that negatively regulate expression of approximately one-third of the genes in animal genomes at post-transcriptional level. However, it is still unclear why some genes are regulated by miRNAs but others are not, i.e. what principles govern miRNA regulation in animal genomes. In this study, we systematically analyzed the relationship between transcription factors (TFs) and miRNAs in gene regulation. We found that the genes with more TF-binding sites have a higher probability of being ta…
Even under constant external conditions, the expression levels of genes fluctuate. Much emphasis has been placed on the components of this noise that are due to randomness in transcription and translation; here we analyze the role of noise associated with the inputs to transcriptional regulation, the random arrival and binding of transcription factors to their target sites along the genome. This noise sets a fundamental physical limit to the reliability of genetic control, and has clear signatures, but we show that these are easily obscured by experimental limitations and even by conventional …
Artificial neurons built on synthetic gene networks have potential applications ranging from complex cellular decision-making to bioreactor regulation. Furthermore, due to the high information throughput of natural systems, it provides an interesting candidate for biologically-based supercomputing and analog simulations of traditionally intractable problems. In this paper, we propose an architecture for constructing multicellular neural networks and programmable nonlinear systems. We design an artificial neuron based on gene regulatory networks and optimize its dynamics for modularity. Using g…
The transcription factors, such as activators and repressors, can interact with the promoter of gene either in a competitive or non-competitive way. In this paper, we construct a stochastic model with non-competitive transcriptional regulatory architecture and develop an analytical theory that re-establishes the experimental results with an improved data fitting. The analytical expressions in the theory allow us to study the nature of the system corresponding to any of its parameters, and hence enable us to find out the factors that govern the regulation of gene expression for that architectur…
The formation of DNA loops by proteins and protein complexes that bind at distal DNA sites plays a central role in many cellular processes, such as transcription, recombination, and replication. Here we review the basic thermodynamic concepts underlying the assembly of macromolecular complexes on looped DNA and the effects that this process has in the properties of gene regulation. Beyond the traditional view of DNA looping as a mechanism to increase the affinity of regulatory molecules for their cognate sites, recent developments indicate that DNA looping can also lead to the suppression of c…
In early development, regulation of transcription results in precisely positioned and highly reproducible expression patterns that specify cellular identities. How transcription, a fundamentally noisy molecular process, is regulated to achieve reliable embryonic patterning remains unclear. In particular, it is unknown how gene-specific regulation mechanisms affect kinetic rates of transcription, and whether there are common, global features that govern these rates across a genetic network. Here, we measure nascent transcriptional activity in the gap gene network of early Drosophila embryos and…
HyperNetWalk: A Unified Framework for Personalized and Cohort-Level Cancer Driver Gene Identification via Reverse Inference on Layered Signaling-Regulatory Network
State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院数学科学学院）；School of Mathematical Sciences, University of Chinese Academy of Sciences（中国科学院大学数学科学学院）；School of Mathematics, Shandong University（山东大学数学学院）
These are notes for a set of 7 two-hour lectures given at the 2010 Summer School on Quantitative Evolutionary and Comparative Genomics at OIST, Okinawa, Japan. The emphasis is on understanding how biological systems process information. We take a physicist's approach of looking for simple phenomenological descriptions that can address the questions of biological function without necessarily modeling all (mostly unknown) microscopic details; the example that is developed throughout the notes is transcriptional regulation in genetic regulatory networks. We present tools from information theory a…
Background: Elucidating gene regulatory networks is crucial for understanding normal cell physiology and complex pathologic phenotypes. Existing computational methods for the genome-wide ``reverse engineering'' of such networks have been successful only for lower eukaryotes with simple genomes. Here we present ARACNE, a novel algorithm, using microarray expression profiles, specifically designed to scale up to the complexity of regulatory networks in mammalian cells, yet general enough to address a wider range of network deconvolution problems. This method uses an information theoretic approac…
The well-known issue of reconstructing regulatory networks from gene expression measurements has been somewhat disrupted by the emergence and rapid development of single-cell data. Indeed, the traditional way of seeing a gene regulatory network as a deterministic system affected by small noise is being challenged by the highly stochastic, bursty nature of gene expression revealed at single-cell level. In previous work, we described a promising strategy in which network inference is seen as a calibration procedure for a mechanistic model driven by transcriptional bursting: this model inherently…
Diverse biological networks exhibit universal features distinguished from those of random networks, calling much attention to their origins and implications. Here we propose a minimal evolution model of Boolean regulatory networks, which evolve by selectively rewiring links towards enhancing adaptability to a changing environment and stability against dynamical perturbations. We find that sparse and heterogeneous connectivity patterns emerge, which show qualitative agreement with real transcriptional regulatory networks and metabolic networks. The characteristic scaling behavior of stability r…
Recently, several studies have investigated the transcription process associated to specific genetic regulatory networks. In this work, we present a stochastic approach for analyzing the dynamics and effect of negative feedback loops (FBL) on the transcriptional noise. First, our analysis allows us to identify a bimodal activity depending of the strength of self-repression coupling D. In the strong coupling region D>>1, the variance of the transcriptional noise is found to be reduced a 28 % more than described earlier. Secondly, the contribution of the noise effect to the abundance of regulati…
A feed-forward loop (FFL) is a common gene-regulatory motif in which usually the upstream regulator is a protein, a transcription factor, that regulates the expression of the target protein in two parallel pathways. Here, we study a distinct sRNA-driven FFL (sFFL) discovered recently in Salmonella enterica. Unlike previously studied transcriptional FFLs (tFFL) and sRNA-mediated FFLs (smFFL), here the upstream regulator is an sRNA that activates the target protein and its transcriptional activator. Such sFFL has not been subjected to rigorous analysis. We, therefore, set out to understand two a…
We typically think of cells as responding to external signals independently by regulating their gene expression levels, yet they often locally exchange information and coordinate. Can such spatial coupling be of benefit for conveying signals subject to gene regulatory noise? Here we extend our information-theoretic framework for gene regulation to spatially extended systems. As an example, we consider a lattice of nuclei responding to a concentration field of a transcriptional regulator (the "input") by expressing a single diffusible target gene. When input concentrations are low, diffusive co…
We describe an approach to model genetic regulatory networks at the level of promotion-inhibition circuitry through a class of stochastic spin models that includes spatial and temporal density fluctuations in a natural way. The formalism can be viewed as an agent-based model formalism with agent behavior ruled by a classical spin-like pseudo-Hamiltonian playing the role of a local, individual objective function. A particular but otherwise generally applicable choice for the microscopic transition rates of the models also makes them of independent interest. To illustrate the formalism, we inves…
The study of gene regulation and expression is often discussed in quantitative terms. In particular, the expression of genes is regularly characterized with respect to how much, how fast, when and where. Whether discussing the level of gene expression in a bacterium or its precise location within a developing embryo, the natural language for these experiments is that of numbers. Such quantitative data demands quantitative models. We review a class of models ("thermodynamic models") which exploit statistical mechanics to compute the probability that RNA polymerase is at the appropriate promoter…
Genome-scale metabolic models have become a fundamental tool for examining metabolic principles. However, metabolism is not solely characterized by the underlying biochemical reactions and catalyzing enzymes, but also affected by regulatory events. Since the pioneering work of Covert and co-workers as well as Shlomi and co-workers it is debated, how regulation and metabolism synergistically characterize a coherent cellular state. The first approaches started from metabolic models which were extended by the regulation of the encoding genes of the catalyzing enzymes. By now, bioinformatics datab…
The study of transcription remains one of the centerpieces of modern biology with implications in settings from development to metabolism to evolution to disease. Precision measurements using a host of different techniques including fluorescence and sequencing readouts have raised the bar for what it means to quantitatively understand transcriptional regulation. In particular our understanding of the simplest genetic circuit is sufficiently refined both experimentally and theoretically that it has become possible to carefully discriminate between different conceptual pictures of how this regul…
The genetic regulatory network (GRN) plays a key role in controlling the response of the cell to changes in the environment. Although the structure of GRNs has been the subject of many studies, their large scale structure in the light of feedbacks from the metabolic network (MN) has received relatively little attention. Here we study the causal structure of the GRNs, namely the chain of influence of one component on the other, taking into account feedback from the MN. First we consider the GRNs of E. coli and B. subtilis without feedback from MN and illustrate their causal structure. Next we a…
