Design of experiments and biochemical network inference
Reinhard Laubenbacher, Brandilyn Stigler
备注：
To appear in "Algebraic and geometric methods in statistics," P. Gibilisco, E. Riccomagno, M.-P. Rogantin, H. P. Wynn, eds., Cambridge University Press, 2008
发表信息：
Algebraic and Geometric Methods in Statistics. Eds: Gibilisco, Riccomagno, Rogantin, Wynn, Cambridge University Press (2008)
Design of experiments is a branch of statistics that aims to identify efficient procedures for planning experiments in order to optimize knowledge discovery. Network inference is a subfield of systems biology devoted to the identification of biochemical networks from experimental data. Common to both areas of research is their focus on the maximization of information gathered from experimentation. The goal of this paper is to establish a connection between these two areas coming from the common use of polynomial models and techniques from computational algebra.
Stochasticity is a key characteristic of intracellular processes such as gene regulation and chemical signalling. Therefore, characterising stochastic effects in biochemical systems is essential to understand the complex dynamics of living things. Mathematical idealisations of biochemically reacting systems must be able to capture stochastic phenomena. While robust theory exists to describe such stochastic models, the computational challenges in exploring these models can be a significant burden in practice since realistic models are analytically intractable. Determining the expected behaviour…
Probabilistic inference provides a language for describing how organisms may learn from and adapt to their environment. The computations needed to implement probabilistic inference often require specific representations, akin to having the suitable data structures for implementing certain algorithms in computer programming. Yet it is unclear how such representations can be instantiated in the stochastic, parallel-running biochemical machinery found in cells (such as single-celled organisms). Here, we show how representations for supporting inference in Markov models can be embodied in cellular…
Motivation: An essential step in developing computational tools for the inference, optimization, and simulation of biochemical reaction networks is gauging tool performance against earlier efforts using an appropriate set of benchmarks. General strategies for the assembly of benchmark models include collection from the literature, creation via subnetwork extraction and de novo generation. However, with respect to biochemical reaction networks, these approaches and their associated tools are either poorly suited to generate models that reflect the wide range of properties found in natural bioch…
By developing and leveraging an explicit molecular realisation of a measurement-and-feedback-powered Szilard engine, we investigate the extraction of work from complex environments by minimal machines with finite capacity for memory and decision-making. Living systems perform inference to exploit complex structure, or correlations, in their environment, but the physical limits and underlying cost/benefit trade-offs involved in doing so remain unclear. To probe these questions, we consider a minimal model for a structured environment - a correlated sequence of molecules - and explore mechanisms…
Network inference approaches are widely used to shed light on regulatory interplay between molecular players such as genes and proteins. Biochemical processes underlying networks of interest (e.g. gene regulatory or protein signalling networks) are generally nonlinear. In many settings, knowledge is available concerning relevant chemical kinetics. However, existing network inference methods for continuous, steady-state data are typically rooted in statistical formulations, which do not exploit chemical kinetics to guide inference. Herein, we present an approach to network inference for steady-…
For many stochastic models of interest in systems biology, such as those describing biochemical reaction networks, exact quantification of parameter uncertainty through statistical inference is intractable. Likelihood-free computational inference techniques enable parameter inference when the likelihood function for the model is intractable but the generation of many sample paths is feasible through stochastic simulation of the forward problem. The most common likelihood-free method in systems biology is approximate Bayesian computation that accepts parameters that result in low discrepancy be…
Stochastic fluctuations of molecule numbers are ubiquitous in biological systems. Important examples include gene expression and enzymatic processes in living cells. Such systems are typically modelled as chemical reaction networks whose dynamics are governed by the Chemical Master Equation. Despite its simple structure, no analytic solutions to the Chemical Master Equation are known for most systems. Moreover, stochastic simulations are computationally expensive, making systematic analysis and statistical inference a challenging task. Consequently, significant effort has been spent in recent …
We present herein an extension of an algebraic statistical method for inferring biochemical reaction networks from experimental data, proposed recently in [3]. This extension allows us to analyze reaction networks that are not necessarily full-dimensional, i.e., the dimension of their stoichiometric space is smaller than the number of species. Specifically, we propose to augment the original algebraic-statistical algorithm for network inference with a preprocessing step that identifies the subspace spanned by the correct reaction vectors, within the space spanned by the species. This dimension…
The first realization of a designed, rather than natural, biochemical filter process is reported and analyzed as a promising network component for increasing the complexity of biomolecular logic systems. Key challenge in biochemical logic research has been achieving scalability for complex network designs. Various logic gates have been realized, but a "toolbox" of analog elements for interconnectivity and signal processing has remained elusive. Filters are important as network elements that allow control of noise in signal transmission and conversion. We report a versatile biochemical filterin…
According to the chemical reaction network theory, the topology of a certain class of chemical reaction networks, regardless of the kinetic details, sets a limit on the dynamical properties that a particular network can potentially admit; the structure of a network predetermines the dynamic capacity of the network. We note that stochastic fluctuations can possibly confer a new dynamical capability to a network. Thus, it is of tremendous value to understand and be able to control the landscape of stochastic dynamical behaviors of a biochemical reaction network as a function of network architect…
Signal duration (e.g. the time scales over which an active signaling intermediate persists) is a key regulator of biological decisions in myriad contexts such as cell growth, proliferation, and developmental lineage commitments. Accompanying differences in signal duration are numerous downstream biological processes that require multiple steps of biochemical regulation. Here, we present an analysis that investigates how simple biochemical motifs that involve multiple stages of regulation can be constructed to differentially process signals that persist at different time scales. We compute the …
Retroactivity arises when the coupling of a molecular network $\mathcal{U}$ to a downstream network $\mathcal{D}$ results in signal propagation back from $\mathcal{D}$ to $\mathcal{U}$. The phenomenon represents a breakdown in modularity of biochemical circuits and hampers the rational design of complex functional networks. Considering simple models of signal-transduction architectures, we demonstrate the strong dependence of retroactivity on the properties of the upstream system, and explore the cost and efficacy of fuel-consuming insulating motifs that can mitigate retroactive effects. We fi…
Synthetic biology is an interdisciplinary field aiming to design biochemical systems with desired behaviors. To this end, molecular controllers have been developed which, when embedded into a pre-existing ambient biochemical network, control the dynamics of the underlying target molecular species. When integrated into smaller compartments, such as biological cells in vivo, or vesicles in vitro, controllers have to be calibrated to factor in the intrinsic noise. In this context, molecular controllers put forward in the literature have focused on manipulating the mean (first moment), and reducin…
Living systems operate in a critical dynamical regime -- between order and chaos -- where they are both resilient to perturbation, and flexible enough to evolve. To characterize such critical dynamics, the established 'structural theory' of criticality uses automata network connectivity and node bias (to be on or off) as tuning parameters. This parsimony in the number of parameters needed sometimes leads to uncertain predictions about the dynamical regime of both random and systems biology models of biochemical regulation. We derive a more accurate theory of criticality by accounting for canal…
A central goal of synthetic biology is to design sophisticated synthetic cellular circuits that can perform complex computations and information processing tasks in response to specific inputs. The tremendous advances in our ability to understand and manipulate cellular information processing networks raises several fundamental physics questions: How do the molecular components of cellular circuits exploit energy consumption to improve information processing? Can one utilize ideas from thermodynamics to improve the design of synthetic cellular circuits and modules? Here, we summarize recent th…
Biochemical molecules interact through modification and binding reactions, giving raise to a combinatorial number of possible biochemical species. The time-dependent evolution of concentrations of the species is commonly described by a system of coupled ordinary differential equations (ODEs). However, the analysis of such high-dimensional, non-linear system of equations is often computationally expensive and even prohibitive in practice. The major challenge towards reducing such models is providing the guarantees as to how the solution of the reduced model relates to that of the original model…
A mathematical framework to study organising principles in graphical representations of biochemical processes
University of Rostock（罗斯托克大学）；Christian-Albrechts-University（克里斯蒂安-阿尔布莱希特大学）；Leibniz-Institute for Food Systems Biology（莱布尼茨食品系统生物研究所）；Technical University of Munich（慕尼黑工业大学）；Stellenbosch Institute for Advanced Study（斯泰伦博斯高等研究院）
Synthetic biology is a growing interdisciplinary field, with far-reaching applications, which aims to design biochemical systems that behave in a desired manner. With the advancement of strand-displacement DNA computing, a large class of abstract biochemical networks may be physically realized using DNA molecules. Methods for systematic design of the abstract systems with prescribed behaviors have been predominantly developed at the (less-detailed) deterministic level. However, stochastic effects, neglected at the deterministic level, are increasingly found to play an important role in biochem…
Comprehensive simulations of the entire biochemistry of cells have great potential to help physicians treat disease and help engineers design biological machines. But such simulations must model networks of millions of molecular species and reactions. The Stochastic Simulation Algorithm (SSA) is widely used for simulating biochemistry, especially systems with species populations small enough that discreteness and stochasticity play important roles. However, existing serial SSA methods are prohibitively slow for comprehensive networks, and existing parallel SSA methods, which use periodic synch…
Robustness of biochemical systems has become one of the central questions in Systems Biology, although it is notoriously difficult to formally capture its multifaceted nature. Maintenance of normal system function depends not only on the stoichiometry of the underlying interrelated components, but also on a multitude of kinetic parameters. For given parameter values, recent findings have aimed at characterizing the property of the system components to exhibit same concentrations in the resulting steady states, termed absolute concentration robustness (ACR). However, the existing method for det…
California Institute of Technology（加州理工学院）；Imperial College London（帝国理工学院）
Can a micron sized sack of interacting molecules understand, and adapt to a constantly-fluctuating environment? Cellular life provides an existence proof in the affirmative, but the principles that allow for life's existence are far from being proven. One challenge in engineering and understanding biochemical computation is the intrinsic noise due to chemical fluctuations. In this paper, we draw insights from machine learning theory, chemical reaction network theory, and statistical physics to show that the broad and biologically relevant class of detailed balanced chemical reaction networks i…
Characterizing interactions between drugs is important to avoid potentially harmful combinations, to reduce off-target effects of treatments and to fight antibiotic resistant pathogens, among others. Here we present a network inference algorithm to predict uncharacterized drug-drug interactions. Our algorithm takes, as its only input, sets of previously reported interactions, and does not require any pharmacological or biochemical information about the drugs, their targets or their mechanisms of action. Because the models we use are abstract, our approach can deal with adverse interactions, sy…
The Turing patterning mechanism is believed to underly the formation of repetitive structures in development, such as zebrafish stripes and mammalian digits, but it has proved difficult to isolate the specific biochemical species responsible for pattern formation. Meanwhile, synthetic biologists have designed Turing systems for implementation in cell colonies, but none have yet led to visible patterns in the laboratory. In both cases, the relationship between underlying chemistry and emergent biology remains mysterious. To help resolve the mystery, this article asks the question: what kinds of…
Cellular signaling involves the transmission of environmental information through cascades of stochastic biochemical reactions, inevitably introducing noise that compromises signal fidelity. Each stage of the cascade often takes the form of a kinase-phosphatase push-pull network, a basic unit of signaling pathways whose malfunction is linked with a host of cancers. We show this ubiquitous enzymatic network motif effectively behaves as a Wiener-Kolmogorov (WK) optimal noise filter. Using concepts from umbral calculus, we generalize the linear WK theory, originally introduced in the context of c…
Chemical reactions occur in energy, environmental, biological, and many other natural systems, and the inference of the reaction networks is essential to understand and design the chemical processes in engineering and life sciences. Yet, revealing the reaction pathways for complex systems and processes is still challenging due to the lack of knowledge of the involved species and reactions. Here, we present a neural network approach that autonomously discovers reaction pathways from the time-resolved species concentration data. The proposed Chemical Reaction Neural Network (CRNN), by design, sa…
University of Wisconsin–Madison（威斯康星大学麦迪逊分校）；Morgridge Institute for Research（莫格里奇研究所）
Cells regulate themselves via dizzyingly complex biochemical processes called signaling pathways. These are usually depicted as a network, where nodes represent proteins and edges indicate their influence on each other. In order to understand diseases and therapies at the cellular level, it is crucial to have an accurate understanding of the signaling pathways at work. Since signaling pathways can be modified by disease, the ability to infer signaling pathways from condition- or patient-specific data is highly valuable. A variety of techniques exist for inferring signaling pathways. We build o…
