arXiv 1306.27562013-06cond-mat.stat-mech

Information Thermodynamics on Causal Networks

Sosuke Ito, Takahiro Sagawa

备注：: 11pages, 8 figures
发表信息：: Phys. Rev. Lett. Lett. 111, 180603 (2013)
DOI：: 10.1103/PhysRevLett.111.180603

英文摘要：

We study nonequilibrium thermodynamics of complex information flows induced by interactions between multiple fluctuating systems. Characterizing nonequilibrium dynamics by causal networks (i.e., Bayesian networks), we obtain novel generalizations of the second law of thermodynamics and the fluctuation theorem, which include an informational quantity characterized by the topology of the causal network. Our result implies that the entropy production in a single system in the presence of multiple other systems is bounded by the information flow between these systems. We demonstrate our general result by a simple model of biochemical adaptation.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Relating the thermodynamic arrow of time to the causal arrow

Consider a Hamiltonian system that consists of a slow subsystem S and a fast subsystem F. The autonomous dynamics of S is driven by an effective Hamiltonian, but its thermodynamics is unexpected. We show that a well-defined thermodynamic arrow of time (second law) emerges for S whenever there is a well-defined causal arrow from S to F and the back-action is negligible. This is because the back-action of F on S is described by a non-globally Hamiltonian Born-Oppenheimer term that violates the Liouville theorem, and makes the second law inapplicable to S. If S and F are mixing, under the causal …

2007-08-08cond-mat.stat-mech

Resolution of causal paradoxes arising from opposing thermodynamic arrows of time

It was recently shown \cite{opposite} that systems with opposite thermodynamic arrows of time could have moderate mutual interaction with neither destroying the order of the other. Such interaction includes signaling. Signals, however, may give rise to causal paradoxes, suggesting that "moderate" interaction may be impossible. Using the two-time boundary condition framework, we resolve the paradoxes. In one example, at a macroscopic level, we establish the existence of solutions to the appropriate boundary value problem. This result is extended to a class of microscopic problems. We also produ…

2001-02-01cond-mat.stat-mech

Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer entropy of the backward time series called the backward transfer entropy, and show that the backward transfer entropy quantifies how far it is from dynamics to a hidden Markov model. Furthermore, we discuss physical interpretations of the backward transfer entropy in completely different settings of thermodynamics for information processing and the gambling wi…

2016-09-21cond-mat.stat-mech

Thermodynamics of Quantum Causal Models: An Inclusive, Hamiltonian Approach

Operational quantum stochastic thermodynamics is a recently proposed theory to study the thermodynamics of open systems based on the rigorous notion of a quantum stochastic process or quantum causal model. In there, a stochastic trajectory is defined solely in terms of experimentally accessible measurement results, which serve as the basis to define the corresponding thermodynamic quantities. In contrast to this observer-dependent point of view, a `black box', which evolves unitarily and can simulate a quantum causal model, is constructed here. The quantum thermodynamics of this big isolated s…

2020-02-12cond-mat.stat-mechquant-ph

Algorithmic independence of initial condition and dynamical law in thermodynamics and causal inference

We postulate a principle stating that the initial condition of a physical system is typically algorithmically independent of the dynamical law. We argue that this links thermodynamics and causal inference. On the one hand, it entails behaviour that is similar to the usual arrow of time. On the other hand, it motivates a statistical asymmetry between cause and effect that has recently postulated in the field of causal inference, namely, that the probability distribution P(cause) contains no information about the conditional distribution P(effect|cause) and vice versa, while P(effect) may contai…

2015-12-07cond-mat.stat-mechmath.STquant-ph

On causally asymmetric versions of Occam's Razor and their relation to thermodynamics

In real-life statistical data, it seems that conditional probabilities for the effect given their causes tend to be less complex and smoother than conditionals for causes, given their effects. We have recently proposed and tested methods for causal inference in machine learning using a formalization of this principle. Here we try to provide some theoretical justification for causal inference methods based upon such a ``causally asymmetric'' interpretation of Occam's Razor. To this end, we discuss toy models of cause-effect relations from classical and quantum physics as well as computer scienc…

2009-01-30cond-mat.othercond-mat.stat-mechquant-ph

更多相关论文收起更多论文

Thermodynamic Depth of Causal States: When Paddling around in Occam's Pool Shallowness Is a Virtue

Thermodynamic depth is an appealing but flawed structural complexity measure. It depends on a set of macroscopic states for a system, but neither its original introduction by Lloyd and Pagels nor any follow-up work has considered how to select these states. Depth, therefore, is at root arbitrary. Computational mechanics, an alternative approach to structural complexity, provides a definition for a system's minimal, necessary causal states and a procedure for finding them. We show that the rate of increase in thermodynamic depth, or {\it dive}, is the system's reverse-time Shannon entropy rate,…

1998-08-13adap-orgchao-dyncond-mat.stat-mech

Information Accessibility and Cryptic Processes: Linear Combinations of Causal States

We show in detail how to determine the time-reversed representation of a stationary hidden stochastic process from linear combinations of its forward-time $ε$-machine causal states. This also gives a check for the $k$-cryptic expansion recently introduced to explore the temporal range over which internal state information is spread.

2009-06-27cond-mat.stat-mech

Hidden Markov models for stochastic thermodynamics

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to shed light on a recent discussion of phase transitions in the optimized response of an information engine, for which measurement noise serves as a control parameter. The HMM formalism also shows that the value of additional information shows a maximum at intermediate signal-to-noise ratios. Finally, we discuss how systems open to information flow can apparently…

2015-04-29cond-mat.stat-mech

Stochastic thermodynamic interpretation of information geometry

In recent years, the unified theory of information and thermodynamics has been intensively discussed in the context of stochastic thermodynamics. The unified theory reveals that information theory would be useful to understand non-stationary dynamics of systems far from equilibrium. In this letter, we have found a new link between stochastic thermodynamics and information theory well known as information geometry. By applying this link, an information geometric inequality can be interpreted as a thermodynamic uncertainty relationship between speed and thermodynamic cost. We have numerically ap…

2018-05-07cond-mat.stat-mech

通过迭代量子信息转移实验探究熵减

Experimentally probing entropy reduction via iterative quantum information transfer

本文在金刚石硅空位中心自旋量子比特上实验验证了迭代测量与反馈下的量子热力学定律，并证明非马尔可夫反馈比马尔可夫反馈具有热力学优势。

2025-08-28cond-mat.stat-mechquant-ph

A unified theory of information transfer and causal relation

Tsinghua University（清华大学）；Huawei Technologies Co. Ltd.（华为技术有限公司）；Université de Paris（巴黎大学）

Information transfer between coupled stochastic dynamics, measured by transfer entropy and information flow, is suggested as a physical process underlying the causal relation of systems. While information transfer analysis has booming applications in both science and engineering fields, critical mysteries about its foundations remain unsolved. Fundamental yet difficult questions concern how information transfer and causal relation originate, what they depend on, how they differ from each other, and if they are created by a unified and general quantity. These questions essentially determine the…

2022-04-21cond-mat.stat-mechcs.ITcs.LG

信息熵与热力学熵

Information vs Thermodynamic Entropy

该研究对比香农信息与热力学熵，指出二者存在差异，且香农信息不受热力学第二定律约束。

2024-07-12cond-mat.stat-mechphysics.data-anquant-ph

Optimal Causal Inference: Estimating Stored Information and Approximating Causal Architecture

University of Hawaii at Manoa（马诺阿夏威夷大学）；University of California at Davis（加州大学戴维斯分校）；Santa Fe Institute（圣塔菲研究所）

We introduce an approach to inferring the causal architecture of stochastic dynamical systems that extends rate distortion theory to use causal shielding---a natural principle of learning. We study two distinct cases of causal inference: optimal causal filtering and optimal causal estimation. Filtering corresponds to the ideal case in which the probability distribution of measurement sequences is known, giving a principled method to approximate a system's causal structure at a desired level of representation. We show that, in the limit in which a model complexity constraint is relaxed, filteri…

2010-08-19cond-mat.stat-mechcs.ITcs.LG

Informational and Causal Architecture of Continuous-time Renewal and Hidden Semi-Markov Processes

We introduce the minimal maximally predictive models (ε-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either hybrid discrete-continuous or continuous random variables and causal-state transitions are described by partial differential equations. Closed-form expressions are given for statistical complexities, excess entropies, and differential information anatomy rates. We present a complete analysis of the ε-machines of continuous-time renewal processes and, then, extend this to processes generated by unifilar hidden semi-Markov models and semi-M…

2016-11-03cond-mat.stat-mechcs.ITmath.IT