Information Thermodynamics: Maxwell's Demon in Nonequilibrium Dynamics
Takahiro Sagawa, Masahito Ueda
备注：
This article will be published in: R. Klages, W. Just, C. Jarzynski (Eds.), "Nonequilibrium Statistical Physics of Small Systems: Fluctuation Relations and Beyond" (Wiley-VCH, Weinheim, 2012; ISBN 978-3-527-41094-1)
We review theory of information thermodynamics which incorporates effects of measurement and feedback into nonequilibrium thermodynamics of a small system, and discuss how the second law of thermodynamics should be extended for such situations. We address the issue of the maximum work that can be extracted from the system in the presence of a feedback controller (Maxwell's demon) and provide a few illustrative examples. We also review a recent experiment that realized a Maxwell's demon based on a feedback-controlled ratchet.
Dissipative effects in electromagnetism on macroscopic scales are examined by coarse graining the microscopic Maxwell equations with respect to time. We illustrate a procedure to derive the dissipative effects on the macroscopic scale by using a Green-Kubo type expression in terms of the microscopic fluctuations and the correlations between them. The resulting macroscopic Maxwell equations are formulated within the General Equation for the Non-Equilibrium Reversible-Irreversible Coupling (GENERIC) framework, accounting also for inhomogeneous temperature.
We investigate stationary nonequilibrium states of systems of particles moving according to Hamiltonian dynamics with specified potentials. The systems are driven away from equilibrium by Maxwell demon ``reflection rules'' at the walls. These deterministic rules conserve energy but not phase space volume, and the resulting global dynamics may or may not be time reversible (or even invertible). Using rules designed to simulate moving walls we can obtain a stationary shear flow. Assuming that for macroscopic systems this flow satisfies the Navier-Stokes equations, we compare the hydrodynamic ent…
We establish a novel generalization of the fluctuation theorem for partially-masked nonequilibrium dynamics. We introduce a partial entropy production with a subset of all possible transitions, and show that the partial entropy production satisfies the integral fluctuation theorem.Our result reveals the fundamental properties of a broad class of autonomous nanomachines as well as non-autonomous ones. In particular, our result gives a unified fluctuation theorem for both autonomous and non-autonomous Maxwell's demons, where mutual information plays a crucial role. Furthermore, we derive a novel…
Maxwell's demons work by rectifying thermal fluctuations. They are not expected to function at macroscopic scales where fluctuations become negligible and dynamics become deterministic. We propose an electronic implementation of an autonomous Maxwell's demon that indeed stops working in the regular macroscopic limit as the dynamics becomes deterministic. However, we find that if the power supplied to the demon is scaled up appropriately, the deterministic limit is avoided and the demon continues to work. The price to pay is a decreasing thermodynamic efficiency. Our work suggests that novel st…
The state of a single-species monatomic gas from near-equilibrium to highly nonequilibrium conditions is investigated using analytical and numerical methods. Normal solutions of the Boltzmann equation for Fourier flow (uniform heat flux) and Couette flow (uniform shear stress) are found in terms of the heat-flux and shear-stress Knudsen numbers. Analytical solutions are found for inverse-power-law molecules from hard-sphere through Maxwell at small Knudsen numbers using Chapman-Enskog (CE) theory and for Maxwell molecules at finite Knudsen numbers using a moment-hierarchy (MH) method. Correspo…
We build a double quantum-dot system with Coulomb coupling and aim at studying the connections among the entropy production, free energy, and information flow. By utilizing the concepts in stochastic thermodynamics and graph theory analysis, the Clausius and nonequilibrium free energy inequalities are built to interpret the local second law of thermodynamics for subsystems. A fundamental set of cycle fluxes and affinities is identified to decompose the two inequalities by using Schnakenberg's network theory. The results show that the thermodynamic irreversibility has the energy-related and inf…
In this work, we analyze the nonequilibrium thermodynamics of a class of neural networks known as Restricted Boltzmann Machines (RBMs) in the context of unsupervised learning. We show how the network is described as a discrete Markov process and how the detailed balance condition and the Maxwell-Boltzmann equilibrium distribution are sufficient conditions for a complete thermodynamics description, including nonequilibrium fluctuation theorems. Numerical simulations in a fully trained RBM are performed and the heat exchange fluctuation theorem is verified with excellent agreement to the theory.…
To describe the nonequilibrium states of a system we introduce a new thermodynamic parameter - the lifetime of a system. The statistical distributions which can be obtained out of the mesoscopic description characterizing the behaviour of a system by specifying the stochastic processes are written down. The expressions for the nonequilibrium entropy, temperature and entropy production are obtained, which at small values of fluxes coincide with those derived within the frame of extended irreversible thermodynamics. The expressions generalizing the Maxwell-Cattaneo relations of extended irrevers…
Hydrodynamics, a term apparently introduced by Daniel Bernoulli (1700-1783) to comprise hydrostatic and hydraulics, has a long history with several theoretical approaches. Here, after a descriptive introduction, we present so-called mesoscopic hydro-thermodynamics, which is also referred to as higher-order generalized hydrodynamics, built within the framework of a mechanical-statistical formalism. It consists of a description of the material and heat motion of fluids in terms of the corresponding densities and their associated fluxes of all orders. In this way, movements are characterized in t…
Framing computation as the transformation of metastable memories, we explore its fundamental thermodynamic limits. The true power of information follows from a novel decomposition of nonequilibrium free energy derived here, which provides a rigorous thermodynamic description of coarse-grained memory systems. In the nearly-quasistatic limit, logically irreversible operations can be performed with thermodynamic reversibility. Yet, here we show that beyond the reversible work Landauer's bound requires of computation, dissipation must be incurred both for modular computation and for neglected stat…
We describe a simple and solvable model of a device that -- like the "neat-fingered being" in Maxwell's famous thought experiment -- transfers energy from a cold system to a hot system by rectifying thermal fluctuations. In order to accomplish this task, our device requires a memory register to which it can write information: the increase in the Shannon entropy of the memory compensates the decrease in the thermodynamic entropy arising from the flow of heat against a thermal gradient. We construct the nonequilibrium phase diagram for this device, and find that it can alternatively act as an er…
In the context of a nonequilibrium statistical thermodynamics, based on a nonequilibrium statistical ensemble formalism, a generalized hydrodynamics of fluids under driven flow and shear stress is derived. At the thermodynamic level, the nonequilibrium equations of state are derived, which are coupled to the evolution of the basic variables that describe the hydrodynamic motion in such a system. Generalized diffusion-advection and Maxwell-Cattaneo advection equations are obtained in appropriate limiting situations. This nonlinear higher-order hydrodynamics is applied, in an illustration, to th…
Dynamics of complex systems is often hierarchically organized on different time scales. To understand the physics of such hierarchy, here Brownian motion of a particle moving through a fluctuating medium with slowly varying temperature is studied as an analytically tractable example, and a kinetic theory is formulated for describing the states of the particle. What is peculiar here is that the (inverse) temperature is treated as a dynamical variable. Dynamical hierarchy is introduced in conformity with the adiabatic scheme. Then, a new analytical method is developed to show how the Fokker-Plan…
Nonequilibrium thermodynamics of a general second-order stochastic system is investigated. We prove that at steady state, under inversion of velocities, the condition of time-reversibility over the phase space is equivalent to the antisymmetry of spatial flux and the symmetry of velocity flux. Then we show that the condition of time-reversibility alone could not always guarantee the Maxwell-Boltzmann distribution. Comparing the two conditions together, we found that the frictional force naturally emerges as the unique odd term of the total force at thermodynamic equilibrium, and is followed by…
In this article, we review a general theoretical framework of thermodynamics of information on the basis of Bayesian networks. This framework can describe a broad class of nonequilibrium dynamics of multiple interacting systems with complex information exchanges. For such situations, we discuss a generalization of the second law of thermodynamics including information contents. The key concept here is an informational quantity called the transfer entropy, which describes the directional information transfer in stochastic dynamics. The generalized second law gives the fundamental lower bound of…
We connect the rare fluctuations of an Equilibrium (EQ) process and the typical fluctuations of a nonequilibrium (NE) stationary process. In the framework of large deviation theory, this observation allows us to introduce NE thermodynamic potentials. For continuous-time Markov chains, we identify the relevant pairs of conjugated variables and propose two NE ensembles: one with fixed dynamics and fluctuating time-averaged variables, and another with fixed time-averaged variables, but a fluctuating dynamics. Accordingly, we show that NE processes are equivalent to conditioned EQ processes ensuri…
We analyze the dynamics of a Brownian gas in contact with a heat bath in which large temperature fluctuations occur. There are two distinct time scales present, one describes the decay of the fluctuations in the temperature and the other one is associated with the establishment of local equilibrium. Although the gas has reached local equilibrium, there exist large fluctuations in an intensive parameter (temperature) which break the thermodynamic equilibrium with the heat bath. Thus the decay of the fluctuations in the intensive parameter is larger than the characteristic time for the establish…
A living non-Newtonian matter like the cell cortex and tissues are driven out-of-equilibrium at multiple spatial and temporal scales. The stochastic dynamics of a particle embedded in such a medium are non-Markovian, given by a generalized Langevin equation. Due to the non-Markovian nature of the dynamics, the heat dissipation and the entropy production rate cannot be computed using the standard methods for Markovian processes. In this work, to calculate heat dissipation, we use an effective Markov description of the non-Markovian dynamics, which includes the degrees-of-freedom of the medium. …
Recent advances in experimental techniques allow one to measure and control systems at the level of single molecules and atoms. Here gaining information about fluctuating thermodynamic quantities is crucial for understanding nonequilibrium thermodynamic behavior of small systems. To achieve this aim, stochastic thermodynamics offers a theoretical framework, and nonequilibrium equalities such as Jarzynski equality and fluctuation theorems provide key information about the fluctuating thermodynamic quantities. We review the recent progress in quantum fluctuation theorems, including the studies o…
The present study is based on a recent success of the second-order stochastic fluctuation theory in describing time autocorrelations of equilibrium and nonequilibrium physical systems. In particular, it was shown to yield values of the related deterministic parameters of the Langevin equation for a Couette flow in a microscopic Molecular Dynamics model of a simple fluid. In this paper we find all the remaining constants of the stochastic dynamics, which is then numerically simulated and directly compared with the original physical system. By using these data, we study in detail the accuracy an…
The model of inelastic Maxwell particles (IMP) allows one to derive some exact results which show the strong influence of inelasticity on the nonequilibrium properties of a granular gas. The aim of this work is to propose a simple model kinetic equation that preserves the most relevant properties of the Boltzmann equation (BE) for IMP and reduces to the BGK kinetic model in the elastic limit. In the proposed kinetic model the collision operator is replaced by a relaxation-time term toward a reference Maxwellian distribution plus a term representing the action of a friction force. It contains t…
Maintained by environmental fluxes, biological systems are thermodynamic processes that operate far from equilibrium without detailed-balance dynamics. Yet, they often exhibit well defined nonequilibrium steady states (NESSs). More importantly, critical thermodynamic functionality arises directly from transitions among their NESSs, driven by environmental switching. Here, we identify constraints on excess thermodynamic quantities that ride above the NESS housekeeping background. We do this by extending the Crooks fluctuation theorem to transitions among NESSs, without invoking an unphysical du…
Here we study the operation efficiency of a finite-size finite-response-time Maxwell's demon, who can make future predictions. We compare the heat and mass transport rate of predictive demons to non-predictive ones and find that predictive demons can achieve higher mass and heat transport rates over longer periods of time. We determine how the demon performance varies with response time, future sight, and the density of the gasses on which they operate.
We analyze the static response to perturbations of nonequilibrium steady states that can be modeled as one-dimensional diffusions on the circle. We demonstrate that an arbitrary perturbation can be broken up into a combination of three specific classes of perturbations that can be fruitfully addressed individually. For each class, we derive a simple formula that quantitatively characterizes the response in terms of the strength of nonequilibrium driving valid arbitrarily far from equilibrium.
In this article, we introduce two kinds of Fluctuation Theorems (FT) containing information for autonomous Maxwell's demon-assisted machines. Using Jensen's Inequality, we obtain Landauer's principle formulation of the second law for the whole process of the machine. Finally we make use of our results to analyze a new information device. \pacs{05.70.Ln, 05.40.-a, 89.70.Cf}
In the presence of feedback control by "Maxwell's demon," the second law of thermodynamics and the nonequilibrium equalities such as the Jarzynski equality need to be generalized. In this paper, we derive the generalized Jarzynski equalities for classical Hamiltonian dynamics based on the Liouville's theorem, which is the same approach as the original proof of the Jarzynski equality [Phys. Rev. Lett. 78, 2690 (1997)]. The obtained equalities lead to the generalizations of the second law of thermodynamics for the Hamiltonian systems in the presence of feedback control.
A CMOS-based implementation of an autonomous Maxwell's demon was recently proposed (Phys. Rev. Lett. 129, 120602) to demonstrate that a Maxwell demon can still work at macroscopic scales, provided that its power supply is scaled appropriately. Here, we first provide a full analytical characterization of the non-autonomous version of that model. We then study system-demon information flows within generic autonomous bipartite setups displaying a macroscopic limit. By doing so, we can study the thermodynamic efficiency of both the measurement and the feedback process performed by the demon. We fi…
By using Newtonian mechanics, we construct a general model of Maxwell's demon, a system in which the engine and the memory interact only through the exchange of information. We show that the Jarzynski relation and the two Sagawa-Ueda relations hold simultaneously, and argue that they are the unique triplet which has a natural decomposition property. The uniqueness provides a strong support to the assertion that the mutual information is the key quantity.
An interesting preprint by Puru Gujrati, "Maxwell's Demon Must Remain Subservient to Clausius' Statement" [ of the Second Law of Thermodynamics ], traces the development and application of Maxwell's Demon. He argues against the Demon on thermodynamic grounds. Gujrati introduces and uses his own version of a generalized thermodynamics in his criticism of the Demon. The complexity of his paper and the lack of any accompanying numerical work piqued our curiousity. The internet provides well over two million "hits'' on the subject of "Maxwell's Demon". There are also hundreds of images of the Demo…
In his famous letter in 1870, Maxwell describes how Joule's law can be violated "only by the intelligent action of a mere guiding agent", later coined as Maxwell's demon by Lord Kelvin. In this letter we study thermodynamics of information using an experimentally feasible Maxwell's demon setup based a single electron transistor capacitively coupled to a single electron box, where both the system and the Demon can be clearly identified. Such an engineered on-chip Demon measures and performes feedback on the system, which can be observed as cooling whose efficiency can be adjusted. We present a …
We present a physical implementation of a Maxwell demon which consists of a conventional single electron transistor (SET) capacitively coupled to another quantum dot detecting its state. Altogether, the system is described by stochastic thermodynamics. We identify the regime where the energetics of the SET is not affected by the detection, but where its coarse-grained entropy production is shown to contain a new contribution compared to the isolated SET. This additional contribution can be identified as the information flow generated by the "Maxwell demon" feedback in an idealized limit.
In a recent paper we have introduced a continuous version of the Maxwell demon (CMD) that is capable of extracting large amounts of work per cycle by repeated measurements of the state of the system. Here we underline its main features such as the role played by the Landauer limit in the average extracted work, the continuous character of the measurement process and the differences between our continuous Maxwell demon and an autonomous Maxwell demon. We demonstrate the reversal of Landauer's inequality depending on the thermodynamical and mechanical stability of the work extracting substance. …
We demonstrate, using well-established nonequilibrium growth models, that mound formation in the dynamical surface growth morphology does not necessarily imply a surface edge diffusion bias (the Schwoebel barrier) as has been almost universally accepted in the literature. We find mounded morphologies in several nonequilibrium growth models which incorporate no Schwoebel barrier. Our work should lead to a critical re-evaluation of recent experimental observations of mounded morphologies which have been theoretically interpreted in terms of Schwoebel barrier effects.
In this work, we investigate the dynamics of the number density fluctuations of a dilute suspension of active particles in a linear viscoelastic fluid. We propose a model for the frequency-dependent diffusion coefficient of the active particles, which captures the effect of rotational diffusion on the persistence of their self-propelled motion and the viscoelasticity of the medium. Using fluctuating hydrodynamics, the linearized equations for the active suspension are derived, from which we calculate its dynamic structure factor and the corresponding intermediate scattering function. For a Max…
An autonomous out of equilibrium Maxwell's demon is used to reverse the natural direction of the heat flux between two electric circuits kept at different temperatures and coupled by the electric thermal noise. The demon does not process any information, but it achieves its goal by using a frequency dependent coupling with the two reservoirs of the system. There is no energy flux between the demon and the system, but the total entropy production (system+demon) is positive. The demon can be power supplied by thermocouples. The system and the demon are ruled by equations similar to those of two …
An equation of state for an ideal gas with a small number of particles is studied. The resulting equation is found to differ from that expected in conventional thermodynamics, which is strikingly illustrated when considering the traditional thermodynamic problem of Maxwell's demon. We clarify the mechanism of this different feature of thermodynamics arising in small systems.
In the past decade several theoretical Maxwell's demon models have been proposed exhibiting effects such as refrigerating, doing work at the cost of information, and some experiments have been done to realise these effects. Here we propose a model with a two level demon, information represented by a sequence of bits, and two heat reservoirs. Which reservoir the demon interact with depends on the bit. If information is pure, one reservoir will be refrigerated, on the other hand, information can be erased if temperature difference is large. Genuine examples of such a system are discussed.
Landauer's principle states that information erasure requires heat dissipation. Landauer's original result focused on equilibrium memories. We here investigate the reset of information stored in a nonequilibrium state of a symmetric two-state memory. We derive a nonequilibrium generalization of the erasure principle and demonstrate that the corresponding bounds on work and heat may be reduced to zero. We further introduce reset protocols that harness the initial preparation energy and entropy and so allow to reach these nonequilibrium bounds. We finally provide numerical simulations with reali…
We propose a way to incorporate the effect of a specific class of feedback processes into stochastic thermodynamics. These "Maxwell demon" feedbacks do not affect the system energetics but only the energy barriers between the system states (in a way which depends on the system states). They are thus of a purely informational nature. We show that the resulting formalism can be applied to study the thermodynamic effect of a feedback process acting on electron transfers through a junction.
The second law of thermodynamics is probabilistic in nature. Its formulation requires that the state of a system be described by a probability distribution. A natural question, thereby, arises as to whether a prior knowledge about the state of the system affects the second law. This question has now been nurtured over a century and its inception was done by C. Maxwell through his famous thought experiment wherein comes the idea of Maxwell's demon. The next important step in this direction was provided by L. Szilard who demonstrated a theoretical model for an information engine incorporating Ma…
The second law of thermodynamics dictates the fundamental limits to the amount of energy and information that can be exchanged between physical systems. In this work, we extend a thermodynamic formalism describing this flow of energy and information developed for a pair of bipartite systems to many multipartite systems. We identify a natural thermodynamic quantity that describes the information exchanged among these systems. We then introduce and discuss a refined version. Our results are illustrated with a model of two, competing Maxwell demons.
Information plays a pivotal role in the thermodynamics of nonequilibrium processes with feedback. However, much remains to be learned about the nature of information fluctuations in small scale devices and their relation with fluctuations in other thermodynamics quantities, like heat and work. Here we derive a series of fluctuation theorems for information flow and partial entropy production in a Brownian particle model of feedback cooling and extend them to arbitrary driven diffusion processes. We then analyze the long-time behavior of the feedback-cooling model in detail. Our results provide…
We demonstrate particle clustering on macroscopic scales in a coupled nonequilibrium system where two species of particles are advected by a fluctuating landscape and modify the landscape in the process. The phase diagram generated by varying the particle-landscape coupling, valid for all particle density and in both one and two dimensions, shows novel nonequilibrium phases. While particle species are completely phase separated, the landscape develops macroscopically ordered regions coexisting with a disordered region, resulting in coarsening and steady state dynamics on time scales which grow…
We expand the standard thermodynamic framework of a system coupled to a thermal reservoir by considering a stream of independently prepared units repeatedly put into contact with the system. These units can be in any nonequilibrium state and interact with the system with an arbitrary strength and duration. We show that this stream constitutes an effective resource of nonequilibrium free energy and identify the conditions under which it behaves as a heat, work or information reservoir. We also show that this setup provides a natural framework to analyze information erasure ("Landauer's principl…
Although there is not a complete "proof" of the second law of thermo- dynamics based on microscopic dynamics, two properties of Hamiltonian systems have been used to prove the impossibility of work extraction from a single thermal reservoir: Liouville's theorem and the adiabatic invariance of the volume enclosed by an energy shell. In this paper we analyze these two properties in the Szilard engine and other systems related with the Maxwell demon. In particular, we recall that the enclosed volume is no longer an adiabatic invariant in non ergodic systems and explore the consequences of this on…
We introduce an information heat engine that is autonomous (i.e., without any time-dependent parameter) but has separated measurement and feedback processes. This model serves as a bridge between the other types of information heat engines inspired by Maxwell's demon; from the original Szilard-engine type systems to the autonomous demonic setups. By analyzing our model on the basis of a general framework introduced in our previous paper [N. Shiraishi and T. Sagawa, Phys. Rev. E {\bf 91}, 012130 (2015).], we clarify the role of the separation of measurement and feedback in the integral fluctuat…
We consider a dilute gas of granular material inside a box, kept in a stationary state by shaking. A wall separates the box into two identical compartments, save for a small hole at some finite height $h$. As the gas is cooled, a second order phase transition occurs, in which the particles preferentially occupy one side of the box. We develop a quantitative theory of this clustering phenomenon and find good agreement with numerical simulations.
We show that in mesoscopic four-terminal thermoelectric devices with two electrodes (the source and the drain) and two heat baths, inelastic scattering processes can lead to unconventional thermoelectric transport. The source (or the drain) can be cooled by passing a thermal current between the two heat baths, with no net heat exchange between the heat baths and the electrodes. This effect, termed as cooling by heat current, is a mesoscopic heat drag effect. In addition, there is a transverse thermoelectric effect where electrical current and power can be generated by a transverse temperature …
In the current research, we investigate the concept of spontaneously nonequilibrium dimension (SND), and show that a SND-based system can break the second law of thermodynamics. The main characteristic of the SND is the inherent nonequilibrium particle crossing ratio. A locally nonchaotic energy barrier is employed to form the model system. On the one hand, when the barrier width is much smaller than the mean free path of the particles, the system cannot reach thermodynamic equilibrium; on the other hand, the nonequilibrium particle distribution allows for production of useful work in a cycle …
The resolution of the Maxwell's demon paradox linked thermodynamics with information theory through information erasure principle. By considering a demon endowed with a Turing-machine consisting of a memory tape and a processor, we attempt to explore the link towards the foundations of statistical mechanics and to derive results therein in an "operational" manner. Here, we present a derivation of the Boltzmann distribution in equilibrium as an example, without hypothesizing the principle of maximum entropy. Further, since the model can be applied to non-equilibrium processes, in principle, we …
