In this article we study relationship between three measures of distinguishability of quantum states called as divergence, relative entropy and the substate property.
The Quantum Substate Theorem due to Jain, Radhakrishnan, and Sen (2002) gives us a powerful operational interpretation of relative entropy, in fact, of the observational divergence of two quantum states, a quantity that is related to their relative entropy. Informally, the theorem states that if the observational divergence between two quantum states rho, sigma is small, then there is a quantum state rho' close to rho in trace distance, such that rho' when scaled down by a small factor becomes a substate of sigma. We present new proofs of this theorem. The resulting statement is optimal up to …
One-shot information theory entertains a plethora of entropic quantities, such as the smooth max-divergence, hypothesis testing divergence and information spectrum divergence, that characterize various operational tasks and are used to prove the asymptotic behavior of various tasks in quantum information theory. Tight inequalities between these quantities are thus of immediate interest. In this note we use a minimax approach (appearing previously for example in the proofs of the quantum substate theorem), to simplify the quantum problem to a commutative one, which allows us to derive such ineq…
Recently, an interesting quantity called the quantum Renyi divergence (or "sandwiched" Renyi relative entropy) was defined for pairs of positive semi-definite operators $ρ$ and $σ$. It depends on a parameter $α$ and acts as a parent quantity for other relative entropies which have important operational significances in quantum information theory: the quantum relative entropy and the min- and max-relative entropies. There is, however, another relative entropy, called the 0-relative Renyi entropy, which plays a key role in the analysis of various quantum information-processing tasks in the one-s…
The Holevo quantity provides an upper bound for the mutual information between the sender of a classical message encoded in quantum carriers and the receiver. Applying the strong sub-additivity of entropy we prove that the Holevo quantity associated with an initial state and a given quantum operation represented in its Kraus form is not larger than the exchange entropy. This implies upper bounds for the coherent information and for the quantum Jensen--Shannon divergence. Restricting our attention to classical information we bound the transmission distance between any two probability distributi…
To this day, von Neumann definition of entropy remains the most popular measure of quantum entanglement. Much of the literature on entanglement entropy, particularly in the context of field theory, has focused on isolating the UV divergences. Zero-mode divergences of the entanglement entropy are less studied in this context, and apart from being easier to isolate, they offer an interesting insight into the physics of the system. To gain a better understanding of the system in this limit, we develop the free particle approximation of Harmonic oscillator, with which we investigate the properties…
Black hole entropy has been shown by 't Hooft to diverge at the horizon. The region near the horizon is in a thermal state, so entropy is linear to energy which consequently also diverges. We find a similar divergence for the energy of the reduced density matrix of relativistic and non-relativistic field theories, extending previous results in quantum mechanics. This divergence is due to an infinitely sharp division between the observable and unobservable regions of space, and it stems from the position/momentum uncertainty relation in the same way that the momentum fluctuations of a precisely…
We investigate the cause of the divergence of the entanglement entropy for the free scalar fields in $(1+1)$ and $(D + 1)$ dimensional space-times. In a canonically equivalent set of variables, we show explicitly that the divergence in the entanglement entropy of the continuum field in $(1 + 1)-$ dimensions is due to the accumulation of large number of near-zero frequency modes as opposed to the commonly held view of divergence having UV origin. The feature revealing the divergence in zero modes is related to the observation that the entropy is invariant under a hidden scaling transformation e…
We examine the correlations between divergences in ground state entanglement entropy and emergent zero-modes of the underlying Hamiltonian in the context of one-dimensional Bosonic and Fermionic chains. Starting with a pair of coupled Bosonic degrees of freedom, we show that zero modes are necessary, but not sufficient for entanglement entropy divergences. We then list sufficient conditions that identify divergences. Next, we extend our analysis to Bosonic chains, where we demonstrate that zero modes of the entanglement Hamiltonian provide a signature for divergences independent of the entangl…
Black hole entropy has been shown by 't Hooft to diverge at the horizon, whereas entanglement entropy in general does not. We show that because the region near the horizon is a thermal state, entropy is linear to energy, and energy at a barrier is inversely proportional to barrier slope, and diverges at an infinitely sharp barrier as a result of position/momentum uncertainty. We show that 't Hooft's divergence at the black hole is also an example of momentum/position uncertainty, as seen by the fact that the "brick wall" which corrects it in fact smooths the sharp boundary into a more gradual …
Recently it has been demonstrated that the Shannon entropy or the von Neuman entropy are the only entropy functions that generate a local Bregman divergences as long as the state space has rank 3 or higher. In this paper we will study the properties of Bregman divergences for convex bodies of rank 2. The two most important convex bodies of rank 2 can be identified with the bit and the qubit. We demonstrate that if a convex body of rank 2 has a Bregman divergence that satisfies sufficiency then the convex body is spectral and if the Bregman divergence is monotone then the convex body has the sh…
The subject is the overview of the use of quasi-entropy in finite dimensional spaces. Matrix monotone functions and relative modular operators are used. The origin is the relative entropy and the f-divergence, monotone metrics, covariance and the chi-square-divergence are the most important particular cases. The extension of the monotone metric to two variables is a new concept.
We characterize the functions for which the corresponding Bregman divergence is jointly convex on matrices. As an application of this characterization, we derive a sharp inequality for the quantum Tsallis entropy of a tripartite state, which can be considered as a generalization of the strong subadditivity of the von Neumann entropy. (In general, the strong subadditivity of the Tsallis entropy fails for quantum states, but it holds for classical states.) Furthermore, we show that the joint convexity of the Bregman divergence does not imply the monotonicity under stochastic maps, but every mono…
Audenaert and Datta recently introduced a two-parameter family of relative Rényi entropies, known as the $α$-$z$-relative Rényi entropies. The definition of the $α$-$z$-relative Rényi entropy unifies all previously proposed definitions of the quantum Rényi divergence of order $α$ under a common framework. Here we will prove that the $α$-$z$-relative Rényi entropies are a proper generalization of the quantum relative entropy by computing the limit of the $α$-$z$ divergence as $α$ approaches one and $z$ is an arbitrary function of $α$. We also show that certain operationally relevant families of…
We consider a family of quantum conditional entropies based on the concept of quantum $f$-divergences. First, we explicitly formulate conditions under which the notion of quantum conditional entropy is well defined in this way. In particular, we demand that the value of conditional entropy be independent of any extension of the principal Hilbert space. Using fundamental properties of the quantum $f$-divergences, several interesting relations for such conditional entropies are formulated. We separately examine an especially important case of quantum conditional entropies related to the Tsallis …
Thermodynamics describes large-scale, slowly evolving systems. Two modern approaches generalize thermodynamics: fluctuation theorems, which concern finite-time nonequilibrium processes, and one-shot statistical mechanics, which concerns small scales and finite numbers of trials. Combining these approaches, we calculate a one-shot analog of the average dissipated work defined in fluctuation contexts: the cost of performing a protocol in finite time instead of quasistatically. The average dissipated work has been shown to be proportional to a relative entropy between phase-space densities, to a …
We study many-party correlations quantified in terms of the Umegaki relative entropy (divergence) from a Gibbs family known as a hierarchical model. We derive these quantities from the maximum-entropy principle which was used earlier to define the closely related irreducible correlation. We point out differences between quantum states and probability vectors which exist in hierarchical models, in the divergence from a hierarchical model and in local maximizers of this divergence. The differences are, respectively, missing factorization, discontinuity and reduction of uncertainty. We discuss gl…
We investigate quantum Rényi entropic quantities, specifically those derived from 'sandwiched' divergence. This divergence is one of several proposed Rényi generalisations of the quantum relative entropy. We may define Rényi generalisations of the quantum conditional entropy and mutual information in terms of this divergence, from which they inherit many desirable properties. However, these quantities lack some of the convenient structure of their Shannon and von Neumann counterparts. We attempt to bridge this gap by establishing divergence inequalities for valid combinations of Rényi order wh…
The quantum relative entropy is a measure of the distinguishability of two quantum states, and it is a unifying concept in quantum information theory: many information measures such as entropy, conditional entropy, mutual information, and entanglement measures can be realized from it. As such, there has been broad interest in generalizing the notion to further understand its most basic properties, one of which is the data processing inequality. The quantum f-divergence of Petz is one generalization of the quantum relative entropy, and it also leads to other relative entropies, such as the Petz…
It has long been conjectured that the entropy of quantum fields across boundaries scales as the boundary area. This conjecture has not been easy to test in spacetime dimensions greater than four because of divergences in the von Neumann entropy. Here we show that the Renyi entropy provides a convergent alternative, yielding a quantitative measure of entanglement between quantum field theoretic degrees of freedom inside and outside hypersurfaces. For the first time, we show that the entanglement entropy in higher dimensions is proportional to the higher dimensional area. We also show that the R…
Motivated by the geometrical structures of quantum mechanics, we introduce an almost-complex structure $J$ on the product $M\times M$ of any parallelizable statistical manifold $M$. Then, we use $J$ to extract a pre-symplectic form and a metric-like tensor on $M\times M$ from a divergence function. These tensors may be pulled back to $M$, and we compute them in the case of an N-dimensional symplex with respect to the Kullback-Leibler relative entropy, and in the case of (a suitable unfolding space of) the manifold of faithful density operators with respect to the von Neumann-Umegaki relative e…
The quantum relative entropy is a measure of the distinguishability of two quantum states, and it is a unifying concept in quantum information theory: many information measures such as entropy, conditional entropy, mutual information, and entanglement measures can be realized from it. As such, there has been broad interest in generalizing the notion to further understand its most basic properties, one of which is the data processing inequality. The quantum f-divergence of Petz is one generalization of the quantum relative entropy, and it also leads to other relative entropies, such as the Petz…
In this work, we provide a strengthening of the data processing inequality for the relative entropy introduced by Belavkin and Staszewski (BS-entropy). This extends previous results by Carlen and Vershynina for the relative entropy and other standard $f$-divergences. To this end, we provide two new equivalent conditions for the equality case of the data processing inequality for the BS-entropy. Subsequently, we extend our result to a larger class of maximal $f$-divergences. Here, we first focus on quantum channels which are conditional expectations onto subalgebras and use the Stinespring dila…
In these decades, it has been revealed that there is rich information-theoretic structure in thermodynamics of out-of-equilibrium systems in both the classical and quantum regimes. This has led to the fruitful interplay among statistical physics, quantum information theory, and mathematical theories including matrix analysis and asymptotic probability theory. The main purpose of this book is to clarify how information theory works behind thermodynamics and to shed modern light on it. We focus on both of purely information-theoretic concepts and their physical implications: We present self-cont…
We describe the structure of the bijective transformations on the set of density operators which preserve the Bregman $f$-divergence for an arbitrary differentiable strictly convex function $f.$ Furthermore, we determine the preservers of the Jensen $f$-divergence in the case when the generating function $f$ belongs to a recently introduced function class called Matrix Entropy Class.
The optimized quantum $f$-divergences form a family of distinguishability measures that includes the quantum relative entropy and the sandwiched Rényi relative quasi-entropy as special cases. In this paper, we establish physically meaningful refinements of the data-processing inequality for the optimized $f$-divergence. In particular, the refinements state that the absolute difference between the optimized $f$-divergence and its channel-processed version is an upper bound on how well one can recover a quantum state acted upon by a quantum channel, whenever the recovery channel is taken to be a…
Continuity of Regularized Channel Rényi Divergences
Zyphra;QICI Quantum Information and Computation Initiative, School of Computing and Data Science, The University of Hong Kong(量子信息与计算倡议,计算与数据科学学院,香港大学)
In a certain sense we generalize the recently introduced and extensively studied notion called quantum Rényi divergence (in another name, sandwiched Rényi relative entropy) and describe the structures of corresponding symmetries. More precisely, we characterize all transformations on the set of density operators which leave our new general quantity invariant and also determine the structure of all bijective transformations on the cone of positive definite operators which preserve the quantum Rényi divergence.
We introduce an axiomatic approach for channel divergences and channel relative entropies that is based on three information-theoretic axioms of monotonicity under superchannels (i.e. generalized data processing inequality), additivity under tensor products, and normalization, similar to the approach given recently for the state domain. We show that these axioms are sufficient to give enough structure also in the channel domain, leading to numerous properties that are applicable to all channel divergences. These include faithfulness, continuity, a type of triangle inequality, and boundedness b…
We define a new divergence of von Neumann algebras using a variational expression that is similar in nature to Kosaki's formula for the relative entropy. Our divergence satisfies the usual desirable properties, upper bounds the sandwiched Renyi entropy and reduces to the fidelity in a limit. As an illustration, we use the formula in quantum field theory to compute our divergence between the vacuum in a bipartite system and an "orbifolded" -- in the sense of conditional expectation -- system in terms of the Jones index. We take the opportunity to point out entropic certainty relation for arbitr…
Tight relations and equivalences between smooth relative entropies
RIKEN Hakubi Research Team, RIKEN Pioneering Research Institute (PRI) and RIKEN Center for Quantum Computing (RQC)(理化学研究所白兔研究团队、理学前驱性研究机构和理中心量子计算);Scuola Normale Superiore(比萨高等师范学院);QuSoft;Korteweg–de Vries Institute for Mathematics, University of Amsterdam(阿姆斯特丹大学科特维格-德弗里斯数学研究所);Institute for Theoretical Physics, University of Amsterdam(阿姆斯特丹大学理论物理研究所);Department of Applied Mathematics and Theoretical Physics, Centre for Mathematical Sciences, University of Cambridge(剑桥大学数学科学中心应用数学与理论物理系)