Building upon work by Matsumoto, we show that the quantum relative entropy with full-rank second argument is determined by four simple axioms: i) Continuity in the first argument, ii) the validity of the data-processing inequality, iii) additivity under tensor products, and iv) super-additivity. This observation has immediate implications for quantum thermodynamics, which we discuss. Specifically, we demonstrate that, under reasonable restrictions, the free energy is singled out as a measure of athermality. In particular, we consider an extended class of Gibbs-preserving maps as free operations in a resource-theoretic framework, in which a catalyst is allowed to build up correlations with the system at hand. The free energy is the only extensive and continuous function that is monotonic under such free operations.
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a measure of uncertainty. In this Letter, we connect these two notions of entropy, using an axiomatic framework for thermodynamics [Lieb, Yngvason, Proc. Roy. Soc.(2013)]. In particular, we obtain a direct relation between the Clausius entropy and the Shannon entropy, or its generalisation to quantum systems, the von Neumann entropy. More generally, we find that …
We have presented a new axiomatic derivation of Shannon Entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function.We have then modified shannon entropy to take account of observational uncertainty.The modified entropy reduces, in the limiting case, to the form of Shannon differential entropy. As an application we have derived the expression for classical entropy of statistical mechanics from the quantized form of the entropy.
We present an axiomatic framework for thermodynamics that incorporates information as a fundamental concept. The axioms describe both ordinary thermodynamic processes and those in which information is acquired, used and erased, as in the operation of Maxwell's demon. This system, like previous axiomatic systems for thermodynamics, supports the construction of conserved quantities and an entropy function governing state changes. Here, however, the entropy exhibits both information and thermodynamic aspects. Although our axioms are not based upon probabilistic concepts, a natural and highly usef…
Thermodynamics can be formulated in either of two approaches, the phenomenological approach, which refers to the macroscopic properties of systems, and the statistical approach, which describes systems in terms of their microscopic constituents. We establish a connection between these two approaches by means of a new axiomatic framework that can take errors and imprecisions into account. This link extends to systems of arbitrary sizes including microscopic systems, for which the treatment of imprecisions is pertinent to any realistic situation. Based on this, we identify the quantities that ch…
We introduce an axiomatic approach for characterizing quantum conditional entropy. Our approach relies on two physically motivated axioms: monotonicity under conditional majorization and additivity. We show that these two axioms provide sufficient structure that enable us to derive several key properties applicable to all quantum conditional entropies studied in the literature. Specifically, we prove that any quantum conditional entropy must be negative on certain entangled states and must equal -log(d) on dxd maximally entangled states. We also prove the non-negativity of conditional entropy …
An axiomatic formalism for a minimal irreversible quantum mechanics is introduced. It is shown that a quantum equilibrium and the decoherence phenomenon are consequences of the axioms and that Lyapunov variables, exponential survival probabilities, and a classisal conditional never-decreasing entropy can be defined.
We provide a unifying axiomatics for Renyi's entropy and non-extensive entropy of Tsallis. It is shown that the resulting entropy coincides with Csiszar's measure of directed divergence known from communication theory.
A new axiomatic characterization with a minimum of conditions for entropy as a function on the set of states in quantum mechanics is presented. Traditionally unspoken assumptions are unveiled and replaced by proven consequences of the axioms. First the Boltzmann-Planck formula is derived. Building on this formula, using the Law of Large Numbers - a basic theorem of probability theory - the von Neumann formula is deduced. Axioms used in older theories on the foundations are now derived facts.
Axiomatization of Rényi Entropy on Quantum Phase Space
Stern School of Business, Tandon School of Engineering, NYU Shanghai, New York University（纽约大学斯特恩商学院、坦登工程学院、上海纽约大学）；HHL - Leipzig Graduate School of Management（莱比锡高等商业与法律学院）
We axiomatically characterize the Tsallis entropy of a finite quantum system. In addition, we derive a continuity property of Tsallis entropy. This gives a generalization of the Fannes inequality.
We present a unified axiomatic approach to contextuality and non-locality based on the fact that both are resource theories. In those theories the main objects are consistent boxes, which can be transformed by certain operations to achieve certain tasks. The amount of resource is quantified by appropriate measures of the resource. Following recent paper [J.I. de Vicente, J. Phys. A: Math. Theor. {\bf 47}, 424017 (2014)], and recent development of abstract approach to resource theories, such as entanglement theory, we propose axioms and welcome properties for operations and measures of resource…
Based on the form invariance of the structures given by Khinchin's axiomatic foundations of information theory and the pseudoadditivity of the Tsallis entropy indexed by q, the concept of conditional entropy is generalized to the case of nonadditive (nonextensive) composite systems. The proposed nonadditive conditional entropy is classically nonnegative but can be negative in the quantum context, indicating its utility for characterizing quantum entanglement. A criterion deduced from it for separability of density matrices for validity of local realism is examined in detail by employing a bipa…
The aim of the present paper is to give axiomatic characterization of quantum relative entropy utilizing resource conversion scenario. We consider two sets of axioms: non-asymptotic and asymptotic. In the former setting, we prove that the upperbound and the lowerbund of $\mathrm{D}^{Q}(ρ||σ) $ is $\mathrm{D}^{R}(ρ||σ) :=\mathrm{tr}% \,ρ\ln\sqrtρσ^{-1}\sqrtρ$ and $\mathrm{D}(ρ||σ) :=$ $\mathrm{tr}\,ρ(\lnρ-\lnσ) $, respectively. In the latter setting, we prove uniqueness of quantum relative entropy, that is, $\mathrm{D}^{Q}(ρ||σ) $ should equal a constant multiple of $\mathrm{D}(ρ||σ) $. In the …
We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find that these axioms induce sufficient structure to establish continuity in the interior of the probability simplex and meaningful upper and lower bounds, e.g., we find that every relative entropy must lie between the Rényi divergences of order $0$ and $\infty$. We further show simple conditions for positive definiteness of such relative entropies and a characte…
We derive a strengthened monotonicity inequality for quantum relative entropy by employing properties of $α$-Rényi relative entropy. We develop a unifying treatment towards the improvement of some quantum entropy inequalities. In particular, an emphasis is put on a lower bound of quantum conditional mutual information (QCMI) as it gives a Pinsker-like lower bound for the QCMI. We also give some improved entropy inequalities based on Rényi relative entropy. The inequalities obtained, thus, extends some well-known ones. We also obtain a condition under which a tripartite operator becomes a Marko…
The operational characterization of quantum coherence is the corner stone in the development of resource theory of coherence. We introduce a new coherence quantifier based on max-relative entropy. We prove that max-relative entropy of coherence is directly related to the maximum overlap with maximally coherent states under a particular class of operations, which provides an operational interpretation of max-relative entropy of coherence. Moreover, we show that, for any coherent state, there are examples of subchannel discrimination problems such that this coherent state allows for a higher pro…
The aim of the present paper is to give axiomatic characterization of quantum relative entropy utilizing resource conversion scenario. We consider two sets of axioms: non-asymptotic and asymptotic. In the former setting, we prove that the upperbound and the lowerbund of D^{Q}(ρ||σ) is D^{R}(ρ||σ):=trρlnσ^{1/2}ρ^{-1}σ^{1/2} and D(ρ||σ):= trρ(lnρ-lnσ), respectively. In the latter setting, we prove uniqueness of quantum relative entropy, that is, D^{Q}(ρ||σ) should equal a constant multiple of D(ρ||σ). In the analysis, we define and use reverse test and asymptotic reverse test, which are natural …
Fidelity and relative entropy are two significant quantities in quantum information theory. We study the quantum fidelity and relative entropy under unitary orbits. The maximal and minimal quantum fidelity and relative entropy between two unitary orbits are explicitly derived. The potential applications in quantum computation and information processing are discussed.
It is well known that for pure states the relative entropy of entanglement is equal to the reduced entropy, and the closest separable state is explicitly known as well. The same holds for Renyi relative entropy per recent results. We ask the same question for a quasi-relative entropy of entanglement, which is an entanglement measure defined as the minimum distance to the set of separable state, when the distance is measured by the quasi-relative entropy. First, we consider a maximally entangled state, and show that the closest separable state is the same for any quasi-relative entropy as for t…
Generalized entropies and relative entropies are the subject of active research. Similar to the standard relative entropy, the relative $q$-entropy is generally unbounded for $q>1$. Upper bounds on the quantum relative $q$-entropy in terms of norm distances between its arguments are obtained in finite-dimensional context. These bounds characterize a continuity property in the sense of Fannes.
Quasi-factorization-type inequalities for the relative entropy have recently proven to be fundamental in modern proofs of modified logarithmic Sobolev inequalities for quantum spin systems. In this paper, we show some results of weak quasi-factorization for the Belavkin-Staszewski relative entropy, i.e. upper bounds for the BS-entropy between two bipartite states in terms of the sum of two conditional BS-entropies, up to some multiplicative and additive factors.
We explore the role of sandwiched Renyi relative entropy in AdS/CFT and in finite-dimensional models of holographic quantum error correction. In particular, in the context of operator algebra quantum error correction, we discuss a suitable generalization of sandwiched Renyi relative entropy over finite-dimensional von Neumann algebras. It is then shown that the equality of bulk and boundary sandwiched relative Renyi entropies is equivalent to algebraic encoding of bulk and boundary states, the Ryu-Takayanagi formula, the equality of bulk and boundary relative entropy, and subregion duality. Th…
Thermodynamics is usually developed starting from entropy and the maximum entropy principle. We investigate here to what extent one can replace entropy with relative entropy which has several advantages, for example in the context of local quantum field theory. We find that the principle of maximum entropy can be replaced by a principle of minimum expected relative entropy. Various ensembles and their thermodynamic potentials can be defined through relative entropy. We also show that thermal fluctuations are in fact governed by a relative entropy. Furthermore we reformulate the third law of th…
The existence of a positive log-Sobolev constant implies a bound on the mixing time of a quantum dissipative evolution under the Markov approximation. For classical spin systems, such constant was proven to exist, under the assumption of a mixing condition in the Gibbs measure associated to their dynamics, via a quasi-factorization of the entropy in terms of the conditional entropy in some sub-$σ$-algebras. In this work we analyze analogous quasi-factorization results in the quantum case. For that, we define the quantum conditional relative entropy and prove several quasi-factorization results…
Many thermodynamic relations involve inequalities, with equality if a process does not involve dissipation. In this article we provide equalities in which the dissipative contribution is shown to involve the relative entropy (a.k.a. Kullback-Leibler divergence). The processes considered are general time evolutions both in classical and quantum mechanics, and the initial state is sometimes thermal, sometimes partially so. As an application, the relative entropy is related to transport coefficients.
We show that a recent definition of relative Rényi entropy is monotone under completely positive, trace preserving maps. This proves a recent conjecture of Müller-Lennert et al.
We prove that the quantum relative entropy is a rate function in large deviation principle. Next, we define information criteria for quantum states and estimate the accuracy of the use of them. Most of the results in this paper are essentially based on Hiai-Ohya-Tsukada theorem.
An analogue of the mixing property of quantum entropy is derived for quantum relative entropy.It is applied to the final state of ideal measurement and to the spectral form of the second density operator. Three cases of states on a directed straight line of relative entropy are discussed.
We consider the gravity dual of the modular Hamiltonian associated to a general subregion of a boundary theory. We use it to argue that the relative entropy of nearby states is given by the relative entropy in the bulk, to leading order in the bulk gravitational coupling. We also argue that the boundary modular flow is dual to the bulk modular flow in the entanglement wedge, with implications for entanglement wedge reconstruction.
Quantum relative entropy $D(ρ\|σ)\defeq\Tr ρ(\log ρ- \log σ)$ plays an important role in quantum information and related fields. However, there are many quantum analogues of relative entropy. In this paper, we characterize these analogues from information geometrical viewpoint. We also consider the naturalness of quantum relative entropy among these analogues.
Because of the difficulty in getting the analytic formula of relative entropy of entanglement, it becomes troublesome to study the monogamy relations of relative entropy of entanglement for three-qubit pure states. However, we find that all generalized W states have the monogamous property for relative entropy of entanglement by calculating the relative entropy of entanglement for the reduced states of the generalized W states in three-qubit systems.
In this article we study relationship between three measures of distinguishability of quantum states called as divergence, relative entropy and the substate property.
The relative entropy of two n-party quantum states is an important quantity exhibiting, for example, the extent to which the two states are different. The relative entropy of the states formed by reducing two n-party to a smaller number $m$ of parties is always less than or equal to the relative entropy of the two original n-party states. This is the monotonicity of relative entropy. Using techniques from convex geometry, we prove that monotonicity under restrictions is the only general inequality satisfied by relative entropies. In doing so we make a connection to secret sharing schemes with …
In the previous paper \cite{FYK}, we mainly studied the mathematical properties of Tsallis relative entropy with respect to the density operators. As an application of it, we adopt a parametrically extended entanglement-measure due to Tsallis relative entropy in order to measure the degree of entanglement. Then we study its properies with respect to the parameter $q$ appearing in Tsallis entropies. In addition, the relation between it and the relative entropy of entanglement is studied.
We review the properties of the quantum relative entropy function and discuss its application to problems of classical and quantum information transfer and to quantum data compression. We then outline further uses of relative entropy to quantify quantum entanglement and analyze its manipulation.
We introduce the theory of operator monotone functions and employ it to derive a new inequality relating the quantum relative entropy and the quantum conditional entropy. We present applications of this new inequality and in particular we prove a new lower bound on the relative entropy of entanglement and other properties of entanglement measures.
We present the modified relative entropy of entanglement for multi-party systems by a given relative density matrix which is spanned by a linear combination of the direct products of so-called basis of relative density matrices and reduced density matrices for every party. For three qubit system in a pure state we derive out the explicit and closed expression of our relative density matrix which is a function of the components of the state vector of three qubits. Through computing the modified relative entropy of entanglement of some important and interesting examples, we display the main beha…
For two gaussian states with given correlation matrices, in order that relative entropy between them is practically calculable, I in this paper describe the ways of transforming the correlation matrix to matrix in the exponential density operator. Gaussian relative entropy of entanglement is proposed as the minimal relative entropy of the gaussian state with respect to separable gaussian state set. I prove that gaussian relative entropy of entanglement achieves when the separable gaussian state is at the border of separable gaussian state set and inseparable gaussian state set. For two mode ga…
We calculate the relative entropy of entanglement for rotationally invariant states of spin-1/2 and arbitrary spin-$j$ particles or of spin-1 particle and spin-$j$ particle with integer $j$. A lower bound of relative entropy of entanglement and an upper bound of distillable entanglement are presented for rotationally invariant states of spin-1 particle and spin-$j$ particle with half-integer $j$.
Previously proposed measures of entanglement, such as entanglement of formation and assistance, are shown to be special cases of the relative entropy of entanglement. The difference between these measures for an ensemble of mixed states is shown to depend on the availability of classical information about particular members of the ensemble. Based on this, relations between relative entropy of entanglement and mutual information are derived.
The relative entropy is a measure of the distinguishability of two quantum states. A great deal of progress has been made in the study of the relative entropy between an excited state and the vacuum state of a conformal field theory (CFT) reduced to a spherical region. For example, when the excited state is a small perturbation of the vacuum state, the relative entropy is known to have a universal expression for \textit{all} CFT's \cite{Faulk-GR-entanglement}. Specifically, the perturbative relative entropy can be written as the symplectic flux of a certain scalar field in an \textit{auxiliary…
The chain rule for the classical relative entropy ensures that the relative entropy between probability distributions on multipartite systems can be decomposed into a sum of relative entropies of suitably chosen conditional distributions on the individual systems. Here, we prove a similar chain rule inequality for the quantum relative entropy in terms of channel relative entropies. The new chain rule allows us to solve an open problem in the context of asymptotic quantum channel discrimination: surprisingly, adaptive protocols cannot improve the error rate for asymmetric channel discrimination…
We quantify the measurement-induced nonlocality [Luo and Fu, Phys. Rev. Lett. 106, 120401 (2011)] from the perspective of the relative entropy. This quantification leads to an operational interpretation for the measurementinduced nonlocality, namely, it is the maximal entropy increase after the locally invariant measurements. The relative entropy of nonlocality is upper bounded by the entropy of the measured subsystem. We establish a relationship between the relative entropy of nonlocality and the geometric nonlocality based on the Hilbert- Schmidt norm, and show that it is equal to the maxima…
Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable states. The various capacities of quantum channels can also be written in this way. We propose a unified framework to numerically compute these quantities using off-the-shelf semidefinite programming solvers, exploiting the approximation method proposed in [Fawzi, Saunderson, Parrilo, Semidefinite approximations of the matrix logarithm, arXiv:1705.00812]. A…
Semidefinite optimization of the quantum relative entropy of channels
Institute for Quantum Information, RWTH Aachen University（亚琛工业大学量子信息研究所）；School of Electrical and Computer Engineering, Cornell University（康奈尔大学电气与计算机工程学院）
Purely multiplicative comparisons of quantum relative entropy are desirable but challenging to prove. We show such comparisons for relative entropies between comparable densities, including the relative entropy of a density with respect to its subalgebraic restriction. These inequalities are asymptotically tight in approaching known, tight inequalities as perturbation size approaches zero. Based on these results, we obtain a kind of inequality known as quasi-factorization or approximate tensorization of relative entropy. Quasi-factorization lower bounds the sum of a density's relative entropie…
Inspired by the recent work of Bao and Ooguri (BO), we study the distinguishability of the black hole microstates from the thermal state as captured by the average of their relative entropies: the Holevo information. Under the assumption that the vacuum conformal block dominates the entropy calculation, BO find that the average relative entropy vanishes on spatial regions less than half the size of the CFT. However, vacuum block dominance fails for some microstates of the $M=0$ BTZ black hole. We show that this renders the average relative entropy nonzero even on infinitesimal intervals at $O(…
