In this work, we consider the weighted difference of two independent complex Wishart matrices and derive the joint probability density function of the corresponding eigenvalues in a finite-dimension scenario using two distinct approaches. The first derivation involves the use of unitary group integral, while the second one relies on applying the derivative principle. The latter relates the joint probability density of eigenvalues of a matrix drawn from a unitarily invariant ensemble to the joint probability density of its diagonal elements. Exact closed form expressions for an arbitrary order correlation function are also obtained and spectral densities are contrasted with Monte Carlo simulation results. Analytical results for moments as well as probabilities quantifying positivity aspects of the spectrum are also derived. Additionally, we provide a large-dimension asymptotic result for the spectral density using the Stieltjes transform approach for algebraic random matrices. Finally, we point out the relationship of these results with the corresponding results for difference of two random density matrices and obtain some explicit and closed form expressions for the spectral density and absolute mean.
Hilbert-Schmidt distance is one of the prominent distance measures in quantum information theory which finds applications in diverse problems, such as construction of entanglement witnesses, quantum algorithms in machine learning, and quantum state tomography. In this work, we calculate exact and compact results for the mean square Hilbert-Schmidt distance between a random density matrix and a fixed density matrix, and also between two random density matrices. In the course of derivation, we also obtain corresponding exact results for the distance between a Wishart matrix and a fixed Hermitian…
We consider four nontrivial ensembles involving Gaussian Wigner and Wishart matrices. These are relevant to problems ranging from multiantenna communication to random supergravity. We derive the matrix probability density, as well as the eigenvalue densities for these ensembles. In all cases the joint eigenvalue density exhibits a biorthogonal structure. A determinantal representation, based on a generalization of Andréief's integration formula, is used to compactly express the $r$-point correlation function of eigenvalues. This representation circumvents the complications encountered in the u…
Positive-definite matrix-variate data is becoming popular in computer vision. The computer vision data descriptors in the form of Region Covariance Descriptors (RCD) are positive definite matrices, which extract the key features of the images. The RCDs are extensively used in image set classification. Some classification methods treating RCDs as Wishart distributed random matrices are being proposed. However, the majority of the current methods preclude the potential correlation among the RCDs caused by the so-called non-voxel information (e.g., subjects' ages and nose widths, etc). Modeling c…
The statistical behaviour of the smallest eigenvalue has important implications for systems which can be modeled using a Wishart-Laguerre ensemble, the regular one or the fixed trace one. For example, the density of the smallest eigenvalue of the Wishart-Laguerre ensemble plays a crucial role in characterizing multiple channel telecommunication systems. Similarly, in the quantum entanglement problem, the smallest eigenvalue of the fixed trace ensemble carries information regarding the nature of entanglement. For real Wishart-Laguerre matrices, there exists an elegant recurrence scheme suggeste…
This paper develops an efficient Monte Carlo method to estimate the tail probabilities of the ratio of the largest eigenvalue to the trace of the Wishart matrix, which plays an important role in multivariate data analysis. The estimator is constructed based on a change-of-measure technique and it is proved to be asymptotically efficient for both the real and complex Wishart matrices. Simulation studies further show the outperformance of the proposed method over existing approaches based on asymptotic approximations, especially when estimating probabilities of rare events.
We introduce a family of matrices with non-commutative entries that generalize the classical real Wishart matrices. With the help of the Brauer product, we derive a non-asymptotic expression for the moments of traces of monomials in such matrices; the expression is quite similar to the formula derived in our previous work for independent complex Wishart matrices. We then analyze the fluctuations about the Marchenko-Pastur law. We show that after centering by the mean, traces of real symmetric polynomials in q-Wishart matrices converge in distribution, and we identify the asymptotic law as the …
Using a character expansion method, we calculate exactly the eigenvalue density of random matrices of the form M^\dagger M where M is a complex matrix drawn from a normalized distribution P(M) ~ exp(-\Tr(A M B M^\dagger) with A and B positive definite (square) matrices of arbitrary dimensions. Such so-called ``correlated Wishart matrices'' occur in many fields ranging from information theory to multivariate analysis.
We provide a compact exact representation for the distribution of the matrix elements of the Wishart-type random matrices $A^\dagger A$, for any finite number of rows and columns of $A$, without any large N approximations. In particular we treat the case when the Wishart-type random matrix contains redundant, non-random information, which is a new result. This representation is of interest for a procedure of reconstructing the redundant information hidden in Wishart matrices, with potential applications to numerous models based on biological, social and artificial intelligence networks.
We present an analytic method to determine spectral properties of the covariance matrices constructed of correlated Wishart random matrices. The method gives, in the limit of large matrices, exact analytic relations between the spectral moments and the eigenvalue densities of the covariance matrices and their estimators. The results can be used in practice to extract information about the genuine correlations from the given experimental realization of random matrices.
Using a change-of-measure argument, we prove an equality in law between the process of largest eigenvalues in a generalized Wishart random-matrix process and a last-passage percolation process. This equality in law was conjectured by Borodin and Peche.
The ergodic unitarily invariant measures on the space of infinite Hermitian matrices have been classified by Pickrell and Olshanski-Vershik. The much-studied complex inverse Wishart measures form a projective family, thus giving rise to a unitarily invariant measure on infinite positive-definite matrices. In this paper we completely solve the corresponding problem of ergodic decomposition for this measure.
Wishart random matrices are often used to model multivariate systems in physics, finance, biology and wireless communication. Extreme value statistics, such as those of the smallest eigenvalue, can be used to test the accuracy of the model. In this article we study the gap formation probability (cumulative distribution function of the smallest eigenvalue) for real and quaternion $N\times \left(N+ν\right)$ Wishart random matrices in the large $N$ limit. We derive compact expression in terms of determinants of known functions. As a consequence of this representation, the gap formation probabilit…
We calculate the `one-point function', meaning the marginal probability density function for any single eigenvalue, of real and complex Wishart correlation matrices. No explicit expression had been obtained for the real case so far. We succeed in doing so by using supersymmetry techniques to express the one-point function of real Wishart correlation matrices as a twofold integral. The result can be viewed as a resummation of a series of Jack polynomials in a non-trivial case. We illustrate our formula by numerical simulations. We also rederive a known expression for the one-point function of c…
The Wishart model for real symmetric correlation matrices is defined as $\mathsf{W}=\mathsf{AA}^{t}$, where matrix $\mathsf{A}$ is usually a rectangular Gaussian random matrix and $\mathsf{A}^{t}$ is the transpose of $\mathsf{A}$. Analogously, for nonsymmetric correlation matrices, a model may be defined for two statistically equivalent but different matrices $\mathsf{A}$ and $\mathsf{B}$ as $\mathsf{AB}^{t}$. The corresponding Wishart model, thus, is defined as $\mathbf{C}=\mathsf{AB}^{t}\mathsf{BA}^{t}$. We study the spectral density of $\mathbf{C}$ for the case when $\mathsf{A}$ and $\maths…
We compute analytically the probability of large fluctuations to the left of the mean of the largest eigenvalue in the Wishart (Laguerre) ensemble of positive definite random matrices. We show that the probability that all the eigenvalues of a (N x N) Wishart matrix W=X^T X (where X is a rectangular M x N matrix with independent Gaussian entries) are smaller than the mean value <λ>=N/c decreases for large N as $\sim \exp[-\fracβ{2}N^2 Φ_{-}(\frac{2}{\sqrt{c}}+1;c)]$, where β=1,2 correspond respectively to real and complex Wishart matrices, c=N/M < 1 and Φ_{-}(x;c) is a large deviation function…
The sum of independent Wishart matrices, taken from distributions with unequal covariance matrices, plays a crucial role in multivariate statistics, and has applications in the fields of quantitative finance and telecommunication. However, analytical results concerning the corresponding eigenvalue statistics have remained unavailable, even for the sum of two Wishart matrices. This can be attributed to the complicated and rotationally noninvariant nature of the matrix distribution that makes extracting the information about eigenvalues a nontrivial task. Using a generalization of the Harish-Cha…
We determined the probability distribution of the combined output power from twenty five coupled fiber lasers and show that it agrees well with the Tracy-Widom, Majumdar-Vergassola and Vivo-Majumdar-Bohigas distributions of the largest eigenvalue of Wishart random matrices with no fitting parameters. This was achieved with $500,000$ measurements of the combined output power from the fiber lasers, that continuously changes with variations of the fiber lasers lengths. We show experimentally that for small deviations of the combined output power over its mean value the Tracy-Widom distribution is…
We derive the probability that all eigenvalues of a random matrix $\bf M$ lie within an arbitrary interval $[a,b]$, $ψ(a,b)\triangleq\Pr\{a\leqλ_{\min}({\bf M}), λ_{\max}({\bf M})\leq b\}$, when $\bf M$ is a real or complex finite dimensional Wishart, double Wishart, or Gaussian symmetric/Hermitian matrix. We give efficient recursive formulas allowing the exact evaluation of $ψ(a,b)$ for Wishart matrices, even with large number of variates and degrees of freedom. We also prove that the probability that all eigenvalues are within the limiting spectral support (given by the Mar{č}enko-Pastur or …
We discuss an application of the random matrix theory in the context of estimating the bipartite entanglement of a quantum system. We discuss how the Wishart ensemble (the earliest studied random matrix ensemble) appears in this quantum problem. The eigenvalues of the reduced density matrix of one of the subsystems have similar statistical properties as those of the Wishart matrices, except that their {\em trace is constrained to be unity}. We focus here on the smallest eigenvalue which serves as an important measure of entanglement between the two subsystems. In the hard edge case (when the t…
We investigate the level density for several ensembles of positive random matrices of a Wishart--like structure, $W=XX^{\dagger}$, where $X$ stands for a nonhermitian random matrix. In particular, making use of the Cauchy transform, we study free multiplicative powers of the Marchenko-Pastur (MP) distribution, ${\rm MP}^{\boxtimes s}$, which for an integer $s$ yield Fuss-Catalan distributions corresponding to a product of $s$ independent square random matrices, $X=X_1\cdots X_s$. New formulae for the level densities are derived for $s=3$ and $s=1/3$. Moreover, the level density corresponding t…
Wishart ensembles of random matrix theory have been useful in modeling positive definite matrices encountered in classical and quantum chaotic systems. We consider nonzero means for the entries of the constituting matrix A which defines the correlated Wishart matrix as W = AA†, and refer to the ensemble of such Wishart matrices as the non-central correlated Wishart ensemble (nc-CWE). We derive the Pastur self-consistent equation which describes the spectral density of nc-CWE at large matrix dimension.
Wishart correlation matrices are the standard model for the statistical analysis of time series. The ensemble averaged eigenvalue density is of considerable practical and theoretical interest. For complex time series and correlation matrices, the eigenvalue density is known exactly. In the real case, however, a fundamental mathematical obstacle made it forbidingly complicated to obtain exact results. We use the supersymmetry method to fully circumvent this problem. We present an exact formula for the eigenvalue density in the real case in terms of twofold integrals and finite sums.
We collect explicit and user-friendly expressions for one-point densities of the real eigenvalues $\{λ_i\}$ of $N\times N$ Wishart-Laguerre and Jacobi random matrices with orthogonal, unitary and symplectic symmetry. Using these formulae, we compute integer moments $τ_n=<\sum_{i=1}^Nλ_i^n>$ for all symmetry classes without any large $N$ approximation. In particular, our results provide exact expressions for moments of transmission eigenvalues in chaotic cavities with time-reversal or spin-flip symmetry and supporting a finite and arbitrary number of electronic channels in the two incoming lead…
We discuss a practical method to determine the eigenvalue spectrum of the empirical correlation matrix. The method is based on the analysis of the behavior of a conformal map at a critical horizon which is defined as a border line of the physical Riemann sheet of this map. The map is a convenient representation of the Marčenko-Pastur equation.
We introduce a one-parameter deformation of the Wishart-Laguerre or chiral ensembles of positive definite random matrices with Dyson index beta=1,2 and 4. Our generalised model has a fat-tailed distribution while preserving the invariance under orthogonal, unitary or symplectic transformations. The spectral properties are derived analytically for finite matrix size NxM for all three beta, in terms of the orthogonal polynomials of the standard Wishart-Laguerre ensembles. For large-N in a certain double scaling limit we obtain a generalised Marcenko-Pastur distribution on the macroscopic scale, …
The eigenvalue statistics for complex $N \times N$ Wishart matrices $X_{r,s}^\dagger X_{r,s}$, where $ X_{r,s}$ is equal to the product of $r$ complex Gaussian matrices, and the inverse of $s$ complex Gaussian matrices, are considered. In the case $r=s$ the exact form of the global density is computed. The averaged characteristic polynomial for the corresponding generalized eigenvalue problem is calculated in terms of a particular generalized hypergeometric function ${}_{s+1} F_r$. For finite $N$ the eigenvalue probability density function is computed, and is shown to be an example of a biorth…
We consider ensembles of Gaussian (Hermite) and Wishart (Laguerre) $N\times N$ hermitian matrices. We study the effect of finite rank perturbations of these ensembles by a source term. The rank $r$ of the perturbation corresponds to the number of non-null eigenvalues of the source matrix. In the perturbed ensembles, the correlation functions can be written in terms of kernels. We show that for all $N$, the difference between the perturbed and the unperturbed kernels is a degenerate kernel of size $r$ which depends on multiple Hermite or Laguerre functions. We also compute asymptotic formulas f…
We compare finite rank perturbations of the following three ensembles of complex rectangular random matrices: First, a generalised Wishart ensemble with one random and two fixed correlation matrices introduced by Borodin and Péché, second, the product of two independent random matrices where one has correlated entries, and third, the case when the two random matrices become also coupled through a fixed matrix. The singular value statistics of all three ensembles is shown to be determinantal and we derive double contour integral representations for their respective kernels. Three different kern…
A Wishart matrix is said to be spiked when the underlying covariance matrix has a single eigenvalue $b$ different from unity. As $b$ increases through $b=2$, a gap forms from the largest eigenvalue to the rest of the spectrum, and with $b-2$ of order $N^{-1/3}$ the scaled largest eigenvalues form a well defined parameter dependent state. Recent works by Bloemendal and Virág [BV], and Mo, have quantified this parameter dependent state for real Wishart matrices from different viewpoints, and the former authors have done similarly for the spiked Wishart $β$-ensemble. The latter is defined in term…
We give formulae for the cumulants of complex Wishart (LUE) and inverse Wishart matrices (inverse LUE). Their large-$N$ expansions are generating functions of double (strictly and weakly) monotone Hurwitz numbers which count constrained factorisations in the symmetric group. The two expansions can be compared and combined with a duality relation proved in [F. D. Cunden, F. Mezzadri, N. O'Connell and N. J. Simm, arXiv:1805.08760] to obtain: i) a combinatorial proof of the reflection formula between moments of LUE and inverse LUE at genus zero and, ii) a new functional relation between the gener…
The statistics of the smallest eigenvalue of Wishart-Laguerre ensemble is important from several perspectives. The smallest eigenvalue density is typically expressible in terms of determinants or Pfaffians. These results are of utmost significance in understanding the spectral behavior of Wishart-Laguerre ensembles and, among other things, unveil the underlying universality aspects in the asymptotic limits. However, obtaining exact and explicit expressions by expanding determinants or Pfaffians becomes impractical if large dimension matrices are involved. For the real matrices ($β=1$) Edelman …
The aim of this note is to provide a pedagogical survey of the recent works by the authors ( arXiv:1409.7548 and arXiv:1507.06013) concerning the local behavior of the eigenvalues of large complex correlated Wishart matrices at the edges and cusp points of the spectrum: Under quite general conditions, the eigenvalues fluctuations at a soft edge of the limiting spectrum, at the hard edge when it is present, or at a cusp point, are respectively described by mean of the Airy kernel, the Bessel kernel, or the Pearcey kernel. Moreover, the eigenvalues fluctuations at several soft edges are asymptot…
Data sets collected at different times and different observing points can possess correlations at different times $and$ at different positions. The doubly correlated Wishart model takes both into account. We calculate the eigenvalue density of the Wishart correlation matrices using supersymmetry. In the complex case we obtain a new closed form expression which we compare to previous results in the literature. In the more relevant and much more complicated real case we derive an expression for the density in terms of a fourfold integral. Finally, we calculate the density in the limit of large c…
Using Beck and Cohen's superstatistics, we introduce in a systematic way a family of generalised Wishart-Laguerre ensembles of random matrices with Dyson index $β$ = 1,2, and 4. The entries of the data matrix are Gaussian random variables whose variances $η$ fluctuate from one sample to another according to a certain probability density $f(η)$ and a single deformation parameter $γ$. Three superstatistical classes for $f(η)$ are usually considered: $χ^2$-, inverse $χ^2$- and log-normal-distributions. While the first class, already considered by two of the authors, leads to a power-law decay of …
We study the probability distribution function (PDF) of the smallest eigenvalue of Laguerre-Wishart matrices $W = X^\dagger X$ where $X$ is a random $M \times N$ ($M \geq N$) matrix, with complex Gaussian independent entries. We compute this PDF in terms of semi-classical orthogonal polynomials, which are deformations of Laguerre polynomials. By analyzing these polynomials, and their associated recurrence relations, in the limit of large $N$, large $M$ with $M/N \to 1$ -- i.e. for quasi-square large matrices $X$ -- we show that this PDF, in the hard edge limit, can be expressed in terms of the…
We study a system of $N$ non-intersecting $(1+1)$-dimensional fluctuating elastic interfaces (`vicious bridges') at thermal equilibrium, each subject to periodic boundary condition in the longitudinal direction and in presence of a substrate that induces an external confining potential for each interface. We show that, for a large system and with an appropriate choice of the external confining potential, the joint distribution of the heights of the $N$ non-intersecting interfaces at a fixed point on the substrate can be mapped to the joint distribution of the eigenvalues of a Wishart matrix of…
The Wishart model of random covariance or correlation matrices continues to find ever more applications as the wealth of data on complex systems of all types grows. The heavy tails often encountered prompt generalizations of the Wishart model, involving algebraic distributions instead of a Gaussian. The mathematical properties pose new challenges, particularly for the doubly correlated versions. Here we investigate such a doubly correlated algebraic model for real covariance or correlation matrices. We focus on the matrix moments and explicitly calculate the first and the second one, the compu…
We study the diffusion of complex Wishart matrices and derive a partial differential equation governing the behavior of the associated averaged characteristic polynomial. In the limit of large size matrices, the inverse Cole-Hopf transform of this polynomial obeys a nonlinear partial differential equation whose solutions exhibit shocks at the evolving edges of the eigenvalue spectrum. In a particular scenario one of those shocks hits the origin that plays the role of an impassable wall. To investigate the universal behavior in the vicinity of this wall, a critical point, we derive an integral …
In the present work, eigenvalue distributions defined by a random rectangular matrix whose components are neither independently nor identically distributed are analyzed using replica analysis and belief propagation. In particular, we consider the case in which the components are independently but not identically distributed; for example, only the components in each row or in each column may be {identically distributed}. We also consider the more general case in which the components are correlated with one another. We use the replica approach while making only weak assumptions in order to deter…
The product of M complex random Gaussian matrices of size N has recently been studied by Akemann, Kieburg and Wei. They showed that, for fixed M and N, the joint probability distribution for the squared singular values of the product matrix forms a determinantal point process with a correlation kernel determined by certain biorthogonal polynomials that can be explicitly constructed. We find that, in the case M=2, the relevant biorthogonal polynomials are actually special cases of multiple orthogonal polynomials associated with Macdonald functions (modified Bessel functions of the second kind) …
We compute analytically, for large $N$, the probability $\mathcal{P}(N_+,N)$ that a $N\times N$ Wishart random matrix has $N_+$ eigenvalues exceeding a threshold $Nζ$, including its large deviation tails. This probability plays a benchmark role when performing the Principal Component Analysis of a large empirical dataset. We find that $\mathcal{P}(N_+,N)\approx\exp(-βN^2 ψ_ζ(N_+/N))$, where $β$ is the Dyson index of the ensemble and $ψ_ζ(κ)$ is a rate function that we compute explicitly in the full range $0\leq κ\leq 1$ and for any $ζ$. The rate function $ψ_ζ(κ)$ displays a quadratic behavior …
We study {the} complex eigenvalues of the Wishart model defined for nonsymmetric correlation matrices. The model is defined for two statistically equivalent but different Gaussian real matrices, as $\mathsf{C}=\mathsf{AB}^{t}/T$, where $\mathsf{B}^{t}$ is the transpose of $\mathsf{B}$ and both matrices $\mathsf{A}$ and $\mathsf{B}$ are of dimension $N\times T$. We consider {\it actual} correlations between the matrices so that on the ensemble average $\mathsf{C}$ does not vanish. We derive a loop equation for the spectral density of $\mathsf{C}$ in {the} large $N$ and $T$ limit where the ratio…
We compute the spectral statistics of the sum H of two independent complex Wishart matrices, each of which is correlated with a different covariance matrix. Random matrix theory enjoys many applications including sums and products of random matrices. Typically ensembles with correlations among the matrix elements are much more difficult to solve. Using a combination of supersymmetry, superbosonisation and bi-orthogonal functions we are able to determine all spectral k-point density correlation functions of H for arbitrary matrix size N. In the half-degenerate case, when one of the covariance m…
Rectangular real $N \times (N + ν)$ matrices $W$ with a Gaussian distribution appear very frequently in data analysis, condensed matter physics and quantum field theory. A central question concerns the correlations encoded in the spectral statistics of $WW^T$. The extreme eigenvalues of $W W^T$ are of particular interest. We explicitly compute the distribution and the gap probability of the smallest non-zero eigenvalue in this ensemble, both for arbitrary fixed $N$ and $ν$, and in the universal large $N$ limit with $ν$ fixed. We uncover an integrable Pfaffian structure valid for all even value…
We briefly review the solution of three ensembles of non-Hermitian random matrices generalizing the Wishart-Laguerre (also called chiral) ensembles. These generalizations are realized as Gaussian two-matrix models, where the complex eigenvalues of the product of the two independent rectangular matrices are sought, with the matrix elements of both matrices being either real, complex or quaternion real. We also present the more general case depending on a non-Hermiticity parameter, that allows us to interpolate between the corresponding three Hermitian Wishart ensembles with real eigenvalues and…
We show that quaternionic Gaussian random variables satisfy a generalization of the Wick formula for computing the expected value of products in terms of a family of graphical enumeration problems. When applied to the quaternionic Wigner and Wishart families of random matrices the result gives the duality between moments of these families and the corresponding real Wigner and Wishart families.
Consider the product of $M$ quadratic random matrices with complex elements and no further symmetry, where all matrix elements of each factor have a Gaussian distribution. This generalises the classical Wishart-Laguerre Gaussian Unitary Ensemble with M=1. In this paper we first compute the joint probability distribution for the singular values of the product matrix when the matrix size $N$ and the number $M$ are fixed but arbitrary. This leads to a determinantal point process which can be realised in two different ways. First, it can be written as a one-matrix singular value model with a non-s…
The correlated Wishart model provides a standard tool for the analysis of correlations in a rich variety of systems. Although much is known for complex correlation matrices, the empirically much more important real case still poses substantial challenges. We put forward a new approach, which maps arbitrary statistical quantities, depending on invariants only, to invariant Hermitian matrix models. For completeness we also include the quaternion case and deal with all three cases in a unified way. As an important application, we study the statistics of the largest eigenvalue and its limiting dis…
The random variable $1+z_1+z_1z_2+\dots$ appears in many contexts and was shown by Kesten to exhibit a heavy tail distribution. We consider natural extensions of this variable and its associated recursion to $N \times N$ matrices either real symmetric $β=1$ or complex Hermitian $β=2$. In the continuum limit of this recursion, we show that the matrix distribution converges to the inverse-Wishart ensemble of random matrices. The full dynamics is solved using a mapping to $N$ fermions in a Morse potential, which are non-interacting for $β=2$. At finite $N$ the distribution of eigenvalues exhibits…
For the correlated Gaussian Wishart ensemble we compute the distribution of the smallest eigenvalue and a related gap probability.We obtain exact results for the complex (β=2) and for the real case (β=1). For a particular set of empirical correlation matrices we find universality in the spectral density, for both real and complex ensembles and all kinds of rectangularity. We calculate the asymptotic and universal results for the gap probability and the distribution of the smallest eigenvalue. We use the Supersymmetry method, in particular the generalized Hubbard-Stratonovich transformation and…
