The spiked model is an important special case of the Wishart ensemble, and a natural generalization of the white Wishart ensemble. Mathematically, it can be defined on three kinds of variables: the real, the complex and the quaternion. For practical application, we are interested in the limiting distribution of the largest sample eigenvalue.
We first give a new proof of the result of Baik, Ben Arous and Péché for the complex spiked model, based on the method of multiple orthogonal polynomials by Bleher and Kuijlaars. Then in the same spirit we present a new result of the rank 1 quaternionic spiked model, proven by combinatorial identities involving quaternionic Zonal polynomials (α= 1/2 Jack polynomials) and skew orthogonal polynomials.
We find a phase transition phenomenon for the limiting distribution in the rank 1 quaternionic spiked model as the spiked population eigenvalue increases, and recognize the seemingly new limiting distribution on the critical point as the limiting distribution of the largest sample eigenvalue in the real white Wishart ensemble.
Finally we give conjectures for higher rank quaternionic spiked model and the real spiked model.
We solve the largest sample eigenvalue distribution problem in the rank 1 spiked model of the quaternionic Wishart ensemble, which is the first case of a statistical generalization of the Laguerre symplectic ensemble (LSE) on the soft edge. We observe a phase change phenomenon similar to that in the complex case, and prove that the new distribution at the phase change point is the GOE Tracy--Widom distribution.
This is the first part of a paper that studies the phase transition in the asymptotic limit of the rank 1 real Wishart spiked model. In this paper, we consider $N$-dimensional real Wishart matrices $S$ in the class $W_{\mathbb{R}}\left(Σ,M\right)$ in which all but one eigenvalues of $Σ$ is $1$. Let the non-trivial eigenvalue of $Σ$ be $1+τ$, then as $N$, $M\rightarrow\infty$, with $N/M=γ^2$ finite and non-zero, the eigenvalue distribution of $S$ will converge into the Machenko-Pastur distribution inside a bulk region. As $τ$ increases from zero, one starts seeing stray eigenvalues of $S$ outsi…
In this paper, we consider N-dimensional real Wishart matrices Y in the class $W_{\mathbb{R}}(Σ,M)$ in which all but one eigenvalues of $Σ$ is 1. Let the non-trivial eigenvalue of $Σ$ be $1+τ$, then as N, $M\rightarrow\infty$, with $M/N=γ^2$ finite and non-zero, the eigenvalue distribution of $Y$ will converge into the Marchenko-Pastur distribution inside a bulk region. When $τ$ increases from zero, one starts to see a stray eigenvalue of Y outside of the support of the Marchenko-Pastur density. As the this stray eigenvalue leaves the bulk region, a phase transition will occur in the largest e…
Let $\mathbf{X}\in\mathbb{C}^{n\times m}$ ($m\geq n$) be a random matrix with independent columns each distributed as complex multivariate Gaussian with zero mean and {\it single-spiked} covariance matrix $\mathbf{I}_n+ η\mathbf{u}\mathbf{u}^*$, where $\mathbf{I}_n$ is the $n\times n$ identity matrix, {\color{blue}$\mathbf{u}\in\mathbb{C}^{n\times 1}$} is an arbitrary vector with unit Euclidean norm, $η\geq 0$ is a non-random parameter, and $(\cdot)^*$ represents the conjugate-transpose. This paper investigates the distribution of the random quantity $κ_{\text{SC}}^2(\mathbf{X})=\sum_{k=1}^n λ…
Let $\mathbf{W}\in\mathbb{C}^{n\times n}$ be a {\it single-spiked} Wishart matrix in the class $\mathbf{W}\sim \mathcal{CW}_n(m,\mathbf{I}_n+ θ\mathbf{v}\mathbf{v}^\dagger) $ with $m\geq n$, where $\mathbf{I}_n$ is the $n\times n$ identity matrix, $\mathbf{v}\in\mathbb{C}^{n\times 1}$ is an arbitrary vector with unit Euclidean norm, $θ\geq 0$ is a non-random parameter, and $(\cdot)^\dagger$ represents the conjugate-transpose operator. Let $\mathbf{u}_1$ and $\mathbf{u}_n$ denote the eigenvectors corresponding to the samllest and the largest eigenvalues of $\mathbf{W}$, respectively. This paper…
This paper proves a matrix model for the Wishart Ensemble with general covariance and general dimension parameter beta. In so doing, we introduce a new and elegant definition of Jack polynomials.
In this paper we study the limiting distribution of the $k$ smallest gaps between eigenvalues of three kinds of random matrices -- the Ginibre ensemble, the Wishart ensemble and the universal unitary ensemble. All of them follow a Poissonian ansatz. More precisely, for the Ginibre ensemble we have a global result in which the $k$-th smallest gap has typical length $n^{-3/4}$ with density $x^{4k-1}e^{-x^4}$ after normalization. For the Wishart and the universal unitary ensemble, it has typical length $n^{-4/3}$ and has density $x^{3k-1}e^{-x^3}$ after normalization.
This paper concentrates on asymptotic properties of determinants of some random symmetric matrices. If B_{n,r} is a n x r rectangular matrix and B_{n,r}' its transpose, we study det (B_{n,r}'B_{n,r}) when n,r tends to infinity with r/n \to c\in (0,1). The r column vectors of B_{n,r} are chosen independently, with common distribution ν_n. The Wishart ensemble corresponds to ν_n = {\cal N}(0, I_n), the standard normal distribution. We call uniform Gram ensemble the ensemble corresponding to ν_n = σ_n, the uniform distribution on the unit sphere `S_{n-1}. In the Wishart ensemble, a well known Bar…
We studied universality of Wishart ensembles whose covariance matrix has 2 distinct eigenvalues and the number of each of these eigenvalue goes to infinity in the asymptotic limit. In this case, the limiting eigenvalue distribution can be supported on 1 or 2 disjoint intervals. In our previous work the case when the support consists of 2 intervals was studied. This paper complements our previous analysis and studied the case when the support consists of a single interval. By using Riemann-Hilbert analysis, we have shown that under proper rescaling of the eigenvalues, the limiting correlation k…
We studied the universality of Wishart ensembles whose covariance matrix has 2 distinct eigenvalues. We studied the asymptotic limit when the number of both eigenvalues goes to infinity and obtained universality results. In this case, the limiting eigenvalue distribution can be supported on 1 or 2 disjoint intervals. We obtained a necessary and sufficient condition on the parameters such that the limiting distribution is supported on 2 disjoint intervals and have computed the eigenvalue density in the limit. Furthermore, by using Riemann-Hilbert analysis, we have shown that under proper rescal…
A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, introduced by Johnstone, in which a prominent eigenvector (or "spike") is planted into a random matrix. These distributions form natural statistical models for principal component analysis (PCA) problems throughout the sciences. Baik, Ben Arous and Peche showed that the spiked Wishart ensemble exhibits a sharp phase transition asymptotically: when the spike strength is above a critical threshold, it is possible to detect the presence of a spike based on the top eigenvalue, and below the t…
Given a large, high-dimensional sample from a spiked population, the top sample covariance eigenvalue is known to exhibit a phase transition. We show that the largest eigenvalues have asymptotic distributions near the phase transition in the rank-one spiked real Wishart setting and its general beta analogue, proving a conjecture of Baik, Ben Arous and Péché (2005). We also treat shifted mean Gaussian orthogonal and beta ensembles. Such results are entirely new in the real case; in the complex case we strengthen existing results by providing optimal scaling assumptions. One obtains the known li…
Vinberg cones and the ambient vector spaces are important in modern statistics of sparse models and of graphical models. The aim of this paper is to study eigenvalue distributions of Gaussian, Wigner and covariance matrices related to growing Vinberg matrices, corresponding to growing daisy graphs. For Gaussian or Wigner ensembles, we give an explicit formula for the limiting distribution. For Wishart ensembles defined naturally on Vinberg cones, their limiting Stieltjes transforms, support and atom at 0 are described explicitly in terms of the Lambert-Tsallis functions, which are defined by u…
We consider matrices formed by a random $N\times N$ matrix drawn from the Gaussian Orthogonal Ensemble (or Gaussian Unitary Ensemble) plus a rank-one perturbation of strength $θ$, and focus on the largest eigenvalue, $x$, and the component, $u$, of the corresponding eigenvector in the direction associated to the rank-one perturbation. We obtain the large deviation principle governing the atypical joint fluctuations of $x$ and $u$. Interestingly, for $θ>1$, in large deviations characterized by a small value of $u$, i.e. $u<1-1/θ$, the second-largest eigenvalue pops out from the Wigner semi-circ…
A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal component analysis (PCA) problems throughout the sciences. Baik, Ben Arous and Péché showed that the spiked Wishart ensemble exhibits a sharp phase transition asymptotically: when the signal strength is above a critical threshold, it is possible to detect the presence of a spike based on the top eigenvalue, and below the threshold the top eigenvalue provides …
We access the edge of Gaussian beta ensembles with one spike by analyzing high powers of the associated tridiagonal matrix models. In the classical cases beta=1, 2, 4, this corresponds to studying the fluctuations of the largest eigenvalues of additive rank one perturbations of the GOE/GUE/GSE random matrices. In the infinite-dimensional limit, we arrive at a one-parameter family of random Feynman-Kac type semigroups, which features the stochastic Airy semigroup of Gorin and Shkolnikov [13] as an extreme case. Our analysis also provides Feynman-Kac formulas for the spiked stochastic Airy opera…
We show how the replica method can be used to compute the asymptotic eigenvalue spectrum of a real Wishart product matrix. For unstructured factors, this provides a compact, elementary derivation of a polynomial condition on the Stieltjes transform first proved by Müller [IEEE Trans. Inf. Theory. 48, 2086-2091 (2002)]. We then show how this computation can be extended to ensembles where the factors are drawn from matrix Gaussian distributions with general correlation structure. For both unstructured and structured ensembles, we derive polynomial conditions on the average values of the minimum …
We construct a diffusive matrix model for the $β$-Wishart (or Laguerre) ensemble for general continuous $β\in [0,2]$, which preserves invariance under the orthogonal/unitary group transformation. Scaling the Dyson index $β$ with the largest size $M$ of the data matrix as $β=2c/M$ (with $c$ a fixed positive constant), we obtain a family of spectral densities parametrized by $c$. As $c$ is varied, this density interpolates continuously between the Mar\vcenko-Pastur ($c\to \infty$ limit) and the Gamma law ($c\to 0$ limit). Analyzing the full Stieltjes transform (resolvent) equation, we obtain as …
The complex elliptic Ginibre ensemble with coupling $τ$ is a complex Gaussian matrix interpolating between the Gaussian Unitary Ensemble (GUE) and the Ginibre ensemble. It has been known for some time that its eigenvalues form a determinantal point process in the complex plane. A recent result of Kanazawa and Kieburg (arXiv:1804.03985) shows that the singular values form a Pfaffian point process. In this paper we turn to consider an extended elliptic Ginibre ensemble, which connects the GUE and the spiked Wishart matrix, and prove that the singular values still build a Pfaffian point process w…
Consider the classical Gaussian unitary ensemble of size $N$ and the real Wishart ensemble $W_N(n,I)$. In the limits as $N \to \infty$ and $N/n \to γ> 0$, the expected number of eigenvalues that exit the upper bulk edge is less than one, 0.031 and 0.170 respectively, the latter number being independent of $γ$. These statements are consequences of quantitative bounds on tail sums of eigenvalues outside the bulk which are established here for applications in high dimensional covariance matrix estimation.
The top eigenvalues of rank $r$ spiked real Wishart matrices and additively perturbed Gaussian orthogonal ensembles are known to exhibit a phase transition in the large size limit. We show that they have limiting distributions for near-critical perturbations, fully resolving the conjecture of Baik, Ben Arous and Péché [Duke Math. J. (2006) 133 205-235]. The starting point is a new $(2r+1)$-diagonal form that is algebraically natural to the problem; for both models it converges to a certain random Schrödinger operator on the half-line with $r\times r$ matrix-valued potential. The perturbation d…
Beta Laguerre ensembles which are generalizations of Wishart ensembles and Laguerre ensembles can be realized as eigenvalues of certain random tridiagonal matrices. Analogous to the Wishart ($β=1$) case and the Laguerre ($β= 2$) case, for fixed $β$, it is known that the empirical distribution of the eigenvalues of these ensembles converges weakly to Marchenko--Pastur distributions, almost surely. The paper restudies the limiting behavior of the empirical distribution but in regimes where the parameter $β$ is allowed to vary as a function of the matrix size $N$. We show that the above Marchenko…
This paper constructs tridiagonal random matrix models for general ($β>0$) $β$-Hermite (Gaussian) and $β$-Laguerre (Wishart) ensembles. These generalize the well-known Gaussian and Wishart models for $β= 1,2,4$. Furthermore, in the cases of the $β$-Laguerre ensembles, we eliminate the exponent quantization present in the previously known models. We further discuss applications for the new matrix models, and present some open problems.
We characterize the limiting smallest eigenvalue distributions (or hard edge laws) for sample covariance type matrices drawn from a spiked population. In the case of a single spike, the results are valid in the context of the general beta ensembles. For multiple spikes, the necessary construction restricts matters to real, complex or quaternion (beta=1, 2, or 4) ensembles. The limit laws are described in terms of a random integral operators, and partial differential equations satisfied by the corresponding distribution functions are derived as corollaries. We also show that, under a natural li…
We derive a Central Limit Theorem (CLT) for $\log \left\vert\det \left( W_{N}-E_{N}\right)\right\vert,$ where $W_{N}$ is a Wigner matrix, and $E_{N}$ is local to the edge of the semi-circle law. Precisely, $E_N=2+N^{-2/3}σ_N$ with $σ_N$ being either a constant (possibly negative), or a sequence of positive real numbers, slowly diverging to infinity so that $σ_N \ll \log^{2} N$. We also extend our CLT to cover spiked Wigner matrices. Our interest in the CLT is motivated by its applications to statistical testing in critically spiked models and to the fluctuations of the free energy in the spher…
The random variable $1+z_1+z_1z_2+\dots$ appears in many contexts and was shown by Kesten to exhibit a heavy tail distribution. We consider natural extensions of this variable and its associated recursion to $N \times N$ matrices either real symmetric $β=1$ or complex Hermitian $β=2$. In the continuum limit of this recursion, we show that the matrix distribution converges to the inverse-Wishart ensemble of random matrices. The full dynamics is solved using a mapping to $N$ fermions in a Morse potential, which are non-interacting for $β=2$. At finite $N$ the distribution of eigenvalues exhibits…
We consider high dimensional Wishart matrices $\mathbb{X} \mathbb{X}^{\top}$ where the entries of $\mathbb{X} \in {\mathbb{R}^{n \times d}}$ are i.i.d. from a log-concave distribution. We prove an information theoretic phase transition: such matrices are close in total variation distance to the corresponding Gaussian ensemble if and only if $d$ is much larger than $n^3$. Our proof is entropy-based, making use of the chain rule for relative entropy along with the recursive structure in the definition of the Wishart ensemble. The proof crucially relies on the well known relation between Fisher i…
We consider the beta-Laguerre ensemble, a family of distributions generalizing the joint eigenvalue distribution of the Wishart random matrices. We show that the bulk scaling limit of these ensembles exists for all beta>0 for a general family of parameters and it is the same as the bulk scaling limit of the corresponding beta-Hermite ensemble.
We derive Painlevé--type expressions for the distribution of the $m^{th}$ largest eigenvalue in the Gaussian Orthogonal and Symplectic Ensembles in the edge scaling limit. The work of Johnstone and Soshnikov (see [7], [10]) implies the immediate relevance of our formulas for the $m^{th}$ largest eigenvalue of the appropriate Wishart distribution.
This paper deals with the existence issue of non-central Wishart distributions which is a research topic initiated by Wishart (1928), and with important contributions by e.g., Lévy (1937), Gindikin (1975), Shanbhag (1988), Peddada and Richards (1991). We present a new method involving the theory of affine Markov processes, which reveals joint necessary conditions on shape and non-centrality parameter. While Eaton's conjecture concerning the necessary range of the shape parameter is confirmed, we also observe that it is not sufficient anymore that it only belongs to the Gindikin ensemble, as is…
We investigate the random eigenvalues coming from the beta-Laguerre ensemble with parameter p, which is a generalization of the real, complex and quaternion Wishart matrices of parameter (n,p). In the case that the sample size n is much smaller than the dimension of the population distribution p, a common situation in modern data, we approximate the beta-Laguerre ensemble by a beta-Hermite ensemble which is a generalization of the real, complex and quaternion Wigner matrices. As corollaries, when n is much smaller than p, we show that the largest and smallest eigenvalues of the complex Wishart…
The product of M complex random Gaussian matrices of size N has recently been studied by Akemann, Kieburg and Wei. They showed that, for fixed M and N, the joint probability distribution for the squared singular values of the product matrix forms a determinantal point process with a correlation kernel determined by certain biorthogonal polynomials that can be explicitly constructed. We find that, in the case M=2, the relevant biorthogonal polynomials are actually special cases of multiple orthogonal polynomials associated with Macdonald functions (modified Bessel functions of the second kind) …
We study the fluctuations of linear statistics with polynomial test functions for Multiple Orthogonal Polynomial Ensembles. Multiple Orthogonal Polynomial Ensembles form an important class of determinantal point processes that include random matrix models such as the GUE with external source, complex Wishart matrices, multi-matrix models and others. Our analysis is based on the recurrence matrix for the multiple orthogonal polynomials, that is constructed out of the nearest neighbor recurrences. If the coefficients for the nearest neighbor recurrences have limits, then we show that the right-l…
We derive Painlevé--type expressions for the distribution of the $m^{th}$ largest eigenvalue in the Gaussian Orthogonal and Symplectic Ensembles in the edge scaling limit. This work generalizes to general $m$ the $m=1$ results of Tracy and Widom [23]. The results of Johnstone and Soshnikov (see [15], [19]) imply the immediate relevance of our formulas for the $m^{th}$ largest eigenvalue of the appropriate Wishart distribution.
The paper studies the limiting behavior of spectral measures of random Jacobi matrices of Gaussian, Wishart and MANOVA beta ensembles. We show that the spectral measures converge weakly to a limit distribution which is the semicircle distribution, Marchenko-Pastur distributions or Kesten-Mckey distributions, respectively. The Gaussian fluctuation around the limit is then investigated.
We find the joint generalized singular value distribution and largest generalized singular value distributions of the $β$-MANOVA ensemble with positive diagonal covariance, which is general. This has been done for the continuous $β> 0$ case for identity covariance (in eigenvalue form), and by setting the covariance to $I$ in our model we get another version. For the diagonal covariance case, it has only been done for $β= 1,2,4$ cases (real, complex, and quaternion matrix entries). This is in a way the first second-order $β$-ensemble, since the sampler for the generalized singular values of the…
The complex Wishart ensemble is the statistical ensemble of $M \times N$ complex random matrices with $M \geq N$ such that the real and imaginary parts of each element are given by independent standard normal variables. The Marcenko--Pastur (MP) density $ρ(x; r), x \geq 0$ describes the distribution for squares of the singular values of the random matrices in this ensemble in the scaling limit $N \to \infty$, $M \to \infty$ with a fixed rectangularity $r=N/M \in (0, 1]$. The dynamical extension of the squared-singular-value distribution is realized by the noncolliding squared Bessel process, a…
We present a combinatorial approach to the infinitesimal distribution of the Gaussian orthogonal ensemble (GOE). In particular we show how the infinitesimal moments are described by non-crossing partitions, but not of type B. We demonstrate the asymptotic infinitesimal freeness of independent complex Wishart matrices. With the combinatorial picture we can easily compute the infinitesimal cumulants of the GOE and demonstrate the lack of asymptotic infinitesimal freeness of independent GOE ensembles. I have added a new figure and some additional explanatory remarks. This update corrects a number…
We survey a number of models from physics, statistical mechanics, probability theory and combinatorics, which are each described in terms of an orthogonal polynomial ensemble. The most prominent example is apparently the Hermite ensemble, the eigenvalue distribution of the Gaussian Unitary Ensemble (GUE), and other well-known ensembles known in random matrix theory like the Laguerre ensemble for the spectrum of Wishart matrices. In recent years, a number of further interesting models were found to lead to orthogonal polynomial ensembles, among which the corner growth model, directed last passa…
It has been recently shown that if $X$ is an $n\times N$ matrix whose entries are i.i.d. standard complex Gaussian and $l_1$ is the largest eigenvalue of $X^*X$, there exist sequences $m_{n,N}$ and $s_{n,N}$ such that $(l_1-m_{n,N})/s_{n,N}$ converges in distribution to $W_2$, the Tracy--Widom law appearing in the study of the Gaussian unitary ensemble. This probability law has a density which is known and computable. The cumulative distribution function of $W_2$ is denoted $F_2$. In this paper we show that, under the assumption that $n/N\to γ\in(0,\infty)$, we can find a function $M$, continu…
Let $A$ and $B$ be independent, central Wishart matrices in $p$ variables with common covariance and having $m$ and $n$ degrees of freedom, respectively. The distribution of the largest eigenvalue of $(A+B)^{-1}B$ has numerous applications in multivariate statistics, but is difficult to calculate exactly. Suppose that $m$ and $n$ grow in proportion to $p$. We show that after centering and scaling, the distribution is approximated to second-order, $O(p^{-2/3})$, by the Tracy--Widom law. The results are obtained for both complex and then real-valued data by using methods of random matrix theory …
We introduce real second-order freeness in second-order noncommutative probability spaces. We demonstrate that under this definition, three real models of random matrices, namely real Ginibre matrices, Gaussian orthogonal matrices, and real Wishart matrices, are asymptotically second-order free. These ensembles do not satisfy the complex definition of second-order freeness satisfied by their complex analogues. We use a combinatorial approach to the matrix calculations similar to the genus expansion for complex random matrices, but in which nonorientable surfaces appear, demonstrating the commo…
Recently subclasses of polynomial ensembles for additive and multiplicative matrix convolutions were identified which were called Pólya ensembles (or polynomial ensembles of derivative type). Those ensembles are closed under the respective convolutions and, thus, build a semi-group when adding by hand a unit element. They even have a semi-group action on the polynomial ensembles. Moreover in several works transformations of the bi-orthogonal functions and kernels of a given polynomial ensemble were derived when performing an additive or multiplicative matrix convolution with particular Pólya e…
