In a spiked population model, the population covariance matrix has all its eigenvalues equal to units except for a few fixed eigenvalues (spikes). This model is proposed by Johnstone to cope with empirical findings on various data sets. The question is to quantify the effect of the perturbation caused by the spike eigenvalues. A recent work by Baik and Silverstein establishes the almost sure limits of the extreme sample eigenvalues associated to the spike eigenvalues when the population and the sample sizes become large. This paper establishes the limiting distributions of these extreme sample eigenvalues. As another important result of the paper, we provide a central limit theorem on random sesquilinear forms.
We solve the largest sample eigenvalue distribution problem in the rank 1 spiked model of the quaternionic Wishart ensemble, which is the first case of a statistical generalization of the Laguerre symplectic ensemble (LSE) on the soft edge. We observe a phase change phenomenon similar to that in the complex case, and prove that the new distribution at the phase change point is the GOE Tracy--Widom distribution.
In this paper, we consider a data matrix $X\in\mathbb{C}^{N\times M}$ where all the columns are i.i.d. samples being $N$ dimensional complex Gaussian of mean zero and covariance $Σ\in\mathbb{C}^{N\times N}$. Here the population matrix $Σ$ is of finite rank perturbation of the identity matrix. This is the "spiked population model" first proposed by Johnstone in \cite{21}. As $M, N\to\infty$ but $M/N = γ\in(1, \infty)$, we first establish in this paper the asymptotic distribution of the smallest eigenvalue of the sample covariance matrix $S:= XX^*/M$. It also exhibits a phase transition phenomen…
We consider an Information-Plus-Noise type matrix where the Information matrix is a spiked matrix. When some eigenvalues of the random matrix separate from the bulk, we study how the corresponding eigenvectors project onto those of the spikes. Note that, in an Appendix, we present alternative versions of the earlier results of Bai and Silverstein about the lack of eigenvalues outside the support of the deterministic equivalent measure and of Capitaine about the exact separation phenomenon, where we remove some technical assumptions.
We investigate the asymptotic behavior of the eigenvalues of spiked perturbations of Wigner matrices when the dimension goes to infinity. The entries of the Hermitian Wigner matrix have a distribution which is symmetric and satisfies a Poincaré inequality. The perturbation matrix is a deterministic Hermitian matrix whose spectral measure converges to some probability measure with compact support. We assume that this perturbation matrix has a fixed number of fixed eigenvalues (spikes) outside the support of its limiting spectral measure whereas the distance between the other eigenvalues and thi…
In this paper, we consider a data matrix $X_N\in\mathbb{R}^{N\times p}$ where all the rows are i.i.d. samples in $\mathbb{R}^p$ of mean zero and covariance matrix $Σ\in\mathbb{R}^{p\times p}$. Here the population matrix $Σ$ is of finite rank perturbation of the identity matrix. This is the "spiked population model" first proposed by Johnstone. As $N, p\to\infty$ but $N/p \to γ\in(1, \infty)$, for the sample covariance matrix $S_N := X_NX_N^T/N$, we establish the joint distribution of the largest and the smallest few packs of eigenvalues. Inside each pack, they will behave the same as the eigen…
A class of robust estimators of scatter applied to information-plus-impulsive noise samples is studied, where the sample information matrix is assumed of low rank; this generalizes the study of (Couillet et al., 2013b) to spiked random matrix models. It is precisely shown that, as opposed to sample covariance matrices which may have asymptotically unbounded (eigen-)spectrum due to the sample impulsiveness, the robust estimator of scatter has bounded spectrum and may contain isolated eigenvalues which we fully characterize. We show that, if found beyond a certain detectability threshold, these …
When some eigenvalues of a spiked multiplicative resp. additive deformation model of a Hermitian Wigner matrix resp. a sample covariance matrix separate from the bulk, we study how the corresponding eigenvectors project onto those of the perturbation. We point out that the inverse of the subordination function relative to the free additive resp. multiplicative convolution plays an important part in the asymptotic behavior.
In this paper, we study the convergent limits and rates of the eigenvalues and eigenvectors for spiked sample covariance matrices whose spectrum can have multiple bulk components. Our model is an extension of Johnstone's spiked covariance matrix model. Based on our results, we can extend many statistical applications based on Johnstone's spiked covariance matrix model.
We consider a spiked population model, proposed by Johnstone, whose population eigenvalues are all unit except for a few fixed eigenvalues. The question is to determine how the sample eigenvalues depend on the non-unit population ones when both sample size and population size become large. This paper completely determines the almost sure limits for a general class of samples.
Let $\boldsymbolΣ_N$ be a $M \times N$ random matrix defined by $\boldsymbolΣ_N = \mathbf{B}_N + σ\mathbf{W}_N$ where $\mathbf{B}_N$ is a uniformly bounded deterministic matrix and where $\mathbf{W}_N$ is an independent identically distributed complex Gaussian matrix with zero mean and variance $\frac{1}{N}$ entries. The purpose of this paper is to study the almost sure location of the eigenvalues $\hatλ_{1,N} \geq ... \geq \hatλ_{M,N}$ of the Gram matrix ${\boldsymbol Σ}_N {\boldsymbol Σ}_N^*$ when $M$ and $N$ converge to $+\infty$ such that the ratio $c_N = \frac{M}{N}$ converges towards a c…
In this paper, we study the eigenvalues and eigenvectors of the spiked invariant multiplicative models when the randomness is from Haar matrices. We establish the limits of the outlier eigenvalues $\widehatλ_i$ and the generalized components ($\langle \mathbf{v}, \widehat{\mathbf{u}}_i \rangle$ for any deterministic vector $\mathbb{v}$) of the outlier eigenvectors $\widehat{\mathbf{u}}_i$ with optimal convergence rates. Moreover, we prove that the non-outlier eigenvalues stick with those of the unspiked matrices and the non-outlier eigenvectors are delocalized. The results also hold near the s…
In this paper, we derive a joint central limit theorem for random vector whose components are function of random sesquilinear forms. This result is a natural extension of the existing central limit theory on random quadratic forms. We also provide applications in random matrix theory related to large-dimensional spiked population models. For the first application, we find the joint distribution of grouped extreme sample eigenvalues correspond to the spikes. And for the second application, under the assumption that the population covariance matrix is diagonal with $k$ (fixed) simple spikes, we …
We consider large complex random sample covariance matrices obtained from "spiked populations", that is when the true covariance matrix is diagonal with all but finitely many eigenvalues equal to one. We investigate the limiting behavior of the largest eigenvalues when the population and the sample sizes both become large. Under some conditions on moments of the sample distribution, we prove that the asymptotic fluctuations of the largest eigenvalues are the same as for a complex Gaussian sample with the same true covariance. The real setting is also considered.
This is the first part of a paper that studies the phase transition in the asymptotic limit of the rank 1 real Wishart spiked model. In this paper, we consider $N$-dimensional real Wishart matrices $S$ in the class $W_{\mathbb{R}}\left(Σ,M\right)$ in which all but one eigenvalues of $Σ$ is $1$. Let the non-trivial eigenvalue of $Σ$ be $1+τ$, then as $N$, $M\rightarrow\infty$, with $N/M=γ^2$ finite and non-zero, the eigenvalue distribution of $S$ will converge into the Machenko-Pastur distribution inside a bulk region. As $τ$ increases from zero, one starts seeing stray eigenvalues of $S$ outsi…
In the spiked population model introduced by Johnstone (2001),the population covariance matrix has all its eigenvalues equal to unit except for a few fixed eigenvalues (spikes). The question is to quantify the effect of the perturbation caused by the spike eigenvalues. Baik and Silverstein (2006) establishes the almost sure limits of the extreme sample eigenvalues associated to the spike eigenvalues when the population and the sample sizes become large. In a recent work (Bai and Yao, 2008), we have provided the limiting distributions for these extreme sample eigenvalues. In this paper, we exte…
Local Law and Outlier Eigenvalues of Spiked Separable Covariance Matrices
Qiuzhen College, Tsinghua University（清华大学邱氏书院）；Department of Probability and Statistics, School of Mathematical Sciences, Peking University（北京大学数学科学学院概率统计系）
Consider a Hermitian matrix model under an external potential with spiked external source. When the external source is of rank one, we compute the limiting distribution of the largest eigenvalue for general, regular, analytic potential for all values of the external source. There is a transitional phenomenon, which is universal for convex potentials. However, for non-convex potentials, new types of transition may occur. The higher rank external source is analyzed in the subsequent paper.
In this note, we establish an asymptotic expansion for the centering parameter appearing in the central limit theorems for linear spectral statistic of large-dimensional sample covariance matrices when the population has a spiked covariance structure. As an application, we provide an asymptotic power function for the corrected likelihood ratio statistic for testing the presence of spike eigenvalues in the population covariance matrix. This result generalizes an existing formula from the literature where only one simple spike exists.
In this paper, we consider N-dimensional real Wishart matrices Y in the class $W_{\mathbb{R}}(Σ,M)$ in which all but one eigenvalues of $Σ$ is 1. Let the non-trivial eigenvalue of $Σ$ be $1+τ$, then as N, $M\rightarrow\infty$, with $M/N=γ^2$ finite and non-zero, the eigenvalue distribution of $Y$ will converge into the Marchenko-Pastur distribution inside a bulk region. When $τ$ increases from zero, one starts to see a stray eigenvalue of Y outside of the support of the Marchenko-Pastur density. As the this stray eigenvalue leaves the bulk region, a phase transition will occur in the largest e…
In this paper, we study the asymptotic behavior of the extreme eigenvalues and eigenvectors of the spiked covariance matrices, in the supercritical regime. Specifically, we derive the joint distribution of the extreme eigenvalues and the generalized components of their associated eigenvectors in this regime.
We consider large Information-Plus-Noise type matrices of the form $M_N=(σ\frac{X_N}{\sqrt{N}}+A_N)(σ\frac{X_N}{\sqrt{N}}+A_N)^*$ where $X_N$ is an $n \times N$ ($n\leq N)$ matrix consisting of independent standardized complex entries, $A_N$ is an $n \times N$ nonrandom matrix and $σ>0$. As $N$ tends to infinity, if $n/N \rightarrow c\in ]0,1]$ and if the empirical spectral measure of $A_N A_N^*$ converges weakly to some compactly supported probability distribution $ν\neq δ_0$, Dozier and Silverstein established that almost surely the empirical spectral measure of $M_N$ converges weakly toward…
This is the second part of a study of the limiting distributions of the top eigenvalues of a Hermitian matrix model with spiked external source under a general external potential. The case when the external source is of rank one was analyzed in an earlier paper. In the present paper we extend the analysis to the higher rank case. If all the eigenvalues of the external source are less than a critical value, the largest eigenvalue converges to the right end-point of the support of the equilibrium measure as in the case when there is no external source. On the other hand, if an external source ei…
We consider matrices formed by a random $N\times N$ matrix drawn from the Gaussian Orthogonal Ensemble (or Gaussian Unitary Ensemble) plus a rank-one perturbation of strength $θ$, and focus on the largest eigenvalue, $x$, and the component, $u$, of the corresponding eigenvector in the direction associated to the rank-one perturbation. We obtain the large deviation principle governing the atypical joint fluctuations of $x$ and $u$. Interestingly, for $θ>1$, in large deviations characterized by a small value of $u$, i.e. $u<1-1/θ$, the second-largest eigenvalue pops out from the Wigner semi-circ…
We introduce a class of separable sample covariance matrices of the form $\widetilde{\mathcal{Q}}_1:=\widetilde A^{1/2} X \widetilde B X^* \widetilde A^{1/2}.$ Here $\widetilde{A}$ and $\widetilde{B}$ are positive definite matrices whose spectrums consist of bulk spectrums plus several spikes, i.e. larger eigenvalues that are separated from the bulks. Conceptually, we call $\widetilde{\mathcal{Q}}_1$ a \emph{spiked separable covariance matrix model}. On the one hand, this model includes the spiked covariance matrix as a special case with $\widetilde{B}=I$. On the other hand, it allows for more…
We study principal components analyses in multivariate random and mixed effects linear models, assuming a spherical-plus-spikes structure for the covariance matrix of each random effect. We characterize the behavior of outlier sample eigenvalues and eigenvectors of MANOVA variance components estimators in such models under a high-dimensional asymptotic regime. Our results show that an aliasing phenomenon may occur in high dimensions, in which eigenvalues and eigenvectors of the MANOVA estimate for one variance component may be influenced by the other components. We propose an alternative proce…
We characterize the limiting smallest eigenvalue distributions (or hard edge laws) for sample covariance type matrices drawn from a spiked population. In the case of a single spike, the results are valid in the context of the general beta ensembles. For multiple spikes, the necessary construction restricts matters to real, complex or quaternion (beta=1, 2, or 4) ensembles. The limit laws are described in terms of a random integral operators, and partial differential equations satisfied by the corresponding distribution functions are derived as corollaries. We also show that, under a natural li…
Given a large, high-dimensional sample from a spiked population, the top sample covariance eigenvalue is known to exhibit a phase transition. We show that the largest eigenvalues have asymptotic distributions near the phase transition in the rank-one spiked real Wishart setting and its general beta analogue, proving a conjecture of Baik, Ben Arous and Péché (2005). We also treat shifted mean Gaussian orthogonal and beta ensembles. Such results are entirely new in the real case; in the complex case we strengthen existing results by providing optimal scaling assumptions. One obtains the known li…
A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, introduced by Johnstone, in which a prominent eigenvector (or "spike") is planted into a random matrix. These distributions form natural statistical models for principal component analysis (PCA) problems throughout the sciences. Baik, Ben Arous and Peche showed that the spiked Wishart ensemble exhibits a sharp phase transition asymptotically: when the spike strength is above a critical threshold, it is possible to detect the presence of a spike based on the top eigenvalue, and below the t…
The top eigenvalues of rank $r$ spiked real Wishart matrices and additively perturbed Gaussian orthogonal ensembles are known to exhibit a phase transition in the large size limit. We show that they have limiting distributions for near-critical perturbations, fully resolving the conjecture of Baik, Ben Arous and Péché [Duke Math. J. (2006) 133 205-235]. The starting point is a new $(2r+1)$-diagonal form that is algebraically natural to the problem; for both models it converges to a certain random Schrödinger operator on the half-line with $r\times r$ matrix-valued potential. The perturbation d…
A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal component analysis (PCA) problems throughout the sciences. Baik, Ben Arous and Péché showed that the spiked Wishart ensemble exhibits a sharp phase transition asymptotically: when the signal strength is above a critical threshold, it is possible to detect the presence of a spike based on the top eigenvalue, and below the threshold the top eigenvalue provides …
This text is about spiked models of non Hermitian random matrices. More specifically, we consider matrices of the type $A+P$, where the rank of $P$ stays bounded as the dimension goes to infinity and where the matrix $A$ is a non Hermitian random matrix, satisfying an isotropy hypothesis: its distribution is invariant under the left and right actions of the unitary group. The macroscopic eigenvalue distribution of such matrices is governed by the so called Single Ring Theorem, due to Guionnet, Krishnapur and Zeitouni. We first prove that if $P$ has some eigenvalues out of the maximal circle of…
We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of the perturbed matrix for additive and multiplicative perturbation models. The limiting non-random value is shown to depend explicitly on the limiting eigenvalue distribution of the unperturbed random matrix and the assumed perturbation model via integral transforms that correspond to very well known objects in free probability theory that linearize non-commuta…
In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is …
We consider eigenvalues of generalized Wishart processes as well as particle systems, of which the empirical measures converge to deterministic measures as the dimension goes to infinity. In this paper, we obtain central limit theorems to characterize the fluctuations of the empirical measures around the limit measures by using stochastic calculus. As applications, central limit theorems for the Dyson's Brownian motion and the eigenvalues of the Wishart process are recovered under slightly more general initial conditions, and a central limit theorem for the eigenvalues of a symmetric Ornstein-…
We prove the Central Limit Theorem for finite-dimensional vectors of linear eigenvalue statistics of submatrices of Wigner random matrices under the assumption that test functions are sufficiently smooth. We connect the asymptotic covariance to a family of correlated Gaussian Free Fields.
We prove that the spectral radius of a strongly irreducible random walk on GLd(R) (or more generally the vector of moduli of eigenvalues of a Zariski-dense random walk on a reductive group) satisfies a central limit theorem under an order two moment assumption.
In this paper, we explain the dependance of the fluctuations of the largest eigenvalues of a Deformed Wigner model with respect to the eigenvectors of the perturbation matrix. We exhibit quite general situations that will give rise to universality or non universality of the fluctuations.
The purpose of this note is to establish a Central Limit Theorem for the number of eigenvalues of a Wigner matrix in an interval. The proof relies on the correct aymptotics of the variance of the eigenvalue counting function of GUE matrices due to Gustavsson, and its extension to large families of Wigner matrices by means of the Tao and Vu Four Moment Theorem and recent localization results by Erdös, Yau and Yin.
This note presents some central limit theorems for the eigenvalue counting function of Wigner matrices in the form of suitable translations of results by Gustavsson and O'Rourke on the limiting behavior of eigenvalues inside the bulk of the semicircle law for Gaussian matrices. The theorems are then extended to large families of Wigner matrices by the Tao and Vu Four Moment Theorem. Similar results are developed for covariance matrices.
In this paper, we show that the diagonal of a high-dimensional sample covariance matrix stemming from $n$ independent observations of a $p$-dimensional time series with finite fourth moments can be approximated in spectral norm by the diagonal of the population covariance matrix. We assume that $n,p\to \infty$ with $p/n$ tending to a constant which might be positive or zero. As applications, we provide an approximation of the sample correlation matrix ${\mathbf R}$ and derive a variety of results for its eigenvalues. We identify the limiting spectral distribution of ${\mathbf R}$ and construct…
We consider $N$ by $N$ deformed Wigner random matrices of the form $X_N=H_N+A_N$, where $H_N$ is a real symmetric or complex Hermitian Wigner matrix and $A_N$ is a deterministic real bounded diagonal matrix. We prove a universal Central Limit Theorem for the linear eigenvalue statistics of $X_N$ for all mesoscopic scales both in the spectral bulk and at regular edges where the global eigenvalue density vanishes as a square root. The method relies on the characteristic function method in [47], local laws for the Green function of $X_N$ in [3, 46, 51] and analytic subordination properties of the…
We study the statistical limits of both detecting and estimating a rank-one deformation of a symmetric random Gaussian tensor. We establish upper and lower bounds on the critical signal-to-noise ratio, under a variety of priors for the planted vector: (i) a uniformly sampled unit vector, (ii) i.i.d. $\pm 1$ entries, and (iii) a sparse vector where a constant fraction $ρ$ of entries are i.i.d. $\pm 1$ and the rest are zero. For each of these cases, our upper and lower bounds match up to a $1+o(1)$ factor as the order $d$ of the tensor becomes large. For sparse signals (iii), our bounds are also…
We consider the asymptotic fluctuation behavior of the largest eigenvalue of certain sample covariance matrices in the asymptotic regime where both dimensions of the corresponding data matrix go to infinity. More precisely, let $X$ be an $n\times p$ matrix, and let its rows be i.i.d. complex normal vectors with mean 0 and covariance $Σ_p$. We show that for a large class of covariance matrices $Σ_p$, the largest eigenvalue of $X^*X$ is asymptotically distributed (after recentering and rescaling) as the Tracy--Widom distribution that appears in the study of the Gaussian unitary ensemble. We give…
For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), γ^{-1} \leq \frac{N}{n} \leq γ$ where $γ\in (0,\infty),$ we obtain consistency rates in the form of CLTs for separated spikes tending to infinity fast enough whenever $M$ grows slightly slower than $n: \lim_{n \to \infty}{\frac{\sqrt{\log{n}}}{\log{\frac{n}{M(n)}}}}=0.$ Our results fill a gap in the existing literature in which the largest range covered for the number of spikes has been $o(n^{1/6})$ an…
We prove the Central Limit Theorem for linear statistics of the eigenvalues of band random matrices provided $\sqrt{n} \ll b_n \ll n$ and test functions are sufficiently smooth.
We consider a class of elliptic random matrices which generalize two classical ensembles from random matrix theory: Wigner matrices and random matrices with iid entries. In particular, we establish a central limit theorem for linear eigenvalue statistics of real elliptic random matrices under the assumption that the test functions are analytic. As a corollary, we extend the results of Rider and Silverstein to real iid random matrices.
We study the linear eigenvalue statistics of large random graphs in the regimes when the mean number of edges for each vertex tends to infinity. We prove that for a rather wide class of test functions the fluctuations of linear eigenvalue statistics converges in distribution to a Gaussian random variable with zero mean and variance which coincides with "non gaussian" part of the Wigner ensemble variance.
Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature …
