We compute the limiting distributions of the largest eigenvalue of a complex Gaussian sample covariance matrix when both the number of samples and the number of variables in each sample become large. When all but finitely many, say $r$, eigenvalues of the covariance matrix are the same, the dependence of the limiting distribution of the largest eigenvalue of the sample covariance matrix on those distinguished $r$ eigenvalues of the covariance matrix is completely characterized in terms of an infinite sequence of new distribution functions that generalize the Tracy-Widom distributions of the random matrix theory. Especially a phase transition phenomena is observed. Our results also apply to a last passage percolation model and a queuing model.
In this paper, we prove a necessary and sufficient condition for the edge universality of sample covariance matrices with general population. We consider sample covariance matrices of the form $\mathcal Q = TX(TX)^{*}$, where the sample $X$ is an $M_2\times N$ random matrix with $i.i.d.$ entries with mean zero and variance $N^{-1}$, and $T$ is an $M_1 \times M_2$ deterministic matrix satisfying $T^* T$ is diagonal. We study the asymptotic behavior of the largest eigenvalues of $\mathcal Q$ when $M:=\min\{M_1,M_2\}$ and $N$ tends to infinity with $\lim_{N \to \infty} {N}/{M}=d \in (0, \infty)$.…
We establish a large-deviations principle for the largest eigenvalue of a generalized sample covariance matrix, meaning a matrix proportional to $Z^T ΓZ$, where $Z$ has i.i.d. real or complex entries and $Γ$ is not necessarily the identity. We treat the classical case when $Z$ is Gaussian and $Γ$ is positive definite, but we also cover two orthogonal extensions: Either the entries of $Z$ can instead be sharp sub-Gaussian, a class including Rademacher and uniform distributions, where we find the same rate function as for the Gaussian model; or $Γ$ can have negative eigenvalues if $Z$ remains Ga…
In a recent study of large non-null sample covariance matrices, a new sequence of functions generalizing the GUE Tracy-Widom distribution of random matrix theory was obtained. This paper derives Painlevé formulas of these functions and use them to prove that they are indeed distribution functions. Applications of these new distribution functions to last passage percolation, queues in tandem and totally asymmetric simple exclusion process are also discussed. As a part of the proof, a representation of orthogonal polynomials on the unit circle in terms of an operator on a discrete set is present…
We consider large complex random sample covariance matrices obtained from "spiked populations", that is when the true covariance matrix is diagonal with all but finitely many eigenvalues equal to one. We investigate the limiting behavior of the largest eigenvalues when the population and the sample sizes both become large. Under some conditions on moments of the sample distribution, we prove that the asymptotic fluctuations of the largest eigenvalues are the same as for a complex Gaussian sample with the same true covariance. The real setting is also considered.
In this paper, we use a new approach to prove that the largest eigenvalue of the sample covariance matrix of a normally distributed vector is bigger than the true largest eigenvalue with probability 1 when the dimension is infinite. We prove a similar result for the smallest eigenvalue.
We prove the first explicit rate of convergence to the Tracy-Widom distribution for the fluctuation of the largest eigenvalue of sample covariance matrices that are not integrable. Our primary focus is matrices of type $ X^*X $ and the proof follows the Erdös-Schlein-Yau dynamical method. We use a recent approach to the analysis of the Dyson Brownian motion from [5] to obtain a quantitative error estimate for the local relaxation flow at the edge. Together with a quantitative version of the Green function comparison theorem, this gives the rate of convergence. Combined with a result of Lee-Sch…
We establish a quantitative version of the Tracy--Widom law for the largest eigenvalue of high dimensional sample covariance matrices. To be precise, we show that the fluctuations of the largest eigenvalue of a sample covariance matrix $X^*X$ converge to its Tracy--Widom limit at a rate nearly $N^{-1/3}$, where $X$ is an $M \times N$ random matrix whose entries are independent real or complex random variables, assuming that both $M$ and $N$ tend to infinity at a constant rate. This result improves the previous estimate $N^{-2/9}$ obtained by Wang [73]. Our proof relies on a Green function comp…
For sample covariance matrices with iid entries with sub-Gaussian tails, when both the number of samples and the number of variables become large and the ratio approaches to one, it is a well-known result of A. Soshnikov that the limiting distribution of the largest eigenvalue is same as the of Gaussian samples. In this paper, we extend this result to two cases. The first case is when the ratio approaches to an arbitrary finite value. The second case is when the ratio becomes infinity or arbitrarily small.
We present a characterization of the null moments of the Complex Multivariate Normal Distribution with non-singular covariance matrix and we give closed-forms expressions for its non-null moments.
We consider the asymptotic fluctuation behavior of the largest eigenvalue of certain sample covariance matrices in the asymptotic regime where both dimensions of the corresponding data matrix go to infinity. More precisely, let $X$ be an $n\times p$ matrix, and let its rows be i.i.d. complex normal vectors with mean 0 and covariance $Σ_p$. We show that for a large class of covariance matrices $Σ_p$, the largest eigenvalue of $X^*X$ is asymptotically distributed (after recentering and rescaling) as the Tracy--Widom distribution that appears in the study of the Gaussian unitary ensemble. We give…
Given a large sample covariance matrix $S_N=\frac 1nΓ_N^{1/2}Z_N Z_N^*Γ_N^{1/2}\, ,$ where $Z_N$ is a $N\times n$ matrix with i.i.d. centered entries, and $Γ_N$ is a $N\times N$ deterministic Hermitian positive semidefinite matrix, we study the location and fluctuations of $λ_{\max}(S_N)$, the largest eigenvalue of $S_N$ as $N,n\to\infty$ and $Nn^{-1} \to r\in(0,\infty)$ in the case where the empirical distribution $μ^{Γ_N}$ of eigenvalues of $Γ_N$ is tight (in $N$) and $λ_{\max}(Γ_N)$ goes to $+\infty$. These conditions are in particular met when $μ^{Γ_N}$ weakly converges to a probability me…
The paper studies the spectral properties of large Wigner, band and sample covariance random matrices with heavy tails of the marginal distributions of matrix entries.
We consider sample covariance matrices of the form $\mathcal{Q}=(Σ^{1/2}X)(Σ^{1/2} X)^*$, where the sample $X$ is an $M\times N$ random matrix whose entries are real independent random variables with variance $1/N$ and where $Σ$ is an $M\times M$ positive-definite deterministic matrix. We analyze the asymptotic fluctuations of the largest rescaled eigenvalue of $\mathcal{Q}$ when both $M$ and $N$ tend to infinity with $N/M\to d\in(0,\infty)$. For a large class of populations $Σ$ in the sub-critical regime, we show that the distribution of the largest rescaled eigenvalue of $\mathcal{Q}$ is giv…
We study the statistics of the largest eigenvalues of real symmetric and sample covariance matrices when the entries are heavy tailed. Extending the result obtained by Soshnikov in \cite{Sos1}, we prove that, in the absence of the fourth moment, the top eigenvalues behave, in the limit, as the largest entries of the matrix.
We extend to the matrix setting a recent result of Srivastava-Vershynin about estimating the covariance matrix of a random vector. The result can be in- terpreted as a quantified version of the law of large numbers for positive semi-definite matrices which verify some regularity assumption. Beside giving examples, we dis- cuss the notion of log-concave matrices and give estimates on the smallest and largest eigenvalues of a sum of such matrices.
For $N,n\in\mathbb N$, consider the sample covariance matrix $$S_N(T)=\frac{1}{N}XX^*$$ from a data set $X=C_N^{1/2}ZT_n^{1/2}$, where $Z=(Z_{i,j})$ is a $N\times n$ matrix having i.i.d. entries with mean zero and variance one, and $C_N, T_n$ are deterministic positive semi-definite Hermitian matrices of dimension $N$ and $n$, respectively. We assume that $(C_N)_N$ is bounded in spectral norm, and $T_n$ is a Toeplitz matrix with its largest eigenvalues diverging to infinity. The matrix $X$ can be viewed as a data set of an $N$-dimensional long memory stationary process having separable depende…
We study the joint limit distribution of the $k$ largest eigenvalues of a $p\times p$ sample covariance matrix $XX^\T$ based on a large $p\times n$ matrix $X$. The rows of $X$ are given by independent copies of a linear process, $X_{it}=\sum_j c_j Z_{i,t-j}$, with regularly varying noise $(Z_{it})$ with tail index $α\in(0,4)$. It is shown that a point process based on the eigenvalues of $XX^\T$ converges, as $n\to\infty$ and $p\to\infty$ at a suitable rate, in distribution to a Poisson point process with an intensity measure depending on $α$ and $\sum c_j^2$. This result is extended to random …
Recently Johansson and Johnstone proved that the distribution of the (properly rescaled) largest principal component of the complex (real) Wishart matrix $ X^* \* X (X^t \*X) $ converges to the Tracy-Widom law as $ n, p $ (the dimensions of $ X $) tend to $ \infty $ in some ratio $ n/p \to γ>0. $ We extend these results in two directions. First of all, we prove that the joint distribution of the first, second, third, etc. eigenvalues of a Wishart matrix converges (after a proper rescaling) to the Tracy-Widom distribution. Second of all, we explain how the combinatorial machinery developed for …
We study point process convergence for sequences of iid random walks. The objective is to derive asymptotic theory for the extremes of these random walks. We show convergence of the maximum random walk to the Gumbel distribution under the existence of a $(2+δ)$th moment. We make heavily use of precise large deviation results for sums of iid random variables. As a consequence, we derive the joint convergence of the off-diagonal entries in sample covariance and correlation matrices of a high-dimensional sample whose dimension increases with the sample size. This generalizes known results on the …
In this paper, we prove the edge universality of largest eigenvalues for separable covariance matrices of the form $\mathcal Q :=A^{1/2}XBX^*A^{1/2}$. Here $X=(x_{ij})$ is an $n\times N$ random matrix with $x_{ij}=N^{-1/2}q_{ij}$, where $q_{ij}$ are $i.i.d.$ random variables with zero mean and unit variance, and $A$ and $B$ are respectively $n \times n$ and $N\times N$ deterministic non-negative definite symmetric (or Hermitian) matrices. We consider the high-dimensional case, i.e. ${n}/{N}\to d \in (0, \infty)$ as $N\to \infty$. Assuming $\mathbb E q_{ij}^3=0$ and some mild conditions on $A$ …
We find the joint generalized singular value distribution and largest generalized singular value distributions of the $β$-MANOVA ensemble with positive diagonal covariance, which is general. This has been done for the continuous $β> 0$ case for identity covariance (in eigenvalue form), and by setting the covariance to $I$ in our model we get another version. For the diagonal covariance case, it has only been done for $β= 1,2,4$ cases (real, complex, and quaternion matrix entries). This is in a way the first second-order $β$-ensemble, since the sampler for the generalized singular values of the…
This paper is aimed at deriving the universality of the largest eigenvalue of a class of high-dimensional real or complex sample covariance matrices of the form $\mathcal{W}_N=Σ^{1/2}XX^*Σ^{1/2}$. Here, $X=(x_{ij})_{M,N}$ is an $M\times N$ random matrix with independent entries $x_{ij},1\leq i\leq M,1\leq j\leq N$ such that $\mathbb{E}x_{ij}=0$, $\mathbb{E}|x_{ij}|^2=1/N$. On dimensionality, we assume that $M=M(N)$ and $N/M\rightarrow d\in(0,\infty)$ as $N\rightarrow\infty$. For a class of general deterministic positive-definite $M\times M$ matrices $Σ$, under some additional assumptions on th…
In this paper we study the joint distributional convergence of the largest eigenvalues of the sample covariance matrix of a $p$-dimensional time series with iid entries when $p$ converges to infinity together with the sample size $n$. We consider only heavy-tailed time series in the sense that the entries satisfy some regular variation condition which ensures that their fourth moment is infinite. In this case, Soshnikov [31, 32] and Auffinger et al. [2] proved the weak convergence of the point processes of the normalized eigenvalues of the sample covariance matrix towards an inhomogeneous Pois…
In a paper that appeared in 2010, C. Tone proved a multivariate central limit theorem for some strictly stationary random fields of random vectors satisfying certain mixing conditions. The "normalization" of a given "partial sum" (or "block sum") involved matrix multiplication by a "standard -1/2 power" of its covariance matrix (a symmetric, positive definite matrix), and the limiting multivariate normal distribution had the identity matrix as its covariance matrix. The mixing assumptions in Tone's result implicitly imposed an upper bound on the ratios of the largest to the smallest eigenvalue…
We consider spectral properties of sparse sample covariance matrices, which includes biadjacency matrices of the bipartite Erdős-Rényi graph model. We prove a local law for the eigenvalue density up to the upper spectral edge. Under a suitable condition on the sparsity, we also prove that the limiting distribution of the rescaled, shifted extremal eigenvalues is given by the GOE Tracy-Widom law with an explicit formula on the deterministic shift of the spectral edge. For the biadjacency matrix of an Erdős-Rényi graph with two vertex sets of comparable sizes $M$ and $N$, this establishes Tracy-…
In this paper, we consider a data matrix $X\in\mathbb{C}^{N\times M}$ where all the columns are i.i.d. samples being $N$ dimensional complex Gaussian of mean zero and covariance $Σ\in\mathbb{C}^{N\times N}$. Here the population matrix $Σ$ is of finite rank perturbation of the identity matrix. This is the "spiked population model" first proposed by Johnstone in \cite{21}. As $M, N\to\infty$ but $M/N = γ\in(1, \infty)$, we first establish in this paper the asymptotic distribution of the smallest eigenvalue of the sample covariance matrix $S:= XX^*/M$. It also exhibits a phase transition phenomen…
We consider the eigenvalues of sample covariance matrices of the form $\mathcal{Q}=(Σ^{1/2}X)(Σ^{1/2}X)^*$. The sample $X$ is an $M\times N$ rectangular random matrix with real independent entries and the population covariance matrix $Σ$ is a positive definite diagonal matrix independent of $X$. Assuming that the limiting spectral density of $Σ$ exhibits convex decay at the right edge of the spectrum, in the limit $M, N \to \infty$ with $N/M \to d\in(0,\infty)$, we find a certain threshold $d_+$ such that for $d>d_+$ the limiting spectral distribution of $\mathcal{Q}$ also exhibits convex deca…
Consider a sample of a centered random vector with unit covariance matrix. We show that under certain regularity assumptions, and up to a natural scaling, the smallest and the largest eigenvalues of the empirical covariance matrix converge, when the dimension and the sample size both tend to infinity, to the left and right edges of the Marchenko--Pastur distribution. The assumptions are related to tails of norms of orthogonal projections. They cover isotropic log-concave random vectors as well as random vectors with i.i.d. coordinates with almost optimal moment conditions. The method is a refi…
After proper rescaling and under some technical assumptions, the smallest eigenvalue of a sample covariance matrix with aspect ratio bounded away from 1 converges to the Tracy--Widom distribution. This complements the results on the largest eigenvalue, due to Soshnikov and Peche.
Let $(\varepsilon_{t})_{t>0}$ be a sequence of independent real random vectors of $p$-dimension and let $X_T= \sum_{t=s+1}^{s+T}\varepsilon_t\varepsilon^T_{t-s}/T$ be the lag-$s$ ($s$ is a fixed positive integer) auto-covariance matrix of $\varepsilon_t$. Since $X_T$ is not symmetric, we consider its singular values, which are the square roots of the eigenvalues of $X_TX^T_T$. Therefore, the purpose of this paper is to investigate the limiting behaviors of the eigenvalues of $X_TX^T_T$ in two aspects. First, we show that the empirical spectral distribution of its eigenvalues converges to a non…
Let $(\varepsilon_{t})_{t>0}$ be a sequence of independent real random vectors of $p$-dimension and let $X_T=\sum_{t=s+1}^{s+T}\varepsilon_t\varepsilon^T_{t-s}/T$ be the lag-$s$ ($s$ is a fixed positive integer) auto-covariance matrix of $\varepsilon_t$. This paper investigates the limiting behavior of the singular values of $X_T$ under the so-called {\em ultra-dimensional regime} where $p\to\infty$ and $T\to\infty$ in a related way such that $p/T\to 0$. First, we show that the singular value distribution of $X_T$ after a suitable normalization converges to a nonrandom limit $G$ (quarter law) …
We study the sample covariance matrix for real-valued data with general population covariance, as well as MANOVA-type covariance estimators in variance components models under null hypotheses of global sphericity. In the limit as matrix dimensions increase proportionally, the asymptotic spectra of such estimators may have multiple disjoint intervals of support, possibly intersecting the negative half line. We show that the distribution of the extremal eigenvalue at each regular edge of the support has a GOE Tracy-Widom limit. Our proof extends a comparison argument of Ji Oon Lee and Kevin Schn…
We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It provides a decomposition of the largest $K$ singular values into the deterministic rate of growth, random centered fluctuations given as explicit linear combinations of the entries of the matrix, and a term negligible in probability. We use this representation to establish asymptotic normality of the largest singular values for random matrices with means that ha…
We study sample covariance matrices of the form $W=\frac 1n C C^T$, where $C$ is a $k\times n$ matrix with i.i.d. mean zero entries. This is a generalization of so-called Wishart matrices, where the entries of $C$ are independent and identically distributed standard normal random variables. Such matrices arise in statistics as sample covariance matrices, and the high-dimensional case, when $k$ is large, arises in the analysis of DNA experiments. We investigate the large deviation properties of the largest and smallest eigenvalues of $W$ when either $k$ is fixed and $n\to \infty$, or $k_n\to \i…
We study the $k$-largest eigenvalues of heavy-tailed sample covariance matrices of the form $\bX\bX^\T$ in an asymptotic framework, where the dimension of the data and the sample size tend to infinity. To this end, we assume that the rows of $\bX$ are given by independent copies of some stationary process with regularly varying marginals with index $α\in(0,2)$ satisfying large deviation and mixing conditions. We apply these general results to stochastic volatility and GARCH processes.
University of Chicago（芝加哥大学）；LPSM, Université de Paris（巴黎大学概率与统计建模实验室）
This paper is concerned with the asymptotic distribution of the largest eigenvalues for some nonlinear random matrix ensemble stemming from the study of neural networks. More precisely we consider $M= \frac{1}{m} YY^\top$ with $Y=f(WX)$ where $W$ and $X$ are random rectangular matrices with i.i.d. centered entries. This models the data covariance matrix or the Conjugate Kernel of a single layered random Feed-Forward Neural Network. The function $f$ is applied entrywise and can be seen as the activation function of the neural network. We show that the largest eigenvalue has the same limit (in p…
We study high-dimensional sample covariance matrices based on independent random vectors with missing coordinates. The presence of missing observations is common in modern applications such as climate studies or gene expression micro-arrays. A weak approximation on the spectral distribution in the "large dimension $d$ and large sample size $n$" asymptotics is derived for possibly different observation probabilities in the coordinates. The spectral distribution turns out to be strongly influenced by the missingness mechanism. In the null case under the missing at random scenario where each comp…
Let $A$ and $B$ be independent, central Wishart matrices in $p$ variables with common covariance and having $m$ and $n$ degrees of freedom, respectively. The distribution of the largest eigenvalue of $(A+B)^{-1}B$ has numerous applications in multivariate statistics, but is difficult to calculate exactly. Suppose that $m$ and $n$ grow in proportion to $p$. We show that after centering and scaling, the distribution is approximated to second-order, $O(p^{-2/3})$, by the Tracy--Widom law. The results are obtained for both complex and then real-valued data by using methods of random matrix theory …
For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), γ^{-1} \leq \frac{N}{n} \leq γ$ where $γ\in (0,\infty),$ we obtain consistency rates in the form of CLTs for separated spikes tending to infinity fast enough whenever $M$ grows slightly slower than $n: \lim_{n \to \infty}{\frac{\sqrt{\log{n}}}{\log{\frac{n}{M(n)}}}}=0.$ Our results fill a gap in the existing literature in which the largest range covered for the number of spikes has been $o(n^{1/6})$ an…
We present an analytical technique to compute the probability of rare events in which the largest eigenvalue of a random matrix is atypically large (i.e.\ the right tail of its large deviations). The results also transfer to the left tail of the large deviations of the smallest eigenvalue. The technique improves upon past methods by not requiring the explicit law of the eigenvalues, and we apply it to a large class of random matrices that were previously out of reach. In particular, we solve an open problem related to the performance of principal components analysis on highly correlated data, …
