For $k,m,n\in \mathbb{N}$, we consider $n^k\times n^k$ random matrices of the form $$ \mathcal{M}_{n,m,k}(\mathbf{y})=\sum_{α=1}^mτ_α{Y_α}Y_α^T,\quad Y_α=\mathbf{y}_α^{(1)}\otimes...\otimes\mathbf{y}_α^{(k)}, $$ where $τ_{α}$, $α\in[m]$, are real numbers and $\mathbf{y}_α^{(j)}$, $α\in[m]$, $j\in[k]$, are i.i.d. copies of a normalized isotropic random vector $\mathbf{y}\in \mathbb{R}^n$. For every fixed $k\ge 1$, if the Normalized Counting Measures of $\{τ_{α}\}_α$ converge weakly as $m,n\rightarrow \infty$, $m/n^k\rightarrow c\in \lbrack 0,\infty )$ and $\mathbf{y}$ is a good vector in the sense of Definition 1.1, then the Normalized Counting Measures of eigenvalues of $\mathcal{M}_{n,m,k}(\mathbf{y})$ converge weakly in probability to a non-random limit found in [15]. For $k=2$, we define a subclass of good vectors $\mathbf{y}$ for which the centered linear eigenvalue statistics $n^{-1/2}\text{Tr} \,φ(\mathcal{M}_{n,m,2}(\mathbf{y}))^\circ$ converge in distribution to a Gaussian random variable, i.e., the Central Limit Theorem is valid.
In this note, we establish an asymptotic expansion for the centering parameter appearing in the central limit theorems for linear spectral statistic of large-dimensional sample covariance matrices when the population has a spiked covariance structure. As an application, we provide an asymptotic power function for the corrected likelihood ratio statistic for testing the presence of spike eigenvalues in the population covariance matrix. This result generalizes an existing formula from the literature where only one simple spike exists.
This paper investigates the central limit theorem for linear spectral statistics of high dimensional sample covariance matrices of the form $\mathbf{B}_n=n^{-1}\sum_{j=1}^{n}\mathbf{Q}\mathbf{x}_j\mathbf{x}_j^{*}\mathbf{Q}^{*}$ where $\mathbf{Q}$ is a nonrandom matrix of dimension $p\times k$, and $\{\mathbf{x}_j\}$ is a sequence of independent $k$-dimensional random vector with independent entries, under the assumption that $p/n\to y>0$. A key novelty here is that the dimension $k\ge p$ can be arbitrary, possibly infinity. This new model of sample covariance matrices $\mathbf{B}_n$ covers mos…
We consider the spectral properties of a class of regularized estimators of (large) empirical covariance matrices corresponding to stationary (but not necessarily Gaussian) sequences, obtained by banding. We prove a law of large numbers (similar to that proved in the Gaussian case by Bickel and Levina), which implies that the spectrum of a banded empirical covariance matrix is an efficient estimator. Our main result is a central limit theorem in the same regime, which to our knowledge is new, even in the Gaussian setup.
A central limit theorem (CLT) for the smoothed empirical spectral distribution of sample covariance matrices is established. Moreover, the CLTs for the smoothed quantiles of Marcenko and Pastur's law have been also developed.
We study the renormalized real sample covariance matrix $H=X^TX/\sqrt{MN}-\sqrt{M/N}$ with $N/M\rightarrow0$ as $N, M\rightarrow \infty$ in this paper. And we always assume $M=M(N)$. Here $X=[X_{jk}]_{M\times N}$ is an $M\times N$ real random matrix with i.i.d entries, and we assume $\mathbb{E}|X_{11}|^{5+δ}<\infty$ with some small positive $δ$. The Stieltjes transform $m_N(z)=N^{-1}Tr(H-z)^{-1}$ and the linear eigenvalue statistics of $H$ are considered. We mainly focus on the asymptotic expansion of $\mathbb{E}\{m_N(z)\}$ in this paper. Then for some fine test function, a central limit theor…
We show that the variance of centred linear statistics of eigenvalues of GUE matrices remains bounded for large $n$ for some classes of test functions less regular than Lipschitz functions. This observation is suggested by the limiting form of the variance (which has previously been computed explicitly), but it does not seem to appear in the literature. We combine this fact with comparison techniques following Tao-Vu and Erdös, Yau, et al. and a Littlewood-Paley type decomposition to extend the central limit theorem for linear eigenvalue statistics to functions in the Hölder class $C^{1/2+ε}$ …
In this paper we show a functional central limit theorem for the sum of the first $\lfloor t n \rfloor$ diagonal elements of $f(Z)$ as a function in $t$, for $Z$ a random real symmetric or complex Hermitian $n\times n$ matrix. The result holds for orthogonal or unitarily invariant distributions of $Z$, in the cases when the linear eigenvalue statistic $\operatorname{tr} f(Z)$ satisfies a CLT. The limit process interpolates between the fluctuations of individual matrix elements as $f(Z)_{1,1}$ and of the linear eigenvalue statistic. It can also be seen as a functional CLT for processes of rando…
For $N,n\in\mathbb N$, consider the sample covariance matrix $$S_N(T)=\frac{1}{N}XX^*$$ from a data set $X=C_N^{1/2}ZT_n^{1/2}$, where $Z=(Z_{i,j})$ is a $N\times n$ matrix having i.i.d. entries with mean zero and variance one, and $C_N, T_n$ are deterministic positive semi-definite Hermitian matrices of dimension $N$ and $n$, respectively. We assume that $(C_N)_N$ is bounded in spectral norm, and $T_n$ is a Toeplitz matrix with its largest eigenvalues diverging to infinity. The matrix $X$ can be viewed as a data set of an $N$-dimensional long memory stationary process having separable depende…
We present some applications of central limit theorems on mesoscopic scales for random matrices. When combined with the recent theory of "homogenization" for Dyson Brownian Motion, this yields the universality of quantities which depend on the behavior of single eigenvalues of Wigner matrices and $β$-ensembles. Among the results we obtain are the Gaussian fluctuations of single eigenvalues for Wigner matrices (without an assumption of 4 matching moments) and classical $β$-ensembles ($β=1, 2, 4$), Gaussian fluctuations of the eigenvalue counting function, and an asymptotic expansion up to order…
In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is …
Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature …
In this paper, we derive a joint central limit theorem for random vector whose components are function of random sesquilinear forms. This result is a natural extension of the existing central limit theory on random quadratic forms. We also provide applications in random matrix theory related to large-dimensional spiked population models. For the first application, we find the joint distribution of grouped extreme sample eigenvalues correspond to the spikes. And for the second application, under the assumption that the population covariance matrix is diagonal with $k$ (fixed) simple spikes, we …
This paper is concerned with normal approximation under relaxed moment conditions using Stein's method. We obtain the explicit rates of convergence in the central limit theorem for (i) nonlinear statistics with finite absolute moment of order $2+δ\in(2,3];$ (ii) nonlinear statistics with vanishing third moment and finite absolute moment of order $3+δ\in(3,4].$ When applied to specific examples, these rates are of the optimal order $O(n^{-\fracδ{2}})$ and $O(n^{-\frac{1+δ}{2}}).$ Our proof are based on the covariance identify formula and simple observations about the solution of Stein's equatio…
In this article, we establish a near-optimal convergence rate for the CLT of linear eigenvalue statistics of Wigner matrices, in Kolmogorov-Smirnov distance. For all test functions $f\in C^5(\mathbb R)$, we show that the convergence rate is either $N^{-1/2+\varepsilon}$ or $N^{-1+\varepsilon}$, depending on the first Chebyshev coefficient of $f$ and the third moment of the diagonal matrix entries. The condition that distinguishes these two rates is necessary and sufficient. For a general class of test functions, we further identify matching lower bounds for the convergence rates. In addition, …
Simple analysis of the leftmost eigenvalue of Ince's equation (a boundary value problem with periodicity) resolves an open issue surrounding a stochastic Lyapunov exponent. Numerical verification is also provided.
In this article, we study the fluctuation of linear eigenvalue statistics of symmetric circulant matrices $(SC_n)$ with independent entries which satisfy some moment conditions. We show that $\frac{1}{\sqrt{n}} \Tr ϕ(SC_n)$ obey the central limit theorem (CLT) type result, where $ϕ$ is a nice test function.
We study linear eigenvalue statistics of band Hankel matrices with Brownian motion entries. We prove that, the centred, normalized linear eigenvalue statistics of band Hankel matrices obey a central limit theorem (CLT) type result. We also discuss the convergence of linear eigenvalue statistics of band Hankel matrices with independent entries for odd power monomials. Our method is based on trace formula, moment method and some results of process convergence.
We prove a new CLT for the difference of linear eigenvalue statistics of a Wigner random matrix $H$ and its minor $\hat H$ and find that the fluctuation is much smaller than the fluctuations of the individual linear statistics, as a consequence of the strong correlation between the eigenvalues of $H$ and $\hat H$. In particular our theorem identifies the fluctuation of Kerov's rectangular Young diagrams, defined by the interlacing eigenvalues of $H$ and $\hat H$, around their asymptotic shape, the Vershik-Kerov-Logan-Shepp curve. This result demonstrates yet another aspect of the close connect…
We derive tight lower bounds on the smallest eigenvalue of a sample covariance matrix of a centred isotropic random vector under weak or no assumptions on its components.
Suppose that $\{u(t\,, x)\}_{t >0, x \in\mathbb{R}^d}$ is the solution to a $d$-dimensional parabolic Anderson model with delta initial condition and driven by a Gaussian noise that is white in time and has a spatially homogeneous covariance given by a nonnegative-definite measure $f$ which satisfies Dalang's condition. Let $\boldsymbol{p}_t(x):=(2πt)^{-d/2}\exp\{-\|x\|^2/(2t)\}$ denote the standard Gaussian heat kernel on $\mathbb{R}^d$. We prove that for all $t>0$, the process $U(t):=\{u(t\,, x)/\boldsymbol{p}_t(x): x\in \mathbb{R}^d\}$ is stationary using Feynman-Kac's formula, and is ergod…
We consider a random field, defined on an integer-valued d-dimensional lattice, with covariance function satisfying a condition more general than summability. Such condition appeared in the well-known Newman's conjecture concerning the central limit theorem (CLT) for stationary associated random fields. As was demonstrated by Herrndorf and Shashkin, the conjecture fails already for d=1. In the present paper, we show the validity of modified conjecture leaving intact the mentioned condition on covariance function. Thus we establish, for any positive integer d, a criterion of the CLT validity fo…
We compute the limiting distributions of the largest eigenvalue of a complex Gaussian sample covariance matrix when both the number of samples and the number of variables in each sample become large. When all but finitely many, say $r$, eigenvalues of the covariance matrix are the same, the dependence of the limiting distribution of the largest eigenvalue of the sample covariance matrix on those distinguished $r$ eigenvalues of the covariance matrix is completely characterized in terms of an infinite sequence of new distribution functions that generalize the Tracy-Widom distributions of the ra…
In this article, we establish a limiting distribution for eigenvalues of a class of auto-covariance matrices. The same distribution has been found in the literature for a regularized version of these auto-covariance matrices. The original non-regularized auto-covariance matrices are non invertible which introduce supplementary diffculties for the study of their eigenvalues through Girko's Hermitization scheme. The key result in this paper is a new polynomial lower bound for the least singular value of the resolvent matrices associated to a rank-defective quadratic function of a random matrix w…
This work is concerned with finite range bounds on the variance of individual eigenvalues of random covariance matrices, both in the bulk and at the edge of the spectrum. In a preceding paper, the author established analogous results for Wigner matrices and stated the results for covariance matrices. They are proved in the present paper. Relying on the LUE example, which needs to be investigated first, the main bounds are extended to complex covariance matrices by means of the Tao, Vu and Wang Four Moment Theorem and recent localization results by Pillai and Yin. The case of real covariance ma…
Bessel processes $(X_{t,k})_{t\ge0}$ in $N$ dimensions are classified via associated root systems and multiplicity constants $k\ge0$. They describe interacting Calogero-Moser-Suther\-land particle systems with $N$ particles and are related to $β$-Hermite and $β$-Laguerre ensembles. Recently, several central limit theorems were derived for fixed $t>0$, fixed starting points, and $k\to\infty$. In this paper we extend the CLT in the A-case from start in 0 to arbitrary starting distributions by using a limit result for the corresponding Bessel functions. We also determine the eigenvalues and eigen…
This note presents some central limit theorems for the eigenvalue counting function of Wigner matrices in the form of suitable translations of results by Gustavsson and O'Rourke on the limiting behavior of eigenvalues inside the bulk of the semicircle law for Gaussian matrices. The theorems are then extended to large families of Wigner matrices by the Tao and Vu Four Moment Theorem. Similar results are developed for covariance matrices.
We study the universality of the eigenvalue statistics of the covariance matrices $\frac{1}{n}M^* M$ where $M$ is a large $p\times n$ matrix obeying condition $\bf{C1}$. In particular, as an application, we prove a variant of universality results regarding the smallest singular value of $M_{p,n}$. This paper is an extension of the results in \cite{tvcovariance} from the bulk of the spectrum up to the edge.
This work is concerned with finite range bounds on the variance of individual eigenvalues of Wigner random matrices, in the bulk and at the edge of the spectrum, as well as for some intermediate eigenvalues. Relying on the GUE example, which needs to be investigated first, the main bounds are extended to families of Hermitian Wigner matrices by means of the Tao and Vu Four Moment Theorem and recent localization results by Erdös, Yau and Yin. The case of real Wigner matrices is obtained from interlacing formulas. As an application, bounds on the expected 2-Wasserstein distance between the empir…
For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), γ^{-1} \leq \frac{N}{n} \leq γ$ where $γ\in (0,\infty),$ we obtain consistency rates in the form of CLTs for separated spikes tending to infinity fast enough whenever $M$ grows slightly slower than $n: \lim_{n \to \infty}{\frac{\sqrt{\log{n}}}{\log{\frac{n}{M(n)}}}}=0.$ Our results fill a gap in the existing literature in which the largest range covered for the number of spikes has been $o(n^{1/6})$ an…
We consider $N$ by $N$ deformed Wigner random matrices of the form $X_N=H_N+A_N$, where $H_N$ is a real symmetric or complex Hermitian Wigner matrix and $A_N$ is a deterministic real bounded diagonal matrix. We prove a universal Central Limit Theorem for the linear eigenvalue statistics of $X_N$ for all mesoscopic scales both in the spectral bulk and at regular edges where the global eigenvalue density vanishes as a square root. The method relies on the characteristic function method in [47], local laws for the Green function of $X_N$ in [3, 46, 51] and analytic subordination properties of the…
In this paper, we consider a data matrix $X\in\mathbb{C}^{N\times M}$ where all the columns are i.i.d. samples being $N$ dimensional complex Gaussian of mean zero and covariance $Σ\in\mathbb{C}^{N\times N}$. Here the population matrix $Σ$ is of finite rank perturbation of the identity matrix. This is the "spiked population model" first proposed by Johnstone in \cite{21}. As $M, N\to\infty$ but $M/N = γ\in(1, \infty)$, we first establish in this paper the asymptotic distribution of the smallest eigenvalue of the sample covariance matrix $S:= XX^*/M$. It also exhibits a phase transition phenomen…
We establish a large-deviations principle for the largest eigenvalue of a generalized sample covariance matrix, meaning a matrix proportional to $Z^T ΓZ$, where $Z$ has i.i.d. real or complex entries and $Γ$ is not necessarily the identity. We treat the classical case when $Z$ is Gaussian and $Γ$ is positive definite, but we also cover two orthogonal extensions: Either the entries of $Z$ can instead be sharp sub-Gaussian, a class including Rademacher and uniform distributions, where we find the same rate function as for the Gaussian model; or $Γ$ can have negative eigenvalues if $Z$ remains Ga…
We consider $n\times n$ real symmetric and Hermitian Wigner random matrices $n^{-1/2}W$ with independent (modulo symmetry condition) entries and the (null) sample covariance matrices $n^{-1}X^*X$ with independent entries of $m\times n$ matrix $X$. Assuming first that the 4th cumulant (excess) $κ_4$ of entries of $W$ and $X$ is zero and that their 4th moments satisfy a Lindeberg type condition, we prove that linear statistics of eigenvalues of the above matrices satisfy the central limit theorem (CLT) as $n\to\infty$, $m\to\infty$, $m/n\to c\in[0,\infty)$ with the same variance as for Gaussian …
We provide bounds of Berry-Esseen type for fundamental limit theorems in operator-valued free probability theory such as the operator-valued free Central Limit Theorem and the asymptotic behaviour of distributions of operator-valued matrices. Our estimates are on the level of operator-valued Cauchy transforms and the Lévy distance. We address the single-variable as well as the multivariate setting for which we consider linear matrix pencils and noncommutative polynomials as test functions. The estimates are in terms of operator-valued moments and yield the first quantitative bounds on the Lévy…
Consider the sample covariance matrix $$Σ^{1/2}XX^TΣ^{1/2}$$ where $X$ is an $M\times N$ random matrix with independent entries and $Σ$ is an $M\times M$ diagonal matrix. It is known that if $Σ$ is deterministic, then the fluctuation of $$\sum_if(λ_i)$$ converges in distribution to a Gaussian distribution. Here $\{λ_i\}$ are eigenvalues of $Σ^{1/2}XX^TΣ^{1/2}$ and $f$ is a good enough test function. In this paper we consider the case that $Σ$ is random and show that the fluctuation of $$\frac{1}{\sqrt N}\sum_if(λ_i)$$ converges in distribution to a Gaussian distribution. This phenomenon implie…
This paper is to investigate the spectral properties of sample covariance matrices under a more general population. We consider a class of matrices of the form $\mathbf S_n=\frac1n\mathbf B_n\mathbf X_n\mathbf X_n^*\mathbf B_n^*$, where $\mathbf B_n$ is a $p\times m$ non-random matrix and $\mathbf X_n$ is an $m\times n$ matrix consisting of i.i.d standard complex entries. $p/n\to c\in (0,\infty)$ as $n\to \infty$ while $m$ can be arbitrary. We proved that under some mild assumptions, with probability 1, there will be no eigenvalues in any closed interval contained in an open interval outside t…
Consider a sample of a centered random vector with unit covariance matrix. We show that under certain regularity assumptions, and up to a natural scaling, the smallest and the largest eigenvalues of the empirical covariance matrix converge, when the dimension and the sample size both tend to infinity, to the left and right edges of the Marchenko--Pastur distribution. The assumptions are related to tails of norms of orthogonal projections. They cover isotropic log-concave random vectors as well as random vectors with i.i.d. coordinates with almost optimal moment conditions. The method is a refi…
We consider a multivariate heavy-tailed stochastic volatility model and analyze the large-sample behavior of its sample covariance matrix. We study the limiting behavior of its entries in the infinite-variance case and derive results for the ordered eigenvalues and corresponding eigenvectors. Essentially, we consider two different cases where the tail behavior either stems from the i.i.d. innovations of the process or from its volatility sequence. In both cases, we make use of a large deviations technique for regularly varying time series to derive multivariate $α$-stable limit distributions o…
The paper proves several limit theorems for linear eigenvalue statistics of overlapping Wigner and sample covariance matrices. It is shown that the covariance of the limiting multivariate Gaussian distribution is diagonalized by choosing the Chebyshev polynomials of the first kind as the basis for the test function space. The covariance of linear statistics for the Chebyshev polynomials of sufficiently high degree depends only on the first two moments of the matrix entries. Proofs are based on a graph-theoretic interpretation of the Chebyshev linear statistics as sums over non-backtracking cyc…
We show central limit theorems (CLT) for the Stieltjes transforms or more general analytic functions of symmetric matrices with independent heavy tailed entries, including entries in the domain of attraction of $α$-stable laws and entries with moments exploding with the dimension, as in the adjacency matrices of Erdös-Rényi graphs. For the second model, we also prove a central limit theorem of the moments of its empirical eigenvalues distribution. The limit laws are Gaussian, but unlike to the case of standard Wigner matrices, the normalization is the one of the classical CLT for independent r…
Let $(\varepsilon_{t})_{t>0}$ be a sequence of independent real random vectors of $p$-dimension and let $X_T= \sum_{t=s+1}^{s+T}\varepsilon_t\varepsilon^T_{t-s}/T$ be the lag-$s$ ($s$ is a fixed positive integer) auto-covariance matrix of $\varepsilon_t$. Since $X_T$ is not symmetric, we consider its singular values, which are the square roots of the eigenvalues of $X_TX^T_T$. Therefore, the purpose of this paper is to investigate the limiting behaviors of the eigenvalues of $X_TX^T_T$ in two aspects. First, we show that the empirical spectral distribution of its eigenvalues converges to a non…
It is known (Hofmann-Credner and Stolz (2008)) that the convergence of the mean empirical spectral distribution of a sample covariance matrix W_n = 1/n Y_n Y_n^t to the Marčenko-Pastur law remains unaffected if the rows and columns of Y_n exhibit some dependence, where only the growth of the number of dependent entries, but not the joint distribution of dependent entries needs to be controlled. In this paper we show that the well-known CLT for traces of powers of W_n also extends to the dependent case.
In this paper, we consider a data matrix $X_N\in\mathbb{R}^{N\times p}$ where all the rows are i.i.d. samples in $\mathbb{R}^p$ of mean zero and covariance matrix $Σ\in\mathbb{R}^{p\times p}$. Here the population matrix $Σ$ is of finite rank perturbation of the identity matrix. This is the "spiked population model" first proposed by Johnstone. As $N, p\to\infty$ but $N/p \to γ\in(1, \infty)$, for the sample covariance matrix $S_N := X_NX_N^T/N$, we establish the joint distribution of the largest and the smallest few packs of eigenvalues. Inside each pack, they will behave the same as the eigen…
In this paper, we shall investigate the almost sure limits of the largest and smallest eigenvalues of a quaternion sample covariance matrix. Suppose that $\mathbf X_n$ is a $p\times n$ matrix whose elements are independent quaternion variables with mean zero, variance 1 and uniformly bounded fourth moments. Denote $\mathbf S_n=\frac{1}{n}\mathbf X_n\mathbf X_n^*$. In this paper, we shall show that $s_{\max}\left(\mathbf S_n\right)=s_{p}\left(\mathbf S_n\right)\to\left(1+\sqrt y\right)^2, a.s.$ and $s_{\min}\left(\mathbf S_n\right)\to\left(1-\sqrt y\right)^2,a.s.$ as $n\to\infty$, where $y=\lim…
