We study point process convergence for sequences of iid random walks. The objective is to derive asymptotic theory for the extremes of these random walks. We show convergence of the maximum random walk to the Gumbel distribution under the existence of a $(2+δ)$th moment. We make heavily use of precise large deviation results for sums of iid random variables. As a consequence, we derive the joint convergence of the off-diagonal entries in sample covariance and correlation matrices of a high-dimensional sample whose dimension increases with the sample size. This generalizes known results on the asymptotic Gumbel property of the largest entry.
We study the limiting spectral distribution of sample covariance matrices $XX^T$, where $X$ are $p\times n$ random matrices with correlated entries, for the cases $p/n\to y\in [0,\infty)$. If $y>0$, we obtain the Marčenko-Pastur distribution and in the case $y=0$ the semicircle distribution (after appropriate rescaling). The entries we consider are Curie-Weiss spins, which are correlated random signs, where the degree of the correlation is governed by an inverse temperature $β>0$. The model exhibits a phase transition at $β=1$. The correlation between any two entries decays at a rate of $O(np)…
Let $T$ be an $n\times n$ random matrix, such that each diagonal entry $T_{i,i}$ is a continuous random variable, independent from all the other entries of $T$. Then for every $n\times n$ matrix $A$ and every $t\ge0$ $$ \p\Big[|\det(A+T)|^{1/n}\le t\Big]\le2bnt, $$ where $b>0$ is a uniform upper bound on the densities of $T_{i,i}$.
We obtain the limiting spectral distribution for large sample covariance matrices associated with random vectors having graph-dependent entries under the assumption that the interdependence among the entries grows with the sample size n. Our results are tight. In particular, they give necessary and sufficient conditions for the Marchenko-Pastur theorem for sample covariance matrices with m-dependent orthonormal elements when m = o(n).
We extend the results about the fluctuations of the matrix entries of regular functions of Wigner matrices to the case of sample covariance random matrices.
We establish a large deviation principle for the empirical spectral measure of a sample covariance matrix with sub-Gaussian entries, which extends Bordenave and Caputo's result for Wigner matrices having the same type of entries [7]. To this aim, we need to establish an asymptotic freeness result for rectangular free convolution, more precisely, we give a bound in the subordination formula for information-plus-noise matrices.
We study the empirical spectral distribution (ESD) of symmetric random matrices with ergodic entries on the diagonals. We observe that for entries with correlations that decay to 0, when the distance of the diagonal entries becomes large the limiting ESD is the well known semicircle law. If it does not decay to 0 (and have the same sign) the semicircle law cannot be the limit of the ESD. This is good agreement with results on exchangeable processes analysed in Friesen and Löwe (2013a) and Hochstättler et al. (2016).
We show that the empirical distribution of the eigenvalues of the sample covariance matrix of certain random vectors (not necessarily independent entries) with bounded marginal $L^{4}$ norms converges weakly to a compound free Poisson distribution.
We give a non-asymptotic bound on the spectral norm of a $d\times d$ matrix $X$ with centered jointly Gaussian entries in terms of the covariance matrix of the entries. In some cases, this estimate is sharp and removes the $\sqrt{\log d}$ factor in the noncommutative Khintchine inequality.
It is a classical result of Wigner that for an hermitian matrix with independent entries on and above the diagonal, the mean empirical eigenvalue distribution converges weakly to the semicircle law as matrix size tends to infinity. In this paper, we prove analogs of Wigner's theorem for random matrices taken from all infinitesimal versions of classical symmetric spaces. This is a class of models which contains those studied by Wigner and Dyson, along with seven others arising in condensed matter physics. Like Wigner's, our results are universal in that they only depend on certain assumptions a…
We investigate the spectral distribution of large sample covariance matrices with independent columns and entries in the columns that stem from Markov chains. We characterize the limiting spectral densities by their moments. Correspondingly, the proof is based on a moment method.
We prove optimal local law, bulk universality and non-trivial decay for the off-diagonal elements of the resolvent for a class of translation invariant Gaussian random matrix ensembles with correlated entries.
Let $(σ_N^{(i)})_{i \in I}$ be a family of symmetric permutations of the entries of a Wigner matrix $\mathbf{W}_N$. We characterize the limiting traffic distribution of the corresponding family of dependent Wigner matrices $(\mathbf{W}_N^{σ_N^{(i)}})_{i \in I}$ in terms of the geometry of the permutations. We also consider the analogous problem for the limiting joint distribution of $(\mathbf{W}_N^{σ_N^{(i)}})_{i \in I}$. In particular, we obtain a description in terms of semicircular families with general covariance structures. As a special case, we derive necessary and sufficient conditions …
We find the joint generalized singular value distribution and largest generalized singular value distributions of the $β$-MANOVA ensemble with positive diagonal covariance, which is general. This has been done for the continuous $β> 0$ case for identity covariance (in eigenvalue form), and by setting the covariance to $I$ in our model we get another version. For the diagonal covariance case, it has only been done for $β= 1,2,4$ cases (real, complex, and quaternion matrix entries). This is in a way the first second-order $β$-ensemble, since the sampler for the generalized singular values of the…
The eigenvector empirical spectral distribution (VESD) is a useful tool in studying the limiting behavior of eigenvalues and eigenvectors of covariance matrices. In this paper, we study the convergence rate of the VESD of sample covariance matrices to the deformed Marčenko-Pastur (MP) distribution. Consider sample covariance matrices of the form $Σ^{1/2} X X^* Σ^{1/2}$, where $X=(x_{ij})$ is an $M\times N$ random matrix whose entries are independent random variables with mean zero and variance $N^{-1}$, and $Σ$ is a deterministic positive-definite matrix. We prove that the Kolmogorov distance …
We investigate the spectral distribution of random matrix ensembles with correlated entries. We consider symmetric matrices with real valued entries and stochastically independent diagonals. Along the diagonals the entries may be correlated. We show that under sufficiently nice moment conditions the empirical eigenvalue distribution converges almost surely weakly to the semi-circle law.
Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing ones as well as generates new results. We show that under suitable assumptions on the entries of $X_p$, the limiting spectral distribution exists in probability or almost surely. The moments are descri…
We study sample covariance matrices of the form $W=\frac 1n C C^T$, where $C$ is a $k\times n$ matrix with i.i.d. mean zero entries. This is a generalization of so-called Wishart matrices, where the entries of $C$ are independent and identically distributed standard normal random variables. Such matrices arise in statistics as sample covariance matrices, and the high-dimensional case, when $k$ is large, arises in the analysis of DNA experiments. We investigate the large deviation properties of the largest and smallest eigenvalues of $W$ when either $k$ is fixed and $n\to \infty$, or $k_n\to \i…
We study the distribution of the outliers in the spectrum of finite rank deformations of Wigner random matrice under the assumption that the off-diagonal matrix entries have uniformly bounded fifth moment and the diagonal entries have uniformly bounded third moment. Using our recent results on the fluctuation of resolvent entries [31],[28], and ideas from [9], we extend results by M.Capitaine, C.Donati-Martin, and D.Féral [12], [13].
We establish a large-deviations principle for the largest eigenvalue of a generalized sample covariance matrix, meaning a matrix proportional to $Z^T ΓZ$, where $Z$ has i.i.d. real or complex entries and $Γ$ is not necessarily the identity. We treat the classical case when $Z$ is Gaussian and $Γ$ is positive definite, but we also cover two orthogonal extensions: Either the entries of $Z$ can instead be sharp sub-Gaussian, a class including Rademacher and uniform distributions, where we find the same rate function as for the Gaussian model; or $Γ$ can have negative eigenvalues if $Z$ remains Ga…
We study the renormalized real sample covariance matrix $H=X^TX/\sqrt{MN}-\sqrt{M/N}$ with $N/M\rightarrow0$ as $N, M\rightarrow \infty$ in this paper. And we always assume $M=M(N)$. Here $X=[X_{jk}]_{M\times N}$ is an $M\times N$ real random matrix with i.i.d entries, and we assume $\mathbb{E}|X_{11}|^{5+δ}<\infty$ with some small positive $δ$. The Stieltjes transform $m_N(z)=N^{-1}Tr(H-z)^{-1}$ and the linear eigenvalue statistics of $H$ are considered. We mainly focus on the asymptotic expansion of $\mathbb{E}\{m_N(z)\}$ in this paper. Then for some fine test function, a central limit theor…
We exhibit an explicit formula for the spectral density of a (large) random matrix which is a diagonal matrix whose spectral density converges, perturbated by the addition of a symmetric matrix with Gaussian entries and a given (small) limiting variance profile.
Let $\mathbf X$ be a random matrix whose pairs of entries $X_{jk}$ and $X_{kj}$ are correlated and vectors $ (X_{jk},X_{kj})$, for $1\le j<k\le n$, are mutually independent. Assume that the diagonal entries are independent from off-diagonal entries as well. We assume that $\mathbb{E} X_{jk}=0$, $\mathbb{E} X_{jk}^2=1$, for any $j,k=1,\ldots,n$ and $\mathbb{E} X_{jk}X_{kj}=ρ$ for $1\le j<k\le n$. Let $\mathbf M_n$ be a non-random $n\times n$ matrix with $\|\mathbf M_n\|\le Kn^Q$, for some positive constants $K>0$ and $Q\ge 0$. Let $s_n(\mathbf X+\mathbf M_n)$ denote the least singular value of …
In this article, we will consider Wishart Matrices with correlated entries, but with a strictly log-concave law. It has been shown by A.Pajor and L.Pastur that the empirical measures of such matrices converges. We will show, under some symmetry and convergence hypotheses, that in this case the central limit theorem for linear statistics holds around their limit, and deduce the convergence of the support to the support of the limiting measure. We also provide the convergence of the Expectation and the Covariance.
We consider the sample covariance matrices of large data matrices which have i.i.d. complex matrix entries and which are non-square in the sense that the difference between the number of rows and the number of columns tends to infinity. We show that the second-order correlation function of the characteristic polynomial of the sample covariance matrix is asymptotically given by the sine kernel in the bulk of the spectrum and by the Airy kernel at the edge of the spectrum. Similar results are given for real sample covariance matrices.
This paper deals with symmetric random matrices whose upper diagonal entries are obtained from a linear random field with heavy tailed noise. It is shown that the maximum eigenvalue and the spectral radius of such a random matrix with dependent entries converge to the Frechét distribution after appropriate scaling. This extends a seminal result of Soshnikov(2004) when the tail index is strictly less than one.
For symmetric random matrices with correlated entries, which are functions of independent random variables, we show that the asymptotic behavior of the empirical eigenvalue distribution can be obtained by analyzing a Gaussian matrix with the same covariance structure. This class contains both cases of short and long range dependent random fields. The technique is based on a blend of blocking procedure and Lindeberg's method. This method leads to a variety of interesting asymptotic results for matrices with dependent entries, including applications to linear processes as well as nonlinear Volte…
We consider large complex random sample covariance matrices obtained from "spiked populations", that is when the true covariance matrix is diagonal with all but finitely many eigenvalues equal to one. We investigate the limiting behavior of the largest eigenvalues when the population and the sample sizes both become large. Under some conditions on moments of the sample distribution, we prove that the asymptotic fluctuations of the largest eigenvalues are the same as for a complex Gaussian sample with the same true covariance. The real setting is also considered.
In this note, we extend the results about the fluctuations of the matrix entries of regular functions of Wigner random matrices obtained in arXiv:1103.3731 [math.PR] to Wigner matrices with non-i.i.d. entries provided certain Lindeberg type conditions for the fourth moments of the off-diagonal entries and the second moments of the diagonal entries are satisfied. In addition, we relax our conditions on the test functions and require that for some $s>3 \ \int (1+|k|)^{2s}\*|\hat{f}(k)|^2 \* dk <\infty.$
We consider complex sample covariance matrices $M_N=\frac{1}{N}YY^*$ where $Y$ is a $N \times p$ random matrix with i.i.d. entries $Y_{ij}, 1\leq i\leq N, 1\leq j \leq p$ with distribution $F$. Under some regularity and decay assumption on $F$, we prove universality of some local eigenvalue statistics in the bulk of the spectrum in the limit where $N\to \infty$ and $\lim_{N \to \infty}p/N =γ$ for any real number $γ\in (0, \infty)$.
In this article, we establish a limiting distribution for eigenvalues of a class of auto-covariance matrices. The same distribution has been found in the literature for a regularized version of these auto-covariance matrices. The original non-regularized auto-covariance matrices are non invertible which introduce supplementary diffculties for the study of their eigenvalues through Girko's Hermitization scheme. The key result in this paper is a new polynomial lower bound for the least singular value of the resolvent matrices associated to a rank-defective quadratic function of a random matrix w…
We establish a large deviation theorem for the empirical spectral distribution of random covariance matrices whose entries are independent random variables with mean 0, variance 1 and having controlled forth moments. Some new properties of Laguerre polynomials are also given.
In this paper we establish the limit of the empirical spectral distribution of quaternion sample covariance matrices. Suppose $\mathbf X_n = ({x_{jk}^{(n)}})_{p\times n}$ is a quaternion random matrix. For each $n$, the entries $\{x_{ij}^{(n)}\}$ are independent random quaternion variables with a common mean $μ$ and variance $σ^2>0$. It is shown that the empirical spectral distribution of the quaternion sample covariance matrix $\mathbf S_n=n^{-1}\mathbf X_n\mathbf X_n^*$ converges to the M-P law as $p\to\infty$, $n\to\infty$ and $p/n\to y\in(0,+\infty)$.
It is known (Hofmann-Credner and Stolz (2008)) that the convergence of the mean empirical spectral distribution of a sample covariance matrix W_n = 1/n Y_n Y_n^t to the Marčenko-Pastur law remains unaffected if the rows and columns of Y_n exhibit some dependence, where only the growth of the number of dependent entries, but not the joint distribution of dependent entries needs to be controlled. In this paper we show that the well-known CLT for traces of powers of W_n also extends to the dependent case.
We consider sample covariance matrices of the form $\mathcal{Q}=(Σ^{1/2}X)(Σ^{1/2} X)^*$, where the sample $X$ is an $M\times N$ random matrix whose entries are real independent random variables with variance $1/N$ and where $Σ$ is an $M\times M$ positive-definite deterministic matrix. We analyze the asymptotic fluctuations of the largest rescaled eigenvalue of $\mathcal{Q}$ when both $M$ and $N$ tend to infinity with $N/M\to d\in(0,\infty)$. For a large class of populations $Σ$ in the sub-critical regime, we show that the distribution of the largest rescaled eigenvalue of $\mathcal{Q}$ is giv…
We study the fluctuations of the matrix entries of regular functions of Wigner random matrices in the limit when the matrix size goes to infinity. In the case of the Gaussian ensembles (GOE and GUE) this problem was considered by A.Lytova and L.Pastur in J. Stat. Phys., v.134, 147-159 (2009). Our results are valid provided the off-diagonal matrix entries have finite fourth moment, the diagonal matrix entries have finite second moment, and the test functions have four continuous derivatives in a neighborhood of the support of the Wigner semicircle law.
In this paper we prove the universality of covariance matrices of the form $H_{N\times N}={X}^{\dagger}X$ where $X$ is an ${M\times N}$ rectangular matrix with independent real valued entries $x_{ij}$ satisfying $\mathbb{E}x_{ij}=0$ and $\mathbb{E}x^2_{ij}={\frac{1}{M}}$, $N$, $M\to \infty$. Furthermore it is assumed that these entries have sub-exponential tails or sufficiently high number of moments. We will study the asymptotics in the regime $N/M=d_N\in(0,\infty),\lim_{N\to\infty}d_N\neq0,\infty$. Our main result is the edge universality of the sample covariance matrix at both edges of the …
It is shown that the Kolmogorov distance between the spectral distribution function of a random covariance matrix $\frac1p XX^T$, where $X$ is a $n\times p$ matrix with independent entries and the distribution function of the Marchenko-Pastur law is of order $O(n^{-1/2})$. The bounds hold {\it uniformly} for any $p$, including $\frac pn$ equal or close to 1.
Consider an $N$ by $N$ matrix $X$ of complex entries with iid real and imaginary parts. We show that the local density of eigenvalues of $X^*X$ converges to the Marchenko-Pastur law on the optimal scale with probability $1$. We also obtain rigidity of the eigenvalues in the bulk and near both hard and soft edges. Here we avoid logarithmic and polynomial corrections by working directly with high powers of expectation of the Stieltjes transforms. We work under the assumption that the entries have a finite 4th moment and are truncated at $N^{1/4}$. In this work we simplify and adapt the methods f…
Centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds are determined by their covariance operators. We consider centered GRFs given as variational solutions to coloring operator equations driven by spatial white noise, with an elliptic self-adjoint pseudodifferential coloring operator from the Hörmander class. This includes the Matérn class of GRFs as a special case. Using biorthogonal multiresolution analyses on the manifold, we prove that the precision and covariance operators, respectively, may be ide…
A non-commutative non-selfadjoint random variable z is called R-diagonal, if its *-distribution is invariant under multiplication by free unitaries: if a unitary w is *-free from z, then the *-distribution of z is the same as that of wz. Using Voiculescu's microstates definition of free entropy, we show that the R-diagonal elements are characterized as having the largest free entropy among all variables y with a fixed distribution of y^*y. More generally, let Z be a d*d matrix whose entries are non-commutative random variables X_{ij}. Then the free entropy of the family {X_{ij}} of the entries…
We study the asymptotic behavior of the appropriately scaled and possibly perturbed spectral measure $μ$ of large random real symmetric matrices with heavy tailed entries. Specifically, consider the N by N symmetric matrix $Y_N^σ$ whose (i,j) entry is $σ(i/N,j/N)X_{ij}$ where $(X_{ij}, 0<i<j+1<\infty)$ is an infinite array of i.i.d real variables with common distribution in the domain of attraction of an $α$-stable law, $0<α<2$, and $σ$ is a deterministic function. For a random diagonal $D_N$ independent of $Y_N^σ$ and with appropriate rescaling $a_N$, we prove that the distribution $μ$ of $a_…
In this paper we study the joint distributional convergence of the largest eigenvalues of the sample covariance matrix of a $p$-dimensional time series with iid entries when $p$ converges to infinity together with the sample size $n$. We consider only heavy-tailed time series in the sense that the entries satisfy some regular variation condition which ensures that their fourth moment is infinite. In this case, Soshnikov [31, 32] and Auffinger et al. [2] proved the weak convergence of the point processes of the normalized eigenvalues of the sample covariance matrix towards an inhomogeneous Pois…
The joint distribution of two off-diagonal Wishart matrix elements was useful in recent work on geometric probability [Finch 2010]. Not finding such formulas in the literature, we report these here.
We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional Gaussian random vector, one needs at least a number of samples proportional to $d$. Furthermore, we show that with $n \ll d$ samples, the hypothesis that two given coordinates are fully correlated, when all other coordinates are conditioned to be zero, cannot be told apart from the hypothesis that the two are uncorrelated.
We consider the eigenvalues of sample covariance matrices of the form $\mathcal{Q}=(Σ^{1/2}X)(Σ^{1/2}X)^*$. The sample $X$ is an $M\times N$ rectangular random matrix with real independent entries and the population covariance matrix $Σ$ is a positive definite diagonal matrix independent of $X$. Assuming that the limiting spectral density of $Σ$ exhibits convex decay at the right edge of the spectrum, in the limit $M, N \to \infty$ with $N/M \to d\in(0,\infty)$, we find a certain threshold $d_+$ such that for $d>d_+$ the limiting spectral distribution of $\mathcal{Q}$ also exhibits convex deca…
