We consider a class of real random matrices with dependent entries and show that the limiting empirical spectral distribution is given by the Marchenko-Pastur law. Additionally, we establish a rate of convergence of the expected empirical spectral distribution.
We prove the Marchenko-Pastur theorem for random matrices with i.i.d. rows and a general dependence structure within the rows by a simple modification of the standard Cauchy-Stieltjes resolvent method.
n this paper, we prove a result linking the square and the rectangular R-transforms, the consequence of which is a surprising relation between the square and rectangular versions the free additive convolutions, involving the Marchenko-Pastur law. Consequences on random matrices, on infinite divisibility and on the arithmetics of the square versions of the free additive and multiplicative convolutions are given.
We show that a weak concentration property for quadratic forms of isotropic random vectors ${\bf x}$ is necessary and sufficient for the validity of the Marchenko-Pastur theorem for sample covariance matrices of random vectors having the form $C{\bf x}$, where $C$ is any rectangular matrix with orthonormal rows. We also obtain some general conditions guaranteeing the weak concentration property.
We study the limiting spectral distribution of large-dimensional sample covariance matrices associated with symmetric random tensors formed by $\binom{n}{d}$ different products of $d$ variables chosen from $n$ independent standardized random variables. We find optimal sufficient conditions for this distribution to be the Marchenko-Pastur law in the case $d=d(n)$ and $n\to\infty$. Our conditions reduce to $d^2=o(n)$ when the variables have uniformly bounded fourth moments. The proofs are based on a new concentration inequality for quadratic forms in symmetric random tensors and a law of large n…
We consider the limiting spectral distribution of matrices of the form $\frac{1}{2b_{n}+1} (R + X)(R + X)^{*}$, where $X$ is an $n\times n$ band matrix of bandwidth $b_{n}$ and $R$ is a non random band matrix of bandwidth $b_{n}$. We show that the Stieltjes transform of ESD of such matrices converges to the Stieltjes transform of a non-random measure. And the limiting Stieltjes transform satisfies an integral equation. For $R=0$, the integral equation yields the Stieltjes transform of the Marchenko-Pastur law.
We study the asymptotic of the spectral distribution for large empirical covariance matrices composed of independent Multifractal Random Walk processes. The asymptotic is taken as the observation lag shrinks to 0. In this setting, we show that there exists a limiting spectral distribution whose Stieltjes transform is uniquely characterized by equations which we specify. We also illustrate our results by numerical simulations.
We prove the Marchenko-Pastur law for the eigenvalues of $p \times p$ sample covariance matrices in two new situations where the data does not have independent coordinates. In the first scenario - the block-independent model - the $p$ coordinates of the data are partitioned into blocks in such a way that the entries in different blocks are independent, but the entries from the same block may be dependent. In the second scenario - the random tensor model - the data is the homogeneous random tensor of order $d$, i.e. the coordinates of the data are all $\binom{n}{d}$ different products of $d$ va…
Lukacs type characterization of Marchenko--Pastur distribution in free probability is studied here. We prove that for free $\mathbb{X}$ and $\mathbb{Y}$ when conditional moments of order $1$ and $-1$ of $(\mathbb{X+Y})^{-1/2}\mathbb{X}(\mathbb{X+Y})^{-1/2}$ given $\mathbb{X+Y}$ are constant then $\mathbb{X}$ and $\mathbb{Y}$ have Marchenko--Pastur distribution.
Let $\mathbf X=(X_{jk})$ denote a $n\times p$ random matrix with entries $X_{jk}$, which are independent for $1\le j\le n, 1\le k\le p$. Let $n,p$ tend to infinity such that $\frac np=y+O(n^{-1})\in(0,1]$. For those values of $n,p$ we investigate the rate of convergence of the expected spectral distribution function of the matrix $\mathbf W=\frac1{ p}\mathbf X\mathbf X^*$ to the Marchenko-Pastur law with parameter $y$. Assuming the conditions $\mathbf E X_{jk}=0$, $\mathbf E X_{jk}^2=1$ and $ \quad \quad \quad \quad \quad \quad \quad \sup_{n,p\ge1}\sup_{1\le j\le n,1\le k\le p}\mathbf E |X_{jk…
Let $\mathbf X=(X_{jk})$ denote $n\times p$ random matrix with entries $X_{jk}$, which are independent for $1\le j\le n,1\le k\le p$. We consider the rate of convergence of empirical spectral distribution function of the matrix $\mathbf W=\frac1p\mathbf X\mathbf X^*$ to the Marchenko--Pastur law. We assume that $\mathbf E X_{jk}=0$, $\mathbf E X_{jk}^2=1$ and that the distributions of the matrix elements $X_{jk}$ have a uniformly sub exponential decay in the sense that there exists a constant $\varkappa>0$ such that for any $1\le j \le n,\,1\le k\le p $ and any $t\ge 1$ we have $$ \mathbf{ Pr}…
The celebrated Marchenko-Pastur theorem gives the asymptotic spectral distribution of sums of random, independent, rank-one projections. Its main hypothesis is that these projections are more or less uniformly distributed on the first grassmannian, which implies for example that the corresponding vectors are delocalized, i.e. are essentially supported by the whole canonical basis. In this paper, we propose a way to drop this delocalization assumption and we generalize this theorem to a quite general framework, including random projections whose corresponding vectors are localized, i.e. with so…
Let $X_N$ be a $N\times N$ matrix whose entries are i.i.d. complex random variables with mean zero and variance $\frac{1}{N}$. We study the asymptotic spectral distribution of the eigenvalues of the covariance matrix $X_N^*X_N$ for $N\to\infty$. We prove that the empirical density of eigenvalues in an interval $[E,E+η]$ converges to the Marchenko-Pastur law locally on the optimal scale, $N η/\sqrt{E} \gg (\log N)^b$, and in any interval up to the hard edge, $\frac{(\log N)^b}{N^2}\lesssim E \leq 4-κ$, for any $κ>0$. As a consequence, we show the complete delocalization of the eigenvectors.
Consider an $N$ by $N$ matrix $X$ of complex entries with iid real and imaginary parts. We show that the local density of eigenvalues of $X^*X$ converges to the Marchenko-Pastur law on the optimal scale with probability $1$. We also obtain rigidity of the eigenvalues in the bulk and near both hard and soft edges. Here we avoid logarithmic and polynomial corrections by working directly with high powers of expectation of the Stieltjes transforms. We work under the assumption that the entries have a finite 4th moment and are truncated at $N^{1/4}$. In this work we simplify and adapt the methods f…
We construct a diffusive matrix model for the $β$-Wishart (or Laguerre) ensemble for general continuous $β\in [0,2]$, which preserves invariance under the orthogonal/unitary group transformation. Scaling the Dyson index $β$ with the largest size $M$ of the data matrix as $β=2c/M$ (with $c$ a fixed positive constant), we obtain a family of spectral densities parametrized by $c$. As $c$ is varied, this density interpolates continuously between the Mar\vcenko-Pastur ($c\to \infty$ limit) and the Gamma law ($c\to 0$ limit). Analyzing the full Stieltjes transform (resolvent) equation, we obtain as …
This paper is the first chapter of three of the author's undergraduate thesis. We study the random matrix ensemble of covariance matrices arising from random $(d_b, d_w)$-regular bipartite graphs on a set of $M$ black vertices and $N$ white vertices, for $d_b \gg \log^4 N$. We simultaneously prove that the Green's functions of these covariance matrices and the adjacency matrices of the underlying graphs agree with the corresponding limiting law (e.g. Marchenko-Pastur law for covariance matrices) down to the optimal scale. This is an improvement from the previously known mesoscopic results. We …
Beta Laguerre ensembles which are generalizations of Wishart ensembles and Laguerre ensembles can be realized as eigenvalues of certain random tridiagonal matrices. Analogous to the Wishart ($β=1$) case and the Laguerre ($β= 2$) case, for fixed $β$, it is known that the empirical distribution of the eigenvalues of these ensembles converges weakly to Marchenko--Pastur distributions, almost surely. The paper restudies the limiting behavior of the empirical distribution but in regimes where the parameter $β$ is allowed to vary as a function of the matrix size $N$. We show that the above Marchenko…
We consider the complex eigenvalues of a Wishart type random matrix model $X=X_1 X_2^*$, where two rectangular complex Ginibre matrices $X_{1,2}$ of size $N\times (N+ν)$ are correlated through a non-Hermiticity parameter $τ\in[0,1]$. For general $ν=O(N)$ and $τ$ we obtain the global limiting density and its support, given by a shifted ellipse. It provides a non-Hermitian generalisation of the Marchenko-Pastur distribution, which is recovered at maximal correlation $X_1=X_2$ when $τ=1$. The square root of the complex Wishart eigenvalues, corresponding to the non-zero complex eigenvalues of the …
For a class of symmetric random matrices whose entries are martingale differences adapted to an increasing filtration, we prove that under a Lindeberg-like condition, the empirical spectral distribution behaves asymptotically similarly to a corresponding matrix with independent centered Gaussian entries having the same variances. Under a slightly reinforced condition, the approximation holds in the almost sure sense. We also point out several sufficient regularity conditions imposed to the variance structure for convergence to the semicircle law or the Marchenko-Pastur law and other convergenc…
The paper studies the limiting behavior of spectral measures of random Jacobi matrices of Gaussian, Wishart and MANOVA beta ensembles. We show that the spectral measures converge weakly to a limit distribution which is the semicircle distribution, Marchenko-Pastur distributions or Kesten-Mckey distributions, respectively. The Gaussian fluctuation around the limit is then investigated.
We consider sparse sample covariance matrices $\frac1{np_n}\mathbf X\mathbf X^*$, where $\mathbf X$ is a sparse matrix of order $n\times m$ with the sparse probability $p_n$. We prove the local Marchenko--Pastur law in some complex domain assuming that $np_n>\log^βn$, $β>0$ and some $(4+δ)$-moment condition is fulfilled, $δ>0$.
We consider $n\times n$ real symmetric and hermitian random matrices $H_{n,m}$ equals the sum of a non-random matrix $H_{n}^{(0)}$ matrix and the sum of $m$ rank-one matrices determined by $m$ i.i.d. isotropic random vectors with log-concave probability law and i.i.d. random amplitudes $\{τ_{α}\}_{α=1}^{m}$. This is a generalization of the case of vectors uniformly distributed over the unit sphere, studied in [Marchenko-Pastur (1967)]. We prove that if $n\to \infty, m\to \infty, m/n\to c\in \lbrack 0,\infty)$ and that the empirical eigenvalue measure of $H_{n}^{(0)}$ converges weakly, then the…
We obtain the limiting spectral distribution for large sample covariance matrices associated with random vectors having graph-dependent entries under the assumption that the interdependence among the entries grows with the sample size n. Our results are tight. In particular, they give necessary and sufficient conditions for the Marchenko-Pastur theorem for sample covariance matrices with m-dependent orthonormal elements when m = o(n).
In this survey article, we give an introduction to two methods of proof in random matrix theory: The method of moments and the Stieltjes transform method. We thoroughly develop these methods and apply them to show both the semicircle law and the Marchenko-Pastur law for random matrices with independent entries. The material is presented in a pedagogical manner and is suitable for anyone who has followed a course in measure-theoretic probability theory.
We consider the random matrix obtained by picking vectors randomly from a large collection of mutually unbiased bases of $\mathbb{C}^n$, and prove that the spectral distribution converges to the Marchenko-Pastur law. This shows that vectors in mutually unbiased bases behave like random vectors. This phenomenon is similar to that of binary linear codes of dual distance at least 5, which was studied in previous work.
We extend the proof of the local semicircle law for generalized Wigner matrices given in [4] to the case when the matrix of variances has an eigenvalue $ -1 $. In particular, this result provides a short proof of the optimal local Marchenko-Pastur law at the hard edge (i.e. around zero) for sample covariance matrices $ \boldsymbol{\mathrm{X}}^\ast \boldsymbol{\mathrm{X}} $, where the variances of the entries of $ \boldsymbol{\mathrm{X}} $ may vary.
In this paper we show weak convergence of the empirical eigenvalue distribution and of the weighted spectral measure of the Jacobi ensemble, when one or both parameters grow faster than the dimension $n$. In these cases the limit measure is given by the Marchenko-Pastur law and the semicircle law, respectively. For the weighted spectral measure we also prove large deviation principles under this scaling, where the rate functions are those of the other classical ensembles.
We prove the convergence of the empirical spectral measure of Wishart matrices with size-dependent entries and characterize the limiting law by its moments. We apply our result to the cases where the entries are Bernoulli variables with parameter c=n or truncated heavy-tailed random variables. In both cases, when c goes to infinity or when the truncation is small, the limiting spectrum is a perturbation of the Marchenko-Pastur distribution and we compute its leading term.
We consider sample covariance matrices of the form $X^*X$, where $X$ is an $M \times N$ matrix with independent random entries. We prove the isotropic local Marchenko-Pastur law, i.e. we prove that the resolvent $(X^* X - z)^{-1}$ converges to a multiple of the identity in the sense of quadratic forms. More precisely, we establish sharp high-probability bounds on the quantity $\langle v, (X^* X - z)^{-1} w \rangle - \langle v,w\rangle m(z)$, where $m$ is the Stieltjes transform of the Marchenko-Pastur law and $v, w \in \mathbb C^N$. We require the logarithms of the dimensions $M$ and $N$ to be…
We prove that if $p\ge 1$ and $0< r\le p$ then the sequence $\binom{mp+r}{m}\frac{r}{mp+r}$, $m=0,1,2,...$, is positive definite, more precisely, is the moment sequence of a probability measure $μ(p,r)$ with compact support contained in $[0,+\infty)$. This family of measures encompasses the multiplicative free powers of the Marchenko-Pastur distribution as well as the Wigner's semicircle distribution centered at $x=2$. We show that if $p>1$ is a rational number, $0<r\le p$, then $μ(p,r)$ is absolutely continuous and its density $W_{p,r}(x)$ can be expressed in terms of the Meijer and the gener…
In this article, we will consider Wishart Matrices with correlated entries, but with a strictly log-concave law. It has been shown by A.Pajor and L.Pastur that the empirical measures of such matrices converges. We will show, under some symmetry and convergence hypotheses, that in this case the central limit theorem for linear statistics holds around their limit, and deduce the convergence of the support to the support of the limiting measure. We also provide the convergence of the Expectation and the Covariance.
To a $N \times N$ real symmetric matrix Kerov assigns a piecewise linear function whose local minima are the eigenvalues of this matrix and whose local maxima are the eigenvalues of its $(N-1) \times (N-1)$ submatrix. We study the scaling limit of Kerov's piecewise linear functions for Wigner and Wishart matrices. For Wigner matrices the scaling limit is given by the Verhik-Kerov-Logan-Shepp curve which is known from asymptotic representation theory. For Wishart matrices the scaling limit is also explicitly found, and we explain its relation to the Marchenko-Pastur limit spectral law.
We find the asymptotic spectral distribution of random Kummer matrix. Then we formulate and prove a~free analogue of HV independence property, which is known for classical Kummer and Gamma random variables and for Kummer and Wishart matrices. We also prove a related characterization of free--Kummer and free--Poisson (Marchenko-Pastur) non--commutative random variables.
It is shown that the Kolmogorov distance between the spectral distribution function of a random covariance matrix $\frac1p XX^T$, where $X$ is a $n\times p$ matrix with independent entries and the distribution function of the Marchenko-Pastur law is of order $O(n^{-1/2})$. The bounds hold {\it uniformly} for any $p$, including $\frac pn$ equal or close to 1.
In this paper, we consider N-dimensional real Wishart matrices Y in the class $W_{\mathbb{R}}(Σ,M)$ in which all but one eigenvalues of $Σ$ is 1. Let the non-trivial eigenvalue of $Σ$ be $1+τ$, then as N, $M\rightarrow\infty$, with $M/N=γ^2$ finite and non-zero, the eigenvalue distribution of $Y$ will converge into the Marchenko-Pastur distribution inside a bulk region. When $τ$ increases from zero, one starts to see a stray eigenvalue of Y outside of the support of the Marchenko-Pastur density. As the this stray eigenvalue leaves the bulk region, a phase transition will occur in the largest e…
In this note, we prove that the normalized trace of the resolvent of the beta-Laguerre ensemble eigenvalues is close to the Stieltjes transform of the Marchenko-Pastur (MP) distribution with very high probability, for values of the imaginary part greater than m^{-1+ε}. As an immediate corollary, we obtain convergence of the one-point density to the MP law on short scales. The proof serves to illustrate some simplifications of the method introduced in our previous work to prove a local semi-circle law for Gaussian beta-ensembles.
We study the limiting spectral distribution of sample covariance matrices $XX^T$, where $X$ are $p\times n$ random matrices with correlated entries, for the cases $p/n\to y\in [0,\infty)$. If $y>0$, we obtain the Marčenko-Pastur distribution and in the case $y=0$ the semicircle distribution (after appropriate rescaling). The entries we consider are Curie-Weiss spins, which are correlated random signs, where the degree of the correlation is governed by an inverse temperature $β>0$. The model exhibits a phase transition at $β=1$. The correlation between any two entries decays at a rate of $O(np)…
In this paper we define distributions on moment spaces corresponding to measures on the real line with an unbounded support. We identify these distributions as limiting distributions of random moment vectors defined on compact moment spaces and as distributions corresponding to random spectral measures associated with the Jacobi, Laguerre and Hermite ensemble from random matrix theory. For random vectors on the unbounded moment spaces we prove a central limit theorem where the centering vectors correspond to the moments of the Marchenko-Pastur distribution and Wigner's semi-circle law.
We study the spectrum of generalized Wishart matrices, defined as $\mathbf{F}=( X Y^\top + Y X^\top)/2T$, where $X$ and $Y$ are $N \times T$ matrices with zero mean, unit variance IID entries and such that $\mathbb{E}[X_{it} Y_{jt}]=c δ_{i,j}$. The limit $c=1$ corresponds to the Marcenko-Pastur problem. For a general $c$, we show that the Stietjes transform of $\mathbf{F}$ is the solution of a cubic equation. In the limit $c=0$, $T \gg N$ the density of eigenvalues converges to the Wigner semi-circle.
It is known that the empirical spectral distribution of random matrices obtained from linear codes of increasing length converges to the well-known Marchenko-Pastur law, if the Hamming distance of the dual codes is at least 5. In this paper, we prove that the convergence in probability is at least of the order $n^{-1/4}$ where $n$ is the length of the code.
It has been shown recently that the limit moments of $W(n)=B(n)B^{*}(n)$, where B(n) is a product of $p$ independent rectangular random matrices, are certain homogenous polynomials in the asymptotic dimensions of these matrices. Using the combinatorics of noncrossing partitions, we explicitly determine these polynomials and show that they are closely related to polynomials which can be viewed as multivariate Fuss-Narayana polynomials. Using this result, we compute the moments of the n-fold free multiplicative convolution of Marchenko-Pastur distributions with arbitrary shape parameters.
Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing ones as well as generates new results. We show that under suitable assumptions on the entries of $X_p$, the limiting spectral distribution exists in probability or almost surely. The moments are descri…
We consider matrix-valued processes described as solutions to stochastic differential equations of very general form. We study the family of the empirical measure-valued processes constructed from the corresponding eigenvalues. We show that the family indexed by the size of the matrix is tight under very mild assumptions on the coefficients of the initial SDE. We characterize the limiting distributions of its subsequences as solutions to an integral equation. We use this result to study some universality classes of random matrix flows. These generalize the classical results related to Dyson Br…
The subject of this paper is the simple random walk on $\mathbb{Z}$. We give a very simple answer to the following problem: under the condition that a random walk has already spent $α$-percent of the traveling time on the positive side $\mathbb{Z}_{\ge 0}$, what is the probability that the random walk is now on the positive side? The symmetric random walks which step $2n$-times can be decomposed in the following two ways: (1) how many times the walk steps on the positive side, (2) whether the last step is on the positive side or on the negative side. To answer the problem above, we clarify the…
Consider a sample of a centered random vector with unit covariance matrix. We show that under certain regularity assumptions, and up to a natural scaling, the smallest and the largest eigenvalues of the empirical covariance matrix converge, when the dimension and the sample size both tend to infinity, to the left and right edges of the Marchenko--Pastur distribution. The assumptions are related to tails of norms of orthogonal projections. They cover isotropic log-concave random vectors as well as random vectors with i.i.d. coordinates with almost optimal moment conditions. The method is a refi…
Let $(X_{jk})_{j,k\geq 1}$ be an infinite array of i.i.d. complex random variables, with mean 0 and variance 1. Let $\la_{n,1},...,\la_{n,n}$ be the eigenvalues of $(\frac{1}{\sqrt{n}}X_{jk})_{1\leq j,k\leq n}$. The strong circular law theorem states that with probability one, the empirical spectral distribution $\frac{1}{n}(\de_{\la_{n,1}}+...+\de_{\la_{n,n}})$ converges weakly as $n\to\infty$ to the uniform law over the unit disc $\{z\in\dC;|z|\leq1\}$. In this short note, we provide an elementary argument that allows to add a deterministic matrix $M$ to $(X_{jk})_{1\leq j,k\leq n}$ provided…
We study the fluctuations of the matrix entries of regular functions of Wigner random matrices in the limit when the matrix size goes to infinity. In the case of the Gaussian ensembles (GOE and GUE) this problem was considered by A.Lytova and L.Pastur in J. Stat. Phys., v.134, 147-159 (2009). Our results are valid provided the off-diagonal matrix entries have finite fourth moment, the diagonal matrix entries have finite second moment, and the test functions have four continuous derivatives in a neighborhood of the support of the Wigner semicircle law.
Let $S=XX^T$ be the (unscaled) sample covariance matrix where $X$ is a real $p \times n$ matrix with independent entries. It is well known that if the entries of $X$ are independent and identically distributed (i.i.d.) with enough moments and $p/n \to y\neq 0$, then the limiting spectral distribution (LSD) of $\frac{1}{n}S$ converges to a Mar$\check{\text{c}}$enko-Pastur law. Several extensions of this result are also known. We prove a general result on the existence of the LSD of $S$ in probability or almost surely, and in particular, many of the above results follow as special cases. At the …
We consider random matrices whose entries are f(<Xi,Xj>) or f(||Xi-Xj||^2) for iid vectors Xi in R^p with normalized distribution. Assuming that f is sufficiently smooth and the distribution of Xi's is sufficiently nice, El Karoui [17] showed that the spectral distributions of these matrices behave as if f is linear in the Marchenko--Pastur limit. When Xi's are Gaussian vectors, variants of this phenomenon were recently proved for varying kernels, i.e. when f may depend on p, by Cheng and Singer [13]. Two results are shown in this paper: first it is shown that for a large class of distribution…
We prove a local law in the bulk of the spectrum for random Gram matrices $XX^*$, a generalization of sample covariance matrices, where $X$ is a large matrix with independent, centered entries with arbitrary variances. The limiting eigenvalue density that generalizes the Marchenko-Pastur law is determined by solving a system of nonlinear equations. Our entrywise and averaged local laws are on the optimal scale with the optimal error bounds. They hold both in the square case (hard edge) and in the properly rectangular case (soft edge). In the latter case we also establish a macroscopic gap away…