Covariance matrices of self-affine measures

Limiting spectral distribution for large sample covariance matrices with graph-dependent elements

We obtain the limiting spectral distribution for large sample covariance matrices associated with random vectors having graph-dependent entries under the assumption that the interdependence among the entries grows with the sample size n. Our results are tight. In particular, they give necessary and sufficient conditions for the Marchenko-Pastur theorem for sample covariance matrices with m-dependent orthonormal elements when m = o(n).

Characteristic Polynomials of Sample Covariance Matrices: The Non-Square Case

We consider the sample covariance matrices of large data matrices which have i.i.d. complex matrix entries and which are non-square in the sense that the difference between the number of rows and the number of columns tends to infinity. We show that the second-order correlation function of the characteristic polynomial of the sample covariance matrix is asymptotically given by the sine kernel in the bulk of the spectrum and by the Airy kernel at the edge of the spectrum. Similar results are given for real sample covariance matrices.

Characteristic Polynomials of Sample Covariance Matrices

We investigate the second-order correlation function of the characteristic polynomial of a sample covariance matrix. Starting from an explicit formula for the generating function, we re-obtain several well-known kernels from random matrix theory.

Additive/multiplicative free subordination property and limiting eigenvectors of spiked additive deformations of Wigner matrices and spiked sample covariance matrices

When some eigenvalues of a spiked multiplicative resp. additive deformation model of a Hermitian Wigner matrix resp. a sample covariance matrix separate from the bulk, we study how the corresponding eigenvectors project onto those of the perturbation. We point out that the inverse of the subordination function relative to the free additive resp. multiplicative convolution plays an important part in the asymptotic behavior.

On the Spectral Density of Large Sample Covariance Matrices with Markov Dependent Columns

We investigate the spectral distribution of large sample covariance matrices with independent columns and entries in the columns that stem from Markov chains. We characterize the limiting spectral densities by their moments. Correspondingly, the proof is based on a moment method.

Limit distributions of sample covariance matrices are compound free Poisson

We show that the empirical distribution of the eigenvalues of the sample covariance matrix of certain random vectors (not necessarily independent entries) with bounded marginal $L^{4}$ norms converges weakly to a compound free Poisson distribution.

马尔可夫切换仿射递归中协方差存在性的谱特征

Spectral Characterisation of Covariance Existence in Markov-Switching Affine Recurrences

研究马尔可夫切换仿射递归平稳协方差矩阵存在性，核心方法是通过马尔可夫切换克罗内克算子及佩龙激励条件判断，贡献是将均方谱条件转化为平稳分布协方差存在准则，并举例说明相关特性。

Estimating the covariance of random matrices

We extend to the matrix setting a recent result of Srivastava-Vershynin about estimating the covariance matrix of a random vector. The result can be in- terpreted as a quantified version of the law of large numbers for positive semi-definite matrices which verify some regularity assumption. Beside giving examples, we dis- cuss the notion of log-concave matrices and give estimates on the smallest and largest eigenvalues of a sum of such matrices.

Local Laws for Sparse Sample Covariance Matrices without the truncation condition

We consider sparse sample covariance matrices $\frac1{np_n}\mathbf X\mathbf X^*$, where $\mathbf X$ is a sparse matrix of order $n\times m$ with the sparse probability $p_n$. We prove the local Marchenko--Pastur law in some complex domain assuming that $np_n>\log^βn$, $β>0$ and some $(4+δ)$-moment condition is fulfilled, $δ>0$.

On the Central Limit Theorem for the Eigenvalue Counting Function of Wigner and Covariance matrices

This note presents some central limit theorems for the eigenvalue counting function of Wigner matrices in the form of suitable translations of results by Gustavsson and O'Rourke on the limiting behavior of eigenvalues inside the bulk of the semicircle law for Gaussian matrices. The theorems are then extended to large families of Wigner matrices by the Tao and Vu Four Moment Theorem. Similar results are developed for covariance matrices.

The universality principle for spectral distributions of sample covariance matrices

We derive the universality principle for empirical spectral distributions of sample covariance matrices and their Stieltjes transforms. This principle states the following. Suppose quadratic forms of random vectors $y_p$ in $R^p$ satisfy a weak law of large numbers and the sample size grows at the same rate as $p$. Then the limiting spectral distribution of corresponding sample covariance matrices is the same as in the case with conditionally Gaussian $y_p$. This result is generalized for $m$-dependent martingale difference sequences and $m$-dependent linear processes.

Covariance Kernel of Linear Spectral Statistics for Half-Heavy tailed Wigner Matrices

In this paper we analyze the covariance kernel of the Gaussian process that arises as the limit of fluctuations of linear spectral statistics for Wigner matrices with a few moments. More precisely, the process we study here corresponds to Hermitian matrices with independent entries that have $α$ moments for $2<α< 4$. We obtain a closed form $α$-dependent expression for the covariance of the limiting process resulting from fluctuations of the Stieltjes transform by explicitly integrating the known double Laplace transform integral formula obtained in the literature. We then express the covarian…

协方差矩阵的Ledoit-Péché RIE公式的一个简短证明

A short proof of Ledoit-Péché's RIE formula for covariance matrices

本文基于Stein公式给出协方差矩阵的Ledoit-Péché RIE公式的简短证明，明确该证明成立仅需真实协方差矩阵的特征值均值与最大特征值同阶的假设，简化了推导过程。

Eigenvalue variance bounds for Wigner and covariance random matrices

This work is concerned with finite range bounds on the variance of individual eigenvalues of Wigner random matrices, in the bulk and at the edge of the spectrum, as well as for some intermediate eigenvalues. Relying on the GUE example, which needs to be investigated first, the main bounds are extended to families of Hermitian Wigner matrices by means of the Tao and Vu Four Moment Theorem and recent localization results by Erdös, Yau and Yin. The case of real Wigner matrices is obtained from interlacing formulas. As an application, bounds on the expected 2-Wasserstein distance between the empir…

Concentration of Measure and Large Random Matrices with an application to Sample Covariance Matrices

The present work provides an original framework for random matrix analysis based on revisiting the concentration of measure theory from a probabilistic point of view. By providing various notions of vector concentration ($q$-exponential, linear, Lipschitz, convex), a set of elementary tools is laid out that allows for the immediate extension of classical results from random matrix theory involving random concentrated vectors in place of vectors with independent entries. These findings are exemplified here in the context of sample covariance matrices but find a large range of applications in st…

Central limit theorem for mesoscopic eigenvalue statistics of deformed Wigner matrices and sample covariance matrices

We consider $N$ by $N$ deformed Wigner random matrices of the form $X_N=H_N+A_N$, where $H_N$ is a real symmetric or complex Hermitian Wigner matrix and $A_N$ is a deterministic real bounded diagonal matrix. We prove a universal Central Limit Theorem for the linear eigenvalue statistics of $X_N$ for all mesoscopic scales both in the spectral bulk and at regular edges where the global eigenvalue density vanishes as a square root. The method relies on the characteristic function method in [47], local laws for the Green function of $X_N$ in [3, 46, 51] and analytic subordination properties of the…

Convergence of Empirical Spectral Distributions of Large Dimensional Quaternion Sample Covariance Matrices

In this paper we establish the limit of the empirical spectral distribution of quaternion sample covariance matrices. Suppose $\mathbf X_n = ({x_{jk}^{(n)}})_{p\times n}$ is a quaternion random matrix. For each $n$, the entries $\{x_{ij}^{(n)}\}$ are independent random quaternion variables with a common mean $μ$ and variance $σ^2>0$. It is shown that the empirical spectral distribution of the quaternion sample covariance matrix $\mathbf S_n=n^{-1}\mathbf X_n\mathbf X_n^*$ converges to the M-P law as $p\to\infty$, $n\to\infty$ and $p/n\to y\in(0,+\infty)$.

Random covariance matrices: Universality of local statistics of eigenvalues up to the edge

We study the universality of the eigenvalue statistics of the covariance matrices $\frac{1}{n}M^* M$ where $M$ is a large $p\times n$ matrix obeying condition $\bf{C1}$. In particular, as an application, we prove a variant of universality results regarding the smallest singular value of $M_{p,n}$. This paper is an extension of the results in \cite{tvcovariance} from the bulk of the spectrum up to the edge.

Universality in the bulk of the spectrum for complex sample covariance matrices

We consider complex sample covariance matrices $M_N=\frac{1}{N}YY^*$ where $Y$ is a $N \times p$ random matrix with i.i.d. entries $Y_{ij}, 1\leq i\leq N, 1\leq j \leq p$ with distribution $F$. Under some regularity and decay assumption on $F$, we prove universality of some local eigenvalue statistics in the bulk of the spectrum in the limit where $N\to \infty$ and $\lim_{N \to \infty}p/N =γ$ for any real number $γ\in (0, \infty)$.

On the behavior of the covariance matrices in a multivariate central limit theorem under some mixing conditions

In a paper that appeared in 2010, C. Tone proved a multivariate central limit theorem for some strictly stationary random fields of random vectors satisfying certain mixing conditions. The "normalization" of a given "partial sum" (or "block sum") involved matrix multiplication by a "standard -1/2 power" of its covariance matrix (a symmetric, positive definite matrix), and the limiting multivariate normal distribution had the identity matrix as its covariance matrix. The mixing assumptions in Tone's result implicitly imposed an upper bound on the ratios of the largest to the smallest eigenvalue…

Sample covariance matrices and special symmetric partitions

Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing ones as well as generates new results. We show that under suitable assumptions on the entries of $X_p$, the limiting spectral distribution exists in probability or almost surely. The moments are descri…

Phase transition of the largest eigenvalue for non-null complex sample covariance matrices

We compute the limiting distributions of the largest eigenvalue of a complex Gaussian sample covariance matrix when both the number of samples and the number of variables in each sample become large. When all but finitely many, say $r$, eigenvalues of the covariance matrix are the same, the dependence of the limiting distribution of the largest eigenvalue of the sample covariance matrix on those distinguished $r$ eigenvalues of the covariance matrix is completely characterized in terms of an infinite sequence of new distribution functions that generalize the Tracy-Widom distributions of the ra…

A CLT for regularized sample covariance matrices

We consider the spectral properties of a class of regularized estimators of (large) empirical covariance matrices corresponding to stationary (but not necessarily Gaussian) sequences, obtained by banding. We prove a law of large numbers (similar to that proved in the Gaussian case by Bickel and Levina), which implies that the spectrum of a banded empirical covariance matrix is an efficient estimator. Our main result is a central limit theorem in the same regime, which to our knowledge is new, even in the Gaussian setup.

仿射Volterra协方差过程及其在商品市场中的应用

Affine Volterra covariance processes and application to commodity markets

本文研究对称正半定矩阵锥上的仿射随机Volterra方程，建立弱存在性并推导Fourier-Laplace变换公式，进而扩展Gibson-Schwartz商品模型为Volterra-Wishart过程，使方差具有记忆性和随机瞬时相关性，同时保持仿射可处理性。

Large deviation theorem for random covariance matrices

We establish a large deviation theorem for the empirical spectral distribution of random covariance matrices whose entries are independent random variables with mean 0, variance 1 and having controlled forth moments. Some new properties of Laguerre polynomials are also given.

Fluctuations of Matrix Entries of Regular Functions of Sample Covariance Random Matrices

We extend the results about the fluctuations of the matrix entries of regular functions of Wigner matrices to the case of sample covariance random matrices.

Local Correlation and Gap Statistics under Dyson Brownian Motion for Covariance Matrices

This paper is the third chapter of three of the author's undergraduate thesis. In this paper, we study the convergence of local bulk statistics for linearized covariance matrices under Dyson's Brownian motion. We consider deterministic initial data $V$ approximate the Dyson Brownian motion for linearized covariance matrices by the Wigner flow. Using universality results for the Wigner flow, we deduce universality for the linearized covariance matrices. We deduce bulk universality of averaged bulk correlation functions for both biregular bipartite graphs and honest covariance matrices. We also …

Universality of sample covariance matrices: CLT of the smoothed empirical spectral distribution

A central limit theorem (CLT) for the smoothed empirical spectral distribution of sample covariance matrices is established. Moreover, the CLTs for the smoothed quantiles of Marcenko and Pastur's law have been also developed.

Central limit theorem of nonparametric estimate of spectral density functions of sample covariance matrices

A consistent kernel estimator of the limiting spectral distribution of general sample covariance matrices was introduced in Jing, Pan, Shao and Zhou (2010). The central limit theorem of the kernel estimator is proved in this paper.

The rate of convergence of spectra of sample covariance matrices

It is shown that the Kolmogorov distance between the spectral distribution function of a random covariance matrix $\frac1p XX^T$, where $X$ is a $n\times p$ matrix with independent entries and the distribution function of the Marchenko-Pastur law is of order $O(n^{-1/2})$. The bounds hold {\it uniformly} for any $p$, including $\frac pn$ equal or close to 1.

大型协方差矩阵和精度矩阵的特征向量分布与最优收缩估计量

Eigenvector distributions and optimal shrinkage estimators for large covariance and precision matrices

本文研究了高维环境下大型样本协方差矩阵和精度矩阵的Stein不变收缩估计量，在近乎任意总体协方差矩阵模型下建立了广泛损失函数的收缩量渐近极限，其关键贡献是推导出非尖峰特征向量的渐近分布。

Quantitative deterministic equivalent of sample covariance matrices with a general dependence structure

We study sample covariance matrices arising from rectangular random matrices with i.i.d. columns. It was previously known that the resolvent of these matrices admits a deterministic equivalent when the spectral parameter stays bounded away from the real axis. We extend this work by proving quantitative bounds involving both the dimensions and the spectral parameter, in particular allowing it to get closer to the real positive semi-line. As applications, we obtain a new bound for the convergence in Kolmogorov distance of the empirical spectral distributions of these general models. We also appl…

The largest eigenvalues of sample covariance matrices for a spiked population: diagonal case

We consider large complex random sample covariance matrices obtained from "spiked populations", that is when the true covariance matrix is diagonal with all but finitely many eigenvalues equal to one. We investigate the limiting behavior of the largest eigenvalues when the population and the sample sizes both become large. Under some conditions on moments of the sample distribution, we prove that the asymptotic fluctuations of the largest eigenvalues are the same as for a complex Gaussian sample with the same true covariance. The real setting is also considered.

Central Limit Theorem for linear eigenvalue statistics of the Wigner and sample covariance random matrices

We consider two classical ensembles of the random matrix theory: the Wigner matrices and sample covariance matrices, and prove Central Limit Theorem for linear eigenvalue statistics under rather weak (comparing with results known before) conditions on the number of derivatives of the test functions and also on the number of the entries moments. Moreover, we develop a universal method which allows one to obtain automatically the bounds for the variance of differentiable test functions, if there is a bound for the variance of the trace of the resolvent of random matrix. The method is applicable …

Covariance matrices of length power functionals of random geometric graphs -- an asymptotic analysis

Asymptotic properties of a vector of length power functionals of random geometric graphs are investigated. More precisely, its asymptotic covariance matrix is studied as the intensity of the underlying homogeneous Poisson point process increases. This includes a systematic discussion of matrix properties like rank, definiteness, determinant, eigenspaces or decompositions of interest. For the formulation of the results a case distinction is necessary. Indeed, in the three possible regimes the respective covariance matrix is of quite different nature which leads to different statements. Finally,…

Fluctuations for linear eigenvalue statistics of sample covariance matrices

We prove a central limit theorem for the difference of linear eigenvalue statistics of a sample covariance matrix $\widetilde{W}$ and its minor $W$. We find that the fluctuation of this difference is much smaller than those of the individual linear statistics, as a consequence of the strong correlation between the eigenvalues of $\widetilde{W}$ and $W$. Our result identifies the fluctuation of the spatial derivative of the approximate Gaussian field in the recent paper by Dumitru and Paquette. Unlike in a similar result for Wigner matrices, for sample covariance matrices the fluctuation may en…

Principal components of spiked covariance matrices in the supercritical regime

In this paper, we study the asymptotic behavior of the extreme eigenvalues and eigenvectors of the spiked covariance matrices, in the supercritical regime. Specifically, we derive the joint distribution of the extreme eigenvalues and the generalized components of their associated eigenvectors in this regime.

Recovery of spectrum from estimated covariance matrices and statistical kernels for machine learning and big data

In this paper we propose two schemes for the recovery of the spectrum of a covariance matrix from the empirical covariance matrix, in the case where the dimension of the matrix is a subunitary multiple of the number of observations. We test, compare and analyze these on simulated data and also on some data coming from the stock market.

Quantitative Universality for the Largest Eigenvalue of Sample Covariance Matrices

We prove the first explicit rate of convergence to the Tracy-Widom distribution for the fluctuation of the largest eigenvalue of sample covariance matrices that are not integrable. Our primary focus is matrices of type $ X^*X $ and the proof follows the Erdös-Schlein-Yau dynamical method. We use a recent approach to the analysis of the Dyson Brownian motion from [5] to obtain a quantitative error estimate for the local relaxation flow at the edge. Together with a quantitative version of the Green function comparison theorem, this gives the rate of convergence. Combined with a result of Lee-Sch…

About limiting spectral distributions of block-rescaled empirical covariance matrices

We establish that the limiting spectral distribution of a block-rescaled empirical covariance matrix is an arcsine law when the ratio between the dimension and the underlying sample size converges to 1 and when the samples corresponding to each block are independent. We further propose a conjecture for the cases where the latter ratio converges to a constant in the unit interval.

A note on conditional covariance matrices for elliptical distributions

In this short note we provide an analytical formula for the conditional covariance matrices of the elliptically distributed random vectors, when the conditioning is based on the values of any linear combination of the marginal random variables. We show that one could introduce the univariate invariant depending solely on the conditioning set, which greatly simplifies the calculations. As an application, we show that one could define uniquely defined quantile-based sets on which conditional covariance matrices must be equal to each other if only the vector is multivariate normal. The similar re…

A universality result for the smallest eigenvalues of certain sample covariance matrices

After proper rescaling and under some technical assumptions, the smallest eigenvalue of a sample covariance matrix with aspect ratio bounded away from 1 converges to the Tracy--Widom distribution. This complements the results on the largest eigenvalue, due to Soshnikov and Peche.

Weak convergence of the empirical spectral distribution of ultra-high-dimensional banded sample covariance matrices

In this article we investigate high-dimensional banded sample covariance matrices under the regime that the sample size $n$, the dimension $p$ and the bandwidth $d$ tend simultaneously to infinity such that $$n/p\to 0 \ \ \text{and} \ \ 2d/n\to y>0.$$ It is shown that the empirical spectral distribution of those matrices almost surely converges weakly to some deterministic probability measure which is characterized by its moments. Certain restricted compositions of natural numbers play a crucial role in the evaluation of the expected moments of the empirical spectral distribution.

Eigenvalues of sample covariance matrices of non-linear processes with infinite variance

We study the $k$-largest eigenvalues of heavy-tailed sample covariance matrices of the form $\bX\bX^\T$ in an asymptotic framework, where the dimension of the data and the sample size tend to infinity. To this end, we assume that the rows of $\bX$ are given by independent copies of some stationary process with regularly varying marginals with index $α\in(0,2)$ satisfying large deviation and mixing conditions. We apply these general results to stochastic volatility and GARCH processes.

Affine Invariant Covariance Estimation for Heavy-Tailed Distributions

In this work we provide an estimator for the covariance matrix of a heavy-tailed multivariate distributionWe prove that the proposed estimator $\widehat{\mathbf{S}}$ admits an \textit{affine-invariant} bound of the form \[(1-\varepsilon) \mathbf{S} \preccurlyeq \widehat{\mathbf{S}} \preccurlyeq (1+\varepsilon) \mathbf{S}\]in high probability, where $\mathbf{S}$ is the unknown covariance matrix, and $\preccurlyeq$ is the positive semidefinite order on symmetric matrices. The result only requires the existence of fourth-order moments, and allows for $\varepsilon = O(\sqrt{κ^4 d\log(d/δ)/n})$ whe…

样本协方差矩阵上特征值算法的普遍性

Universality for eigenvalue algorithms on sample covariance matrices

研究随机正定样本协方差矩阵上幂/逆幂方法和QR特征值算法的迭代次数，证明其收敛性及计算极值特征值的复杂度估计。

样本协方差矩阵特征值统计量之差的中心极限定理

A CLT for the difference of eigenvalue statistics of sample covariance matrices

该研究在数据维度与样本量同阶增长的情形下，证明了样本协方差矩阵与删去一列及对应行后矩阵的线性谱统计量之差的中心极限定理，放宽了总体协方差矩阵对角性与各阶矩存在的条件，还建立了差分型谱统计量与常规线性谱统计量的渐近独立性。

Universality for the conjugate gradient and MINRES algorithms on sample covariance matrices

We present a probabilistic analysis of two Krylov subspace methods for solving linear systems. We prove a central limit theorem for norms of the residual vectors that are produced by the conjugate gradient and MINRES algorithms when applied to a wide class of sample covariance matrices satisfying some standard moment conditions. The proof involves establishing a four moment theorem for the so-called spectral measure, implying, in particular, universality for the matrix produced by the Lanczos iteration. The central limit theorem then implies an almost-deterministic iteration count for the iter…

Painleve formulas of the limiting distributions for non-null complex sample covariance matrices

In a recent study of large non-null sample covariance matrices, a new sequence of functions generalizing the GUE Tracy-Widom distribution of random matrix theory was obtained. This paper derives Painlevé formulas of these functions and use them to prove that they are indeed distribution functions. Applications of these new distribution functions to last passage percolation, queues in tandem and totally asymmetric simple exclusion process are also discussed. As a part of the proof, a representation of orthogonal polynomials on the unit circle in terms of an operator on a discrete set is present…

Riemannian statistics meets random matrix theory: towards learning from high-dimensional covariance matrices

Riemannian Gaussian distributions were initially introduced as basic building blocks for learning models which aim to capture the intrinsic structure of statistical populations of positive-definite matrices (here called covariance matrices). While the potential applications of such models have attracted significant attention, a major obstacle still stands in the way of these applications: there seems to exist no practical method of computing the normalising factors associated with Riemannian Gaussian distributions on spaces of high-dimensional covariance matrices. The present paper shows that …

Eigenvalues of Large Sample Covariance Matrices of Spiked Population Models

We consider a spiked population model, proposed by Johnstone, whose population eigenvalues are all unit except for a few fixed eigenvalues. The question is to determine how the sample eigenvalues depend on the non-unit population ones when both sample size and population size become large. This paper completely determines the almost sure limits for a general class of samples.

CLT for LSS of sample covariance matrices with unbounded dispersions

Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature …

New Methods for Handling Singular Sample Covariance Matrices

The estimation of a covariance matrix from an insufficient amount of data is one of the most common problems in fields as diverse as multivariate statistics, wireless communications, signal processing, biology, learning theory and finance. In a joint work of Marzetta, Tucci and Simon, a new approach to handle singular covariance matrices was suggested. The main idea was to use dimensionality reduction in conjunction with an average over the Stiefel manifold. In this paper we continue with this research and we consider some new approaches to solve this problem. One of the methods is called the …

协方差矩阵和格拉姆矩阵的简单相对偏差界

Simple Relative Deviation Bounds for Covariance and Gram Matrices

本文提出一种通用定理，将现有均匀界转换为相对偏差界，从而为协方差和格拉姆矩阵的特征值提供非渐近的、跨谱更精确的控制。