We consider the spectral properties of a class of regularized estimators of (large) empirical covariance matrices corresponding to stationary (but not necessarily Gaussian) sequences, obtained by banding. We prove a law of large numbers (similar to that proved in the Gaussian case by Bickel and Levina), which implies that the spectrum of a banded empirical covariance matrix is an efficient estimator. Our main result is a central limit theorem in the same regime, which to our knowledge is new, even in the Gaussian setup.
In this note, we establish an asymptotic expansion for the centering parameter appearing in the central limit theorems for linear spectral statistic of large-dimensional sample covariance matrices when the population has a spiked covariance structure. As an application, we provide an asymptotic power function for the corrected likelihood ratio statistic for testing the presence of spike eigenvalues in the population covariance matrix. This result generalizes an existing formula from the literature where only one simple spike exists.
This paper investigates the central limit theorem for linear spectral statistics of high dimensional sample covariance matrices of the form $\mathbf{B}_n=n^{-1}\sum_{j=1}^{n}\mathbf{Q}\mathbf{x}_j\mathbf{x}_j^{*}\mathbf{Q}^{*}$ where $\mathbf{Q}$ is a nonrandom matrix of dimension $p\times k$, and $\{\mathbf{x}_j\}$ is a sequence of independent $k$-dimensional random vector with independent entries, under the assumption that $p/n\to y>0$. A key novelty here is that the dimension $k\ge p$ can be arbitrary, possibly infinity. This new model of sample covariance matrices $\mathbf{B}_n$ covers mos…
A central limit theorem (CLT) for the smoothed empirical spectral distribution of sample covariance matrices is established. Moreover, the CLTs for the smoothed quantiles of Marcenko and Pastur's law have been also developed.
We study the renormalized real sample covariance matrix $H=X^TX/\sqrt{MN}-\sqrt{M/N}$ with $N/M\rightarrow0$ as $N, M\rightarrow \infty$ in this paper. And we always assume $M=M(N)$. Here $X=[X_{jk}]_{M\times N}$ is an $M\times N$ real random matrix with i.i.d entries, and we assume $\mathbb{E}|X_{11}|^{5+δ}<\infty$ with some small positive $δ$. The Stieltjes transform $m_N(z)=N^{-1}Tr(H-z)^{-1}$ and the linear eigenvalue statistics of $H$ are considered. We mainly focus on the asymptotic expansion of $\mathbb{E}\{m_N(z)\}$ in this paper. Then for some fine test function, a central limit theor…
For $N,n\in\mathbb N$, consider the sample covariance matrix $$S_N(T)=\frac{1}{N}XX^*$$ from a data set $X=C_N^{1/2}ZT_n^{1/2}$, where $Z=(Z_{i,j})$ is a $N\times n$ matrix having i.i.d. entries with mean zero and variance one, and $C_N, T_n$ are deterministic positive semi-definite Hermitian matrices of dimension $N$ and $n$, respectively. We assume that $(C_N)_N$ is bounded in spectral norm, and $T_n$ is a Toeplitz matrix with its largest eigenvalues diverging to infinity. The matrix $X$ can be viewed as a data set of an $N$-dimensional long memory stationary process having separable depende…
In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is …
Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature …
For $k,m,n\in \mathbb{N}$, we consider $n^k\times n^k$ random matrices of the form $$ \mathcal{M}_{n,m,k}(\mathbf{y})=\sum_{α=1}^mτ_α{Y_α}Y_α^T,\quad Y_α=\mathbf{y}_α^{(1)}\otimes...\otimes\mathbf{y}_α^{(k)}, $$ where $τ_{α}$, $α\in[m]$, are real numbers and $\mathbf{y}_α^{(j)}$, $α\in[m]$, $j\in[k]$, are i.i.d. copies of a normalized isotropic random vector $\mathbf{y}\in \mathbb{R}^n$. For every fixed $k\ge 1$, if the Normalized Counting Measures of $\{τ_{α}\}_α$ converge weakly as $m,n\rightarrow \infty$, $m/n^k\rightarrow c\in \lbrack 0,\infty )$ and $\mathbf{y}$ is a good vector in the se…
We give a two-dimensional central limit theorem (CLT) for the second-order quadratic variation of the centered Gaussian processes on $[0,T]$. Though the approach we use is well known in the literature, the conditions under which the CLT holds are usually based on differentiability of the corresponding covariance function. In our case, we replace differentiability conditions by the convergence of the scaled sums of the second-order moments. To illustrate the usefulness and easiness of use of the approach, we apply the obtained CLT to proving the asymptotic normality of the estimator of the Orey…
In this paper, we derive a joint central limit theorem for random vector whose components are function of random sesquilinear forms. This result is a natural extension of the existing central limit theory on random quadratic forms. We also provide applications in random matrix theory related to large-dimensional spiked population models. For the first application, we find the joint distribution of grouped extreme sample eigenvalues correspond to the spikes. And for the second application, under the assumption that the population covariance matrix is diagonal with $k$ (fixed) simple spikes, we …
We obtain convergence rates (in the Levi-Prokhorove metric) in the functional central limit theorem (CLT) for partial sums $S_n=\sum_{j=1}^{n}ξ_{j,n}$ of triangular arrays $\{ξ_{1,n},ξ_{2,n},...,ξ_{n,n}\}$ satisfying some mixing and moment conditions (which are not necessarily uniform in $n$). For certain classes of additive functionals of triangular arrays of contracting Markov chains (in the sense of Dobrushin) we obtain rates which are close to the best rates obtained for independent random variables. In addition, we obtain close to optimal rates in the usual CLT and a moderate deviations p…
Suppose that $\{u(t\,, x)\}_{t >0, x \in\mathbb{R}^d}$ is the solution to a $d$-dimensional parabolic Anderson model with delta initial condition and driven by a Gaussian noise that is white in time and has a spatially homogeneous covariance given by a nonnegative-definite measure $f$ which satisfies Dalang's condition. Let $\boldsymbol{p}_t(x):=(2πt)^{-d/2}\exp\{-\|x\|^2/(2t)\}$ denote the standard Gaussian heat kernel on $\mathbb{R}^d$. We prove that for all $t>0$, the process $U(t):=\{u(t\,, x)/\boldsymbol{p}_t(x): x\in \mathbb{R}^d\}$ is stationary using Feynman-Kac's formula, and is ergod…
In this article, we establish a limiting distribution for eigenvalues of a class of auto-covariance matrices. The same distribution has been found in the literature for a regularized version of these auto-covariance matrices. The original non-regularized auto-covariance matrices are non invertible which introduce supplementary diffculties for the study of their eigenvalues through Girko's Hermitization scheme. The key result in this paper is a new polynomial lower bound for the least singular value of the resolvent matrices associated to a rank-defective quadratic function of a random matrix w…
Bessel processes $(X_{t,k})_{t\ge0}$ in $N$ dimensions are classified via associated root systems and multiplicity constants $k\ge0$. They describe interacting Calogero-Moser-Suther\-land particle systems with $N$ particles and are related to $β$-Hermite and $β$-Laguerre ensembles. Recently, several central limit theorems were derived for fixed $t>0$, fixed starting points, and $k\to\infty$. In this paper we extend the CLT in the A-case from start in 0 to arbitrary starting distributions by using a limit result for the corresponding Bessel functions. We also determine the eigenvalues and eigen…
For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), γ^{-1} \leq \frac{N}{n} \leq γ$ where $γ\in (0,\infty),$ we obtain consistency rates in the form of CLTs for separated spikes tending to infinity fast enough whenever $M$ grows slightly slower than $n: \lim_{n \to \infty}{\frac{\sqrt{\log{n}}}{\log{\frac{n}{M(n)}}}}=0.$ Our results fill a gap in the existing literature in which the largest range covered for the number of spikes has been $o(n^{1/6})$ an…
This work presents an infinite-dimensional generalization of the correspondence between the Kullback-Leibler and Rényi divergences between Gaussian measures on Euclidean space and the Alpha Log-Determinant divergences between symmetric, positive definite matrices. Specifically, we present the regularized Kullback-Leibler and Rényi divergences between covariance operators and Gaussian measures on an infinite-dimensional Hilbert space, which are defined using the infinite-dimensional Alpha Log-Determinant divergences between positive definite trace class operators. We show that, as the regulariz…
In this paper, we consider the explicit bound for the second-order approximation of the quadratic variation of a general fractional Gaussian process $(G_t)_{t\ge 0}$. The second order mixed partial derivative of the covariance function $ R(t,\, s)=\mathbb{E}[G_t G_s]$ can be decomposed into two parts, one of which coincides with that of fractional Brownian motion and the other of which is bounded by $(ts)^{H-1}$ up to a constant factor. This condition is valid for a class of continuous Gaussian processes that fails to be self-similar or have stationary increments. %Some examples include the su…
We prove central limit theorems (CLT) for empirical processes of extreme values cluster functionals as in Drees and Rootzén (2010). We use coupling properties enlightened for Dedecker \& Prieur's $τ-$dependence coefficients in order to improve the conditions of dependence and continue to obtain these CLT. The assumptions are precisely set for particular processes and cluster functionals of interest. The number of excesses provides a complete example of a cluster functional for a simple non-mixing model (AR(1)-process) for which ours results are definitely needed. We also give the expression ex…
We provide bounds of Berry-Esseen type for fundamental limit theorems in operator-valued free probability theory such as the operator-valued free Central Limit Theorem and the asymptotic behaviour of distributions of operator-valued matrices. Our estimates are on the level of operator-valued Cauchy transforms and the Lévy distance. We address the single-variable as well as the multivariate setting for which we consider linear matrix pencils and noncommutative polynomials as test functions. The estimates are in terms of operator-valued moments and yield the first quantitative bounds on the Lévy…
It is known (Hofmann-Credner and Stolz (2008)) that the convergence of the mean empirical spectral distribution of a sample covariance matrix W_n = 1/n Y_n Y_n^t to the Marčenko-Pastur law remains unaffected if the rows and columns of Y_n exhibit some dependence, where only the growth of the number of dependent entries, but not the joint distribution of dependent entries needs to be controlled. In this paper we show that the well-known CLT for traces of powers of W_n also extends to the dependent case.
Consider a $N\times n$ matrix $Σ_n=\frac{1}{\sqrt{n}}R_n^{1/2}X_n$, where $R_n$ is a nonnegative definite Hermitian matrix and $X_n$ is a random matrix with i.i.d. real or complex standardized entries. The fluctuations of the linear statistics of the eigenvalues \[\operatorname {Trace}f \bigl(Σ_nΣ_n^*\bigr)=\sum_{i=1}^Nf(λ_i),\qquad (λ_i)\ eigenvalues\ of\ Σ_nΣ_n^*,\] are shown to be Gaussian, in the regime where both dimensions of matrix $Σ_n$ go to infinity at the same pace and in the case where $f$ is of class $C^3$, that is, has three continuous derivatives. The main improvements with resp…
This article studies two regularized robust estimators of scatter matrices proposed (and proved to be well defined) in parallel in (Chen et al., 2011) and (Pascal et al., 2013), based on Tyler's robust M-estimator (Tyler, 1987) and on Ledoit and Wolf's shrinkage covariance matrix estimator (Ledoit and Wolf, 2004). These hybrid estimators have the advantage of conveying (i) robustness to outliers or impulsive samples and (ii) small sample size adequacy to the classical sample covariance matrix estimator. We consider here the case of i.i.d. elliptical zero mean samples in the regime where both s…
German Aerospace Center (DLR), Institute for AI Safety and Security（德国航空航天中心（DLR）人工智能安全与保护研究所）；German Aerospace Center (DLR), Institute of Frontier Materials on Earth and in Space, Functional, Granular, and Composite Materials（德国航空航天中心（DLR）地球与太空前沿材料研究所功能、颗粒与复合材料部门）；Department of Physics, LMU München（慕尼黑大学物理系）；Karlsruhe Institute of Technology, Institute for Stochastics（卡尔斯鲁厄理工学院概率论研究所）
