We investigate the multivariate central limit theorem for nonlinear statistics by means of Stein's method and Slepian's smart path interpolation method. Based on certain difference operators in theory of concentration inequalities, we obtain two explicit bounds for the rate of convergence. Applications to Rademacher functionals, the runs and quadratic forms are provided as well.
We prove a multivariate functional version of de Jong's CLT (1990) yielding that, given a sequence of vectors of Hoeffding-degenerate U-statistics, the corresponding empirical processes on $[0,1]$ weakly converge in the Skorohod space as soon as their fourth cumulants in $t=1$ vanish asymptotically and a certain strengthening of the Lindeberg-type condition is verified. As an application, we lift to the functional level the `universality of Wiener chaos' phenomenon first observed in Nourdin, Peccati and Reinert (2010).
Let $(X_1 , \ldots , X_d)$ be random variables taking nonnegative integer values and let $f(z_1, \ldots , z_d)$ be the probability generating function. Suppose that $f$ is real stable; equivalently, suppose that the polarization of this probability distribution is strong Rayleigh. In specific examples, such as occupation counts of disjoint sets by a determinantal point process, it is known~\cite{soshnikov02} that the joint distribution must approach a multivariate Gaussian distribution. We show that this conclusion follows already from stability of $f$.
We show that a necessary and sufficient condition for the sum of iid random vectors to converge (under appropriate shifting and scaling) to a multivariate Gaussian distribution is that the truncated second moment matrix is slowly varying at infinity. This is more natural than the standard conditions, and allows for the possibility that the limiting Gaussian distribution is degenerate (so long as it is not concentrated at a point). We also give necessary and sufficient conditions for a d-dimensional Levy process to converge (under appropriate shifting and scaling) to a multivariate Gaussian dis…
We prove a multivariate central limit theorem with explicit error bound on a non-smooth function distance for sums of bounded decomposable $d$-dimensional random vectors. The decomposition structure is similar to that of Barbour, Karoński and Ruciński (1989) and is more general than the local dependence structure considered in Chen and Shao (2004). The error bound is of the order $d^{\frac{1}{4}} n^{-\frac{1}{2}}$, where $d$ is the dimension and $n$ is the number of summands. The dependence on $d$, namely $d^{\frac{1}{4}}$, is the best known dependence even for sums of independent and identica…
We use a multivariate version of Stein's method to establish a quantitative Lindeberg CLT for the Fourier transforms of random $N$-vectors. We achieve this by deducing a specific integral representation for the Hessian matrix of a solution to the Stein equation with test function $e_t(x) = \exp(- i \sum_{k=1}^N t_k x_k)$, where $t,x \in \mathbb{R}^N$.
We provide bounds of Berry-Esseen type for fundamental limit theorems in operator-valued free probability theory such as the operator-valued free Central Limit Theorem and the asymptotic behaviour of distributions of operator-valued matrices. Our estimates are on the level of operator-valued Cauchy transforms and the Lévy distance. We address the single-variable as well as the multivariate setting for which we consider linear matrix pencils and noncommutative polynomials as test functions. The estimates are in terms of operator-valued moments and yield the first quantitative bounds on the Lévy…
Let $M_n$ be a random element of the unitary, special orthogonal, or unitary symplectic groups, distributed according to Haar measure. By a classical result of Diaconis and Shahshahani, for large matrix size $n$, the vector $ (\on{Tr}(M_n), \on{Tr}(M_n^2),..., \on{Tr}(M_n^d))$ tends to a vector of independent (real or complex) Gaussian random variables. Recently, Jason Fulman has demonstrated that for a single power $j$ (which may grow with $n$), a speed of convergence result may be obtained via Stein's method of exchangeable pairs. In this note, we extend Fulman's result to the multivariate c…
As an important topic in Mathematical Physics and statistics, random matrices theory has found uses in many aspects of modern physics and multivariate analysis. This paper is to investigate the Gaussian fluctuations for linear spectral statistics (LSS) of Wigner beta ensembles. We first establish a central limit theorem (CLT) for LSS of Wigner quaternion matrices, then give a general CLT for Wigner $β$ ensembles.
We show that the variance of centred linear statistics of eigenvalues of GUE matrices remains bounded for large $n$ for some classes of test functions less regular than Lipschitz functions. This observation is suggested by the limiting form of the variance (which has previously been computed explicitly), but it does not seem to appear in the literature. We combine this fact with comparison techniques following Tao-Vu and Erdös, Yau, et al. and a Littlewood-Paley type decomposition to extend the central limit theorem for linear eigenvalue statistics to functions in the Hölder class $C^{1/2+ε}$ …
This paper is concerned with normal approximation under relaxed moment conditions using Stein's method. We obtain the explicit rates of convergence in the central limit theorem for (i) nonlinear statistics with finite absolute moment of order $2+δ\in(2,3];$ (ii) nonlinear statistics with vanishing third moment and finite absolute moment of order $3+δ\in(3,4].$ When applied to specific examples, these rates are of the optimal order $O(n^{-\fracδ{2}})$ and $O(n^{-\frac{1+δ}{2}}).$ Our proof are based on the covariance identify formula and simple observations about the solution of Stein's equatio…
We provide non-asymptotic convergence rates of the Polyak-Ruppert averaged stochastic gradient descent (SGD) to a normal random vector for a class of twice-differentiable test functions. A crucial intermediate step is proving a non-asymptotic martingale central limit theorem (CLT), i.e., establishing the rates of convergence of a multivariate martingale difference sequence to a normal random vector, which might be of independent interest. We obtain the explicit rates for the multivariate martingale CLT using a combination of Stein's method and Lindeberg's argument, which is then used in conjun…
In this paper we show a functional central limit theorem for the sum of the first $\lfloor t n \rfloor$ diagonal elements of $f(Z)$ as a function in $t$, for $Z$ a random real symmetric or complex Hermitian $n\times n$ matrix. The result holds for orthogonal or unitarily invariant distributions of $Z$, in the cases when the linear eigenvalue statistic $\operatorname{tr} f(Z)$ satisfies a CLT. The limit process interpolates between the fluctuations of individual matrix elements as $f(Z)_{1,1}$ and of the linear eigenvalue statistic. It can also be seen as a functional CLT for processes of rando…
We consider linear spectral statistics of the form $\mathrm{tr} ( φ(H))$ for test functions $φ$ of low regularity and Wigner matrices $H$ with smooth entry distribution. We show that for functions $φ$ in the Sobolev space $H^{1/2+\varepsilon}$ or the space $C^{1/2+\varepsilon}$, that are supported within the spectral bulk of the semicircle distribution, these linear spectral statistics have asymptotic Gaussian fluctuations with the same variance as in the CLT for functions of higher regularity, for any $\varepsilon >0$.
This paper investigates the central limit theorem for linear spectral statistics of high dimensional sample covariance matrices of the form $\mathbf{B}_n=n^{-1}\sum_{j=1}^{n}\mathbf{Q}\mathbf{x}_j\mathbf{x}_j^{*}\mathbf{Q}^{*}$ where $\mathbf{Q}$ is a nonrandom matrix of dimension $p\times k$, and $\{\mathbf{x}_j\}$ is a sequence of independent $k$-dimensional random vector with independent entries, under the assumption that $p/n\to y>0$. A key novelty here is that the dimension $k\ge p$ can be arbitrary, possibly infinity. This new model of sample covariance matrices $\mathbf{B}_n$ covers mos…
Consider a $N\times n$ random matrix $Y_n=(Y_{ij}^{n})$ where the entries are given by $$ Y_{ij}^{n}=\frac{σ_{ij}(n)}{\sqrt{n}} X_{ij}^{n} $$ the $X_{ij}^{n}$ being centered, independent and identically distributed random variables with unit variance and $(σ_{ij}(n); 1\le i\le N, 1\le j\le n)$ being an array of numbers we shall refer to as a variance profile. We study in this article the fluctuations of the random variable $$ \log\det(Y_n Y_n^* + ρI_N) $$ where $Y^*$ is the Hermitian adjoint of $Y$ and $ρ> 0$ is an additional parameter. We prove that when centered and properly rescaled, this r…
We study the renormalized real sample covariance matrix $H=X^TX/\sqrt{MN}-\sqrt{M/N}$ with $N/M\rightarrow0$ as $N, M\rightarrow \infty$ in this paper. And we always assume $M=M(N)$. Here $X=[X_{jk}]_{M\times N}$ is an $M\times N$ real random matrix with i.i.d entries, and we assume $\mathbb{E}|X_{11}|^{5+δ}<\infty$ with some small positive $δ$. The Stieltjes transform $m_N(z)=N^{-1}Tr(H-z)^{-1}$ and the linear eigenvalue statistics of $H$ are considered. We mainly focus on the asymptotic expansion of $\mathbb{E}\{m_N(z)\}$ in this paper. Then for some fine test function, a central limit theor…
In this note, we establish an asymptotic expansion for the centering parameter appearing in the central limit theorems for linear spectral statistic of large-dimensional sample covariance matrices when the population has a spiked covariance structure. As an application, we provide an asymptotic power function for the corrected likelihood ratio statistic for testing the presence of spike eigenvalues in the population covariance matrix. This result generalizes an existing formula from the literature where only one simple spike exists.
In this paper we consider a branching particle system consisting of particles moving according to the Ornstein-Uhlenbeck process in R^d and undergoing a binary, supercritical branching with a constant rate λ>0. This system is known to fulfil a law of large numbers (under exponential scaling). In the paper we prove the corresponding central limit theorem. Moreover, in the second part of the paper we consider U-statistics of the system, for which, under mild assumptions, we prove a law of large numbers and a central limit theorem. The limits are expressed in terms of multiple stochastic integral…
We consider "randomized" statistics constructed by using a finite number of observations a random field at randomly chosen points. We generalize the invariance principle (the functional CLT), the Glivenko--Cantelli theorem, the theorem about convergence to the Brownian bridge and the Kolmogorov theorem about the limit distribution of the empirical distribution function, as well as an improved version of the CLT in A. Tempelman, Randomized multivariate central limit theorems for ergodic homogeneous random fields, Stochastic Processes and their Applications. 143 (2022), 89-105. The randomized ap…
We prove a local central limit theorem for fluctuations of linear statistics of smooth enough test functions under the canonical Gibbs measure of two-dimensional Coulomb gases at any positive temperature. The proof relies on the existing global central limit theorem and a new decay estimate for the characteristic function of such fluctuations.
For $k,m,n\in \mathbb{N}$, we consider $n^k\times n^k$ random matrices of the form $$ \mathcal{M}_{n,m,k}(\mathbf{y})=\sum_{α=1}^mτ_α{Y_α}Y_α^T,\quad Y_α=\mathbf{y}_α^{(1)}\otimes...\otimes\mathbf{y}_α^{(k)}, $$ where $τ_{α}$, $α\in[m]$, are real numbers and $\mathbf{y}_α^{(j)}$, $α\in[m]$, $j\in[k]$, are i.i.d. copies of a normalized isotropic random vector $\mathbf{y}\in \mathbb{R}^n$. For every fixed $k\ge 1$, if the Normalized Counting Measures of $\{τ_{α}\}_α$ converge weakly as $m,n\rightarrow \infty$, $m/n^k\rightarrow c\in \lbrack 0,\infty )$ and $\mathbf{y}$ is a good vector in the se…
Bessel processes $(X_{t,k})_{t\ge0}$ in $N$ dimensions are classified via associated root systems and multiplicity constants $k\ge0$. They describe interacting Calogero-Moser-Suther\-land particle systems with $N$ particles and are related to $β$-Hermite and $β$-Laguerre ensembles. Recently, several central limit theorems were derived for fixed $t>0$, fixed starting points, and $k\to\infty$. In this paper we extend the CLT in the A-case from start in 0 to arbitrary starting distributions by using a limit result for the corresponding Bessel functions. We also determine the eigenvalues and eigen…
We analyze the fluctuations of incomplete $U$-statistics over a triangular array of independent random variables. We give criteria for a Central Limit Theorem (CLT, for short) to hold in the sense that we prove that an appropriately scaled and centered version of the U-statistic converges to a normal random variable. Our method of proof relies on a martingale CLT. A possible application -- a CLT for the hitting time for random walk on random graphs -- will be presented in \cite{LoTe20b}
We study dynamical systems arising as time-dependent compositions of Pomeau-Manneville-type intermittent maps. We establish central limit theorems for appropriately scaled and centered Birkhoff-like partial sums, with estimates on the rate of convergence. For maps chosen from a certain parameter range, but without additional assumptions on how the maps vary with time, we obtain a self-normalized CLT provided that the variances of the partial sums grow sufficiently fast. When the maps are chosen randomly according to a shift-invariant probability measure, we identify conditions under which the …
In this article, we establish a near-optimal convergence rate for the CLT of linear eigenvalue statistics of Wigner matrices, in Kolmogorov-Smirnov distance. For all test functions $f\in C^5(\mathbb R)$, we show that the convergence rate is either $N^{-1/2+\varepsilon}$ or $N^{-1+\varepsilon}$, depending on the first Chebyshev coefficient of $f$ and the third moment of the diagonal matrix entries. The condition that distinguishes these two rates is necessary and sufficient. For a general class of test functions, we further identify matching lower bounds for the convergence rates. In addition, …
We obtain convergence rates (in the Levi-Prokhorove metric) in the functional central limit theorem (CLT) for partial sums $S_n=\sum_{j=1}^{n}ξ_{j,n}$ of triangular arrays $\{ξ_{1,n},ξ_{2,n},...,ξ_{n,n}\}$ satisfying some mixing and moment conditions (which are not necessarily uniform in $n$). For certain classes of additive functionals of triangular arrays of contracting Markov chains (in the sense of Dobrushin) we obtain rates which are close to the best rates obtained for independent random variables. In addition, we obtain close to optimal rates in the usual CLT and a moderate deviations p…
We show central limit theorems (CLT) for the Stieltjes transforms or more general analytic functions of symmetric matrices with independent heavy tailed entries, including entries in the domain of attraction of $α$-stable laws and entries with moments exploding with the dimension, as in the adjacency matrices of Erdös-Rényi graphs. For the second model, we also prove a central limit theorem of the moments of its empirical eigenvalues distribution. The limit laws are Gaussian, but unlike to the case of standard Wigner matrices, the normalization is the one of the classical CLT for independent r…
In this paper, we establish the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix when the population covariance matrices are not uniformly bounded, which is a nontrivial extension of the Bai-Silverstein theorem (BST) (2004). The latter has strongly stimulated the development of high-dimensional statistics, especially the application of random matrix theory to statistics. However, the assumption of uniform boundedness of the population covariance matrices is found strongly limited to the applications of BST. The aim of this paper is …
The law of large numbers (LLN) and central limit theorem (CLT) are long and widely been known as two fundamental results in probability theory. Recently problems of model uncertainties in statistics, measures of risk and superhedging in finance motivated us to introduce, in [4] and [5] (see also [2], [3] and references herein), a new notion of sublinear expectation, called \textquotedblleft% $G$-expectation\textquotedblright, and the related \textquotedblleft$G$-normal distribution\textquotedblright from which we were able to define G-Brownian motion as well as the corresponding stochastic cal…
A law of large numbers and a central limit theorem are derived for linear statistics of random symmetric matrices whose on-or-above diagonal entries are independent, but neither necessarily identically distributed, nor necessarily all of the same variance. The derivation is based on systematic combinatorial enumeration, study of generating functions, and concentration inequalities of the Poincare type. Special cases treated, with an explicit evaluation of limiting variances, are generalized Wigner and Wishart matrices.
We prove, for any $β>0$, a central limit theorem for the fluctuations of linear statistics in the Sine-$β$ process, which is the infinite volume limit of the random microscopic behavior in the bulk of one-dimensional log-gases at inverse temperature $β$. If $ϕ$ is a compactly supported test function of class $C^4$, and $\mathcal{C}$ is a random point configuration distributed according to Sine-$β$, the integral of $ϕ(\cdot / \ell)$ against the random fluctuation $d\mathcal{C} - dx$, converges in law, as $\ell$ goes to infinity, to a centered normal random variable whose standard deviation is p…
We study the fluctuations of certain biorthogonal ensembles for which the underlying family \{P,Q\} satisfies a finite-term recurrence relation of the form $x P(x) = \mathbf{J}P(x)$. For polynomial linear statistics of such ensembles, we reformulate the cumulants' method introduced by Soshnikov in terms of counting lattice paths on the graph of the adjacency matrix \mathbf{J}. In the spirit of Breuer-Duits, we show that the asymptotic fluctuations of polynomial linear statistics are described by the right-limits of the matrix \mathbf{J}. Moreover, whenever the right-limit is a Laurent matrix, …
The multivariate central limit theorems (CLT) for the volumes of excursion sets of stationary quasi-associated random fields on $\mathbb{R}^d$ are proved. Special attention is paid to Gaussian and shot noise fields. Formulae for the covariance matrix of the limiting distribution are provided. A statistical version of the CLT is considered as well. Some numerical results are also discussed.
We study linear eigenvalue statistics of band Hankel matrices with Brownian motion entries. We prove that, the centred, normalized linear eigenvalue statistics of band Hankel matrices obey a central limit theorem (CLT) type result. We also discuss the convergence of linear eigenvalue statistics of band Hankel matrices with independent entries for odd power monomials. Our method is based on trace formula, moment method and some results of process convergence.
In this paper, we will derive the first and 2nd order Wiener chaos decomposition for the multivariate linear statistics of the determinantal point processes associated with the spectral projection kernels on the unit spheres $S^d$. We will first get a graphical representation for the cumulants of multivariate linear statistics for any determinantal point process. The main results then follow from the very precise estimates and identities regarding the spectral projection kernels and the symmetry of the spheres.
In this article, we study the fluctuations of the random variable: $$ {\mathcal I}_n(ρ) = \frac 1N \log\det(Σ_n Σ_n^* + ρI_N),\quad (ρ>0) $$ where $Σ_n= n^{-1/2} D_n^{1/2} X_n\tilde D_n^{1/2} +A_n$, as the dimensions of the matrices go to infinity at the same pace. Matrices $X_n$ and $A_n$ are respectively random and deterministic $N\times n$ matrices; matrices $D_n$ and $\tilde D_n$ are deterministic and diagonal, with respective dimensions $N\times N$ and $n\times n$; matrix $X_n=(X_{ij})$ has centered, independent and identically distributed entries with unit variance, either real or comple…
In many medical and biological investigations, including genetics, it is typical to handle high dimensional data which can be viewed as a set of values of some factors and a binary response variable. For instance, the response variable can describe the state of a patient health and one often assumes that it depends only on some part of factors. An important problem is to determine collections of significant factors. In this regard we turn to the MDR-method introduced by M.Ritchie and coauthors. Our recent paper provided the necessary and sufficient conditions for strong consistency of estimate…
We provide a new general theorem for multivariate normal approximation on convex sets. The theorem is formulated in terms of a multivariate extension of Stein couplings. We apply the results to a homogeneity test in dense random graphs and to prove multivariate asymptotic normality for certain doubly indexed permutation statistics.
We prove a central limit theorem for the linear statistics of one-dimensional log-gases, or $β$-ensembles. We use a method based on a change of variables which allows to treat fairly general situations, including multi-cut and, for the first time, critical cases, and generalizes the previously known results of Johansson, Borot-Guionnet and Shcherbina. In the one-cut regular case, our approach also allows to retrieve a rate of convergence as well as previously known expansions of the free energy to arbitrary order.
We establish a multivariate empirical process central limit theorem for stationary $\R^d$-valued stochastic processes $(X_i)_{i\geq 1}$ under very weak conditions concerning the dependence structure of the process. As an application we can prove the empirical process CLT for ergodic torus automorphisms. Our results also apply to Markov chains and dynamical systems having a spectral gap on some Banach space of functions. Our proof uses a multivariate extension of the techniques introduced by Dehling, Durieu and Volný \cite{DehDurVol09} in the univariate case. As an important technical ingredien…
Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature …
In a recent paper by the authors, a new approach--called the "embedding method"--was introduced, which allows to make use of exchangeable pairs for normal and multivariate normal approximation with Stein's method in cases where the corresponding couplings do not satisfy a certain linearity condition. The key idea is to embed the problem into a higher dimensional space in such a way that the linearity condition is then satisfied. Here we apply the embedding to U-statistics as well as to subgraph counts in random graphs.
We consider $n\times n$ real symmetric and Hermitian Wigner random matrices $n^{-1/2}W$ with independent (modulo symmetry condition) entries and the (null) sample covariance matrices $n^{-1}X^*X$ with independent entries of $m\times n$ matrix $X$. Assuming first that the 4th cumulant (excess) $κ_4$ of entries of $W$ and $X$ is zero and that their 4th moments satisfy a Lindeberg type condition, we prove that linear statistics of eigenvalues of the above matrices satisfy the central limit theorem (CLT) as $n\to\infty$, $m\to\infty$, $m/n\to c\in[0,\infty)$ with the same variance as for Gaussian …
We discuss CLT for the global and local linear statistics of random matrices from classical compact groups. The main part of our proofs are certain combinatorial identities much in the spirit of works by Kac and Spohn.
