In this paper, we derive a necessary and sufficient condition on the parameters of the Hypergeometric distribution for weak convergence to a Normal limit. We establish a Berry-Esseen theorem for the Hypergeometric distribution solely under this necessary and sufficient condition. We further derive a nonuniform Berry-Esseen bound where the tails of the difference between the Hypergeometric and the Normal distribution functions are shown to decay at a sub-Gaussian rate.
We establish a Berry--Esseen bound for general multivariate nonlinear statistics by developing a new multivariate-type randomized concentration inequality. The bound is the best possible for many known statistics. As applications, Berry--Esseen bounds for M-estimators and averaged stochastic gradient descent algorithms are obtained.
New nonuniform Berry--Esseen-type bounds for sums of independent random variables are obtained, motivated by recent studies concerning such bounds for nonlinear statistics. The proofs are based on the Chen--Shao concentration techniques within the framework of the Stein method.
New Berry--Esseen-type bounds, with explicit constant factors, for the distribution of the Student statistic and, equivalently, for that of the self-normalized sum of independent zero-mean random variables are obtained. These bounds are compared with the corresponding existing results.
In this work, we provide a $(n/m)^{-1/2}$-rate finite sample Berry-Esseen bound for $m$-dependent high-dimensional random vectors over the class of hyper-rectangles. This bound imposes minimal assumptions on the random vectors such as nondegenerate covariances and finite third moments. The proof uses inductive relationships between anti-concentration inequalities and Berry--Esseen bounds, which are inspired by the telescoping method of Chen and Shao (2004) and the recursion method of Kuchibhotla and Rinaldo (2020). Performing a dual induction based on the relationships, we obtain tight Berry-E…
As an extension of a central limit theorem established by Svante Janson, we prove a Berry-Esseen inequality for a sum of independent and identically distributed random variables conditioned by a sum of independent and identically distributed integer-valued random variables.
Refined Berry-Esseen bounds under local dependence
Southern University of Science and Technology（南方科技大学）；Shenzhen International Center for Mathematics, Southern University of Science and Technology（南方科技大学深圳数学中心）
A Chernoff-type distribution is a nonnormal distribution defined by the slope at zero of the greatest convex minorant of a two-sided Brownian motion with a polynomial drift. While a Chernoff-type distribution is known to appear as the distributional limit in many non-regular statistical estimation problems, the accuracy of Chernoff-type approximations has remained largely unknown. In the present paper, we tackle this problem and derive Berry-Esseen bounds for Chernoff-type limit distributions in the canonical non-regular statistical estimation problem of isotonic (or monotone) regression. The …
The Berry-Esséen upper bounds of moment estimators and least squares estimators of the mean and drift coefficients in Vasicek models driven by general Gaussian processes are studied. When studying the parameter estimation problem of Ornstein-Uhlenbeck (OU) process driven by fractional Brownian motion, the commonly used methods are mainly given by Kim and Park, they show the upper bound of Kolmogorov distance between the distribution of the ratio of two double Wiener-Itô stochastic integrals and the Normal distribution. The main innovation in this paper is extending the above ratio process, tha…
Let $H$ be a real separable Hilbert space and $(a_k)_{k\in\mathbb{Z}}$ a sequence of bounded linear operators from $H$ to $H$. We consider the linear process $X$ defined for any $k$ in $\mathbb{Z}$ by $X_k=\sum_{j\in\mathbb{Z}}a_j(\varepsilon_{k-j})$ where $(\varepsilon_k)_{k\in\mathbb{Z}}$ is a sequence of i.i.d. centered $H$-valued random variables. We investigate the rate of convergence in the CLT for $X$ and in particular we obtain the usual Berry-Esseen's bound provided that $\sum_{j\in\mathbb{Z}}\vert j\vert\|a_j\|_{\mathcal{L}(H)}<+\infty$ and $\varepsilon_0$ belongs to $L_H^{\infty}$.
Let $Z:=\{Z_t,t\geq0\}$ be a stationary Gaussian process. We study two estimators of $\mathbb{E}[Z_0^2]$, namely $\widehat{f}_T(Z):= \frac{1}{T} \int_{0}^{T} Z_{t}^{2}dt$, and $\widetilde{f}_n(Z) :=\frac{1}{n} \sum_{i =1}^{n} Z_{t_{i}}^{2}$, where $ t_{i} = i Δ_{n}$, $ i=0,1,\ldots, n $, $Δ_{n}\rightarrow 0$ and $ T_{n} := n Δ_{n}\rightarrow \infty$. We prove that the two estimators are strongly consistent and establish Berry-Esseen bounds for a central limit theorem involving $\widehat{f}_T(Z)$ and $\widetilde{f}_n(Z)$. We apply these results to asymptotically stationary Gaussian processes an…
We give a nonuniform Berry-Esseen bound for self-normalized martingales, which bridges the gap between the result of Haeusler (1988) and Fan and Shao (2018). The bound coincides with the nonuniform Berry-Esseen bound of Haeusler and Joos (1988) for standardized martingales. As a consequence, a Berry-Esseen bound is obtained.
The inductive size bias coupling technique and Stein's method yield a Berry-Esseen theorem for the number of urns having occupancy $d \ge 2$ when $n$ balls are uniformly distributed over $m$ urns. In particular, there exists a constant $C$ depending only on $d$ such that $$ \sup_{z \in \mathbb{R}}|P(W_{n,m} \le z) -P(Z \le z)| \le C \left( \frac{1+(\frac{n}{m})^3}{σ_{n,m}} \right) \quad \mbox{for all $n \ge d$ and $m \ge 2$,} $$ where $W_{n,m}$ and $σ_{n,m}^2$ are the standardized count and variance, respectively, of the number of urns with $d$ balls, and $Z$ is a standard normal random variab…
We obtain Berry-Esseen type estimates for "nonconventional" expressions of the form $ξ_N=\frac 1{\sqrt N}\sum_{n=1}^N(F(X(q_1(n)),...,X(q_\ell(n)))-\bar F)$
A Berry-Esseen bound is obtained for self-normalized martingales under the assumption of finite moments. The bound coincides with the classical Berry-Esseen bound for standardized martingales. An example is given to show the optimality of the bound. Applications to Student's statistic and autoregressive process are also discussed.
In this paper, we prove a Berry--Esseen bound with optimal order for self-normalized sums of local dependent random variables under some mild dependence conditions. The proof is based on Stein's method and a randomized concentration inequality. As applications, we obtain optimal Berry--Esseen bounds for $m$-dependent random variables and graph dependency.
In this paper, we establish optimal Berry--Esseen bounds for the generalized $U$-statistics. The proof is based on a new Berry--Esseen theorem for exchangeable pair approach by Stein's method under a general linearity condition setting. As applications, an optimal convergence rate of the normal approximation for subgraph counts in Erdös--Rényi graphs and graphon-random graph is obtained.
We obtain a Berry-Esseen type bound for the distribution of the maximum likelihood estimator of the drift parameter for fractional Ornstein-uhlenbeck type process driven by sub-fractional Brownian motion.
Berry-Esseen-type bounds for total variation and relative entropy distances to the normal law are established for the sums of non-i.i.d. random variables.
For an Ornstein-Uhlenbeck process driven by fractional Brownian motion with Hurst index $H\in [\frac12,\frac34]$, we show the Berry-Esséen bound of the least squares estimator of the drift parameter. We use an approach based on Malliavin calculus given by Kim and Park \cite{kim 3}.
Under correlation-type conditions, we derive upper bounds of order $\frac{1}{\sqrt{n}}$ for the Kolmogorov distance between the distributions of weighted sums of dependent summands and the normal law.
Bolthausen used a variation of Stein's method to give an inductive proof of the Berry-Esseen theorem for sums of independent, identically distributed random variables. We modify this technique to prove a Berry-Esseen theorem for character ratios of a random representation of the symmetric group on transpositions. An analogous result is proved for Jack measure on partitions.
We obtain a sharp estimate of the speed of convergence in the Boolean central limit theorem for measures of finite sixth moment. The main tool is a quantitative version of the Stieltjes-Perron inversion formula.
We establish new lower bounds for the normal approximation in the Wasserstein distance of random variables that are functionals of a Poisson measure. Our results generalize previous findings by Nourdin and Peccati (2012, 2015) and Biermé, Bonami, Nourdin and Peccati (2013), involving random variables living on a Gaussian space. Applications are given to optimal Berry-Esseen bounds for edge counting in random geometric graphs.
We establish nonuniform Berry-Esseen bounds for martingales under the conditional Bernstein condition. These bounds imply Cramér type large deviations for moderate $x$'s, and are of exponential decay rate as de la Peña's inequality when $x\rightarrow \infty$. Statistical applications associated with linear regressions and self-normalized large deviations are also provided.
In the present paper we consider the Ornstein-Uhlenbeck process of the second kind defined as solution to the equation $dX_{t} = -αX_{t}dt+dY_{t}^{(1)}, \ \ X_{0}=0$, where $Y_{t}^{(1)}:=\int_{0}^{t}e^{-s}dB^H_{a_{s}}$ with $a_{t}=He^{\frac{t}{H}}$, and $B^H$ is a fractional Brownian motion with Hurst parameter $H\in(\frac12,1)$, whereas $α>0$ is unknown parameter to be estimated. We obtain the upper bound $O(1/\sqrt{T})$ in Kolmogorov distance for normal approximation of the least squares estimator of the drift parameter $α$ on the basis of the continuous observation $\{X_t,t\in[0,T]\}$, as $…
We derive explicit Berry-Esseen bounds in the total variation distance for the Breuer-Major central limit theorem, in the case of a subordinating function $φ$ satisfying minimal regularity assumptions. Our approach is based on the combination of the Malliavin-Stein approach for normal approximations with Gebelein's inequality, bounding the covariance of functionals of Gaussian fields in terms of maximal correlation coefficients.
We give estimates on the rate of convergence in the Boolean central limit theorem for the Lévy distance. In the case of measures with bounded support we obtain a sharp estimate by giving a qualitative description of this convergence.
We show, how the classical Berry-Esseen theorem for normal approximation may be used to derive rates of convergence for random sums of centerd, real-valued random variables with respect to a certain class of probability metrics, including the Kolmogorov and the Wasserstein distances. This technique is applied to several examples, including the approximation by a Laplace distribution of a geometric sum of centered random variables with finite third moment, where a concrete Berry-Esseen bound is derived. This bound reduces to a bound of the supposedly optimal order $\sqrt{p}$ in the i.i.d. case.
We give rates of convergence in the Central Limit Theorem for the coefficients and the spectral radius of the left random walk on GLd(R), assuming the existence of an exponential or polynomial moment.
We consider functionals which are weighted averages of the avoidance function of a Poisson process. Using the approach to Stein's method based on Malliavin calculus for Poisson functionals we provide explicit bounds for the Wasserstein distance between these standardized functionals and the standard normal distribution. Our approach relies on closed-form expressions for the action of some Malliavin type operators on avoidance functionals of Poisson processes. As a result we provide Berry-Esseen bounds in the CLT for the volume of the union of balls of a fixed radius around random Poisson cente…
Let $(Z_n)$ be a supercritical branching process in a random environment $ξ= (ξ_n)$. We establish a Berry-Esseen bound and a Cramér's type large deviation expansion for $\log Z_n$ under the annealed law $\mathbb P$. We also improve some earlier results about the harmonic moments of the limit variable $W=lim_{n\to \infty} W_n$, where $W_n =Z_n/ \mathbb{E}_ξ Z_n$ is the normalized population size.
We obtain Berry-Esseen-type bounds for the sum of random variables with a dependency graph and uniformly bounded moments of order $δ\in (2,\infty]$ using a Fourier transform approach. Our bounds improve the state-of-the-art in the regime where the degree of the dependency graph is large. As a Corollary of our results, we obtain a Central Limit Theorem for random variables with a sparse dependency graph that are uniformly bounded in $L^δ$ for some $δ\in(2,\infty]$.
Berry-Esseen bounds for non-linear functionals of infinite Rademacher sequences are derived by means of the Malliavin-Stein method. Moreover, multivariate extensions for vectors of Rademacher functionals are shown. The results establish a connection to small-ball probabilities and shed new light onto the relation between central limit theorems on the Rademacher chaos and norms of contraction operators. Applications concern infinite weighted 2-runs, a combinatorial central limit theorem and traces of Bernoulli random matrices.
Hwang's quasi-power theorem asserts that a sequence of random variables whose moment generating functions are approximately given by powers of some analytic function is asymptotically normally distributed. This theorem is generalised to higher dimensional random variables. To obtain this result, a higher dimensional analogue of the Berry-Esseen inequality is proved, generalising a two-dimensional version by Sadikova.
\noindent We study the asymptotic behavior of a sum of independent and identically distributed random variables conditioned by a sum of independent and identically distributed integer-valued random variables. We prove a Berry-Esseen bound in a general setting and a large deviation result when the Laplace transform of the underlying distribution is not defined in a neighborhood of zero. Then we present several combinatorial applications. In particular, we prove a large deviation result for the model of hashing with linear probing.
Applying Stein's method, an inductive technique and size bias coupling yields a Berry-Esseen theorem for normal approximation without the usual restriction that the coupling be bounded. The theorem is applied to counting the number of vertices in the Erdos-Renyi random graph of a given degree.
A new Berry-Esseen bound for non-linear functionals of non-symmetric and non-homogeneous infinite Rademacher sequences is established. It is based on a discrete version of the Malliavin-Stein method and an analysis of the discrete Ornstein-Uhlenbeck semigroup. The result is applied to sub-graph counts and to the number of vertices having a prescribed degree in the Erdős-Renyi random graph. A further application deals with a percolation problem on trees.
Given a weakly dependent stationary process, we describe the transition between a Berry-Esseen bound and a second order Edgeworth expansion in terms of the Berry-Esseen characteristic. This characteristic is sharp: We show that Edgeworth expansions are valid if and only if the Berry-Esseen characteristic is of a certain magnitude. If this is not the case, we still get an optimal Berry-Esseen bound, thus describing the exact transition. We also obtain (fractional) expansions given $3 < p \leq 4$ moments, where a similar transition occurs. Corresponding results also hold for the Wasserstein metr…
An analogue of the Berry-Esseen inequality is proved for the speed of convergence of free additive convolutions of bounded probability measures. The obtained rate of convergence is of the order n^{-1/2}, the same as in the classical case. An example with binomial measures shows that this estimate cannot be improved without imposing further restrictions on convolved measures.
