We establish a general Berry-Esseen type bound which gives optimal bounds in many situations under suitable moment assumptions. By combining the general bound with Palm theory, we deduce a new error bound for assessing the accuracy of normal approximation to statistics arising from random measures, including stochastic geometry. We illustrate the use of the bound in four examples: completely random measures, excursion random measure of a locally dependent random process, and the total edge length of Ginibre-Voronoi tessellations and of Poisson-Voronoi tessellations. Moreover, we apply the general bound to Stein couplings and discuss the special cases of local dependence and additive functionals in occupancy problems.
This exposition explains the basic ideas of Stein's method for Poisson random variable approximation and Poisson process approximation from the point of view of the immigration-death process and Palm theory. The latter approach also enables us to define local dependence of point processes [Chen and Xia (2004)] and use it to study Poisson process approximation for locally dependent point processes and for dependent superposition of point processes.
The framework of Stein's method for Poisson process approximation is presented from the point of view of Palm theory, which is used to construct Stein identities and define local dependence. A general result (Theorem \refimportantproposition) in Poisson process approximation is proved by taking the local approach. It is obtained without reference to any particular metric, thereby allowing wider applicability. A Wasserstein pseudometric is introduced for measuring the accuracy of point process approximation. The pseudometric provides a generalization of many metrics used so far, including the t…
We present new Poisson process approximation results for stabilizing functionals of Poisson and binomial point processes. These functionals are allowed to have an unbounded range of interaction and encompass many examples in stochastic geometry. Our bounds are derived for the Kantorovich-Rubinstein distance using the generator approach to Stein's method. We give different types of bounds for different point processes. While some of our bounds are given in terms of coupling of the point process with its Palm version, the others are in terms of the local dependence structure formalized via the n…
We introduce some applications of Stein's method in the high temperature analysis of spin glasses. Stein's method allows the direct analysis of the Gibbs measure without having to create a cavity. Another advantage is that it gives limit theorems with total variation error bounds, although the bounds can be suboptimal. A surprising byproduct of our analysis is a relatively transparent explanation of the Thouless-Anderson-Palmer system of equations. Along the way, we develop Stein's method for mixtures of two Gaussian densities.
We consider a lcsc group G acting properly on a Borel space S and measurably on an underlying sigma-finite measure space. Our first main result is a transport formula connecting the Palm pairs of jointly stationary random measures on S. A key (and new) technical result is a measurable disintegration of the Haar measure on G along the orbits. The second main result is an intrinsic characterization of the Palm pairs of a G-invariant random measure. We then proceed with deriving a general version of the mass-transport principle for possibly non-transitive and non-unimodular group operations first…
Using an intrinsic approach, we study some properties of random fields which appear as tail fields of regularly varying stationary random fields. The index set is allowed to be a general locally compact Hausdorff Abelian group $\mathbb{G}$. The values are taken in a measurable cone, equipped with a pseudo norm. We first discuss some Palm formulas for the exceedance random measure $ξ$ associated with a stationary (measurable) random field $Y=(Y_s)_{s\in \mathbb{G}}$. It is important to allow the underlying stationary measure to be $σ$-finite. Then we proceed to a random field (defined on a prob…
The tail process $\boldsymbol{Y}=(Y_{\boldsymbol{i}})_{\boldsymbol{i}\in\mathbb{Z}^d}$ of a stationary regularly varying random field $\boldsymbol{X}=(X_{\boldsymbol{i}})_{\boldsymbol{i}\in\mathbb{Z}^d}$ represents the asymptotic local distribution of $\boldsymbol{X}$ as seen from its typical exceedance over a threshold $u$ as $u\to\infty$. Motivated by the standard Palm theory, we show that every tail process satisfies an invariance property called exceedance-stationarity and that this property, together with the polar decomposition of the tail process, characterizes the class of all tail pro…
In this paper we extend Stein's method to the distribution of the product of $n$ independent mean zero normal random variables. A Stein equation is obtained for this class of distributions, which reduces to the classical normal Stein equation in the case $n=1$. This Stein equation motivates a generalisation of the zero bias transformation. We establish properties of this new transformation, and illustrate how they may be used together with the Stein equation to assess distributional distances for statistics that are asymptotically distributed as the product of independent central normal random…
In his work \cite{Ti80}, Tikhomirov combined elements of Stein's method with the theory of characteristic functions to derive Kolmogorov bounds for the convergence rate in the central limit theorem for a normalized sum of a stationary sequence of random variables satisfying one of several weak dependency conditions. The combination of elements of Stein's method with the theory of characteristic functions is sometimes called \emph{Stein-Tikhomirov method}. \citet*{AMPS17} successfully used the Stein-Tikhomirov method to bound the convergence rate in contexts with non-Gaussian targets. \citet*{R…
We use a multivariate version of Stein's method to establish a quantitative Lindeberg CLT for the Fourier transforms of random $N$-vectors. We achieve this by deducing a specific integral representation for the Hessian matrix of a solution to the Stein equation with test function $e_t(x) = \exp(- i \sum_{k=1}^N t_k x_k)$, where $t,x \in \mathbb{R}^N$.
We obtain Stein approximation bounds for stochastic integrals with respect to a Poisson random measure over ${\Bbb R}^d$, $d\geq 2$. This approach relies on third cumulant Edgeworth-type expansions based on derivation operators defined by the Malliavin calculus for Poisson random measures. The use of third cumulants can exhibit faster convergence rates than the standard Berry-Esseen rate for some sequences of Poisson stochastic integrals.
In this paper, we extend Stein's method to products of independent beta, gamma, generalised gamma and mean zero normal random variables. In particular, we obtain Stein operators for mixed products of these distributions, which include the classical beta, gamma and normal Stein operators as special cases. These operators lead us to closed-form expressions involving the Meijer $G$-function for the probability density function and characteristic function of the mixed product of independent beta, gamma and central normal random variables.
We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and functionals of both continuous and discrete independent random variables. For random variables admitting a continuous density, it recovers classical distance bounds based on absolute third moments, with better and explicit constants. We also apply this method to multiple stochastic integrals that can be used to represent U-statistics, and include linear and quad…
In the first part of this paper we consider a general stationary subcritical cluster model in $\mathbb{R}^d$. The associated pair-connectedness function can be defined in terms of two-point Palm probabilities of the underlying point process. Using Palm calculus and Fourier theory we solve the Ornstein-Zernike equation (OZE) under quite general distributional assumptions. In the second part of the paper we discuss the analytic and combinatorial properties of the OZE-solution in the special case of a Poisson driven random connection model.
In this paper, a new method based on probability generating functions is used to obtain multiple Stein operators for various random variables closely related to Poisson, binomial and negative binomial distributions. Also, Stein operators for certain compound distributions, where the random summand satisfies Panjer's recurrence relation, are derived. A well-known perturbation approach for Stein's method is used to obtain total variation bounds for the distributions mentioned above. The importance of such approximations is illustrated, for example, by the binomial convoluted with Poisson approxi…
Let $Z$ be a standard normal random variable and let $H_n$ denote the $n$-th Hermite polynomial. In this note, we obtain Stein equations for the random variables $H_3(Z)$ and $H_4(Z)$, which represents a first step towards developing Stein's method for distributional limits from the third and fourth Wiener chaoses. Perhaps surprisingly, these Stein equations are fifth and third order linear ordinary differential equations, respectively. As a warm up, we obtain a Stein equation for the random variable $aZ^2+bZ+c$, $a,b,c\in\mathbb{R}$, which leads us to a Stein equation for the non-central chi-…
We use Stein's method to obtain explicit bounds on the rate of convergence for the Laplace approximation of two different sums of independent random variables; one being a random sum of mean zero random variables and the other being a deterministic sum of mean zero random variables in which the normalisation sequence is random. We make technical advances to the framework of Pike and Ren \cite{pike} for Stein's method for Laplace approximation, which allows us to give bounds in the Kolmogorov and Wasserstein metrics. Under the additional assumption of vanishing third moments, we obtain faster c…
The original Donsker theorem says that a standard random walk converges in distribution to a Brownian motion in the space of continuous functions. It has recently been extended to enriched random walks and enriched Brownian motion. We use the Stein-Dirichlet method to precise the rate of this convergence in the topology of fractional Sobolev spaces.
In this article, we first review the connection between Lévy processes and infinitely divisible random variables, and the classification of infinitely divisible distributions. Using this connection and the Lévy-Khinchine representation of the characteristic function, we establish a Stein identity for an infinitely divisible random variable. The classification and slight modification in approach give us a Stein identity for an $α$-stable random variable with $α\in (0,2).$ Using fine regularity estimates for the solution to Stein equation, we derive error bounds for $α$-stable approximations. We…
We develop Stein's method for the half-normal distribution and apply it to derive rates of convergence in distributional limit theorems for three statistics of the simple symmetric random walk: the maximum value, the number of returns to the origin and the number of sign changes up to a given time $n$. We obtain explicit error bounds with the optimal rate $n^{-1/2}$ for both the Kolmogorov and the Wasserstein metric. In order to apply Stein's method, we compare the characterizing operator of the limiting half-normal distribution with suitable characterizations of the discrete approximating dis…
In this article, we develop Stein characterization for two-sided tempered stable distribution. Stein characterizations for normal, gamma, Laplace, and variance-gamma distributions already known in the literature follow easily. One can also derive Stein characterizations for more difficult distributions such as the distribution of product of two normal random variables, a difference between two gamma random variables. Using the semigroup approach, we obtain estimates of the solution to Stein equation. Finally, we apply these estimates to obtain error bounds in the Wasserstein-type distance for …
We build upon recent advances on the distributional aspect of Stein's method to propose a novel and flexible technique for computing Stein operators for random variables that can be written as products of independent random variables. We show that our results are valid for a wide class of distributions including normal, beta, variance-gamma, generalized gamma and many more. Our operators are $k$th degree differential operators with polynomial coefficients; they are straightforward to obtain even when the target density bears no explicit handle. As an application, we derive a new formula for th…
Let $\boldsymbolξ=(ξ_1,\ldots,ξ_m)$ be a negatively associated mean zero random vector with components that obey the bound $|ξ_i| \le B, i=1,\ldots,m$, and whose sum $W = \sum_{i=1}^m ξ_i$ has variance 1, the bound \[ d_1\big({\cal L}(W),{\cal L}(Z)\big) \le 5B - 5.2\sum_{i \not = j} σ_{ij}. \] is obtained where $Z$ has the standard normal distribution and $d_1(\cdot,\cdot)$ is the $L^1$ metric. The result is extended to the multidimensional case with the $L^1$ metric replaced by a smooth functions metric. Applications to second order stationary random fields with exponential decreasing covari…
In a recent paper, Gaunt 2020 extended Stein's method to limit distributions that can be represented as a function $g:\mathbb{R}^d\rightarrow\mathbb{R}$ of a centered multivariate normal random vector $Σ^{1/2}\mathbf{Z}$ with $\mathbf{Z}$ a standard $d$-dimensional multivariate normal random vector and $Σ$ a non-negative definite covariance matrix. In this paper, we obtain improved bounds, in the sense of weaker moment conditions, smaller constants and simpler forms, for the case that $g$ has derivatives with polynomial growth. We obtain new non-uniform bounds for the derivatives of the soluti…
Using Stein's method techniques, we develop a framework which allows one to bound the error terms arising from approximation by the Laplace distribution and apply it to the study of random sums of mean zero random variables. As a corollary, we deduce a Berry-Esseen type theorem for the convergence of certain geometric sums. Our results make use of a second order characterizing equation and a distributional transformation which is related to zero-biasing.
We use Stein's method to prove a generalization of the Lindeberg-Feller CLT providing an upper and a lower bound for the superior limit of the Kolmogorov distance between a normally distributed random variable and the rowwise sums of a rowwise independent triangular array of random variables which is asymptotically negligible in the sense of Feller. A natural example shows that the upper bound is of optimal order. The lower bound improves a result by Andrew Barbour and Peter Hall.
We investigate Stein-Malliavin approximations for nonlinear functionals of geometric interest of Gaussian random eigenfunctions on the unit $d$ -dimensional sphere ${\mathbb{S}}^{d},$ $d\geq 2.$ All our results are established in the high energy limit, i.e. for eigenfunctions corresponding to growing eigenvalues. More precisely, we provide an asymptotic analysis for the variance of random eigenfunctions, and also establish rates of convergence for various probability metrics for Hermite subordinated processes, arbitrary polynomials of finite order and square integral nonlinear transforms; the …
We combine Malliavin calculus with Stein's method to derive bounds for the Variance-Gamma approximation of functionals of isonormal Gaussian processes, in particular of random variables living inside a fixed Wiener chaos induced by such a process. The bounds are presented in terms of Malliavin operators and norms of contractions. We show that a sequence of distributions of random variables in the second Wiener chaos converges to a Variance-Gamma distribution if and only if their moments of order two to six converge to that of a Variance-Gamma distributed random variable (six moment theorem). M…
In this article, we provide an extension of the Chen-Stein inequality for Poisson approximation in the total variation distance for sums of independent Bernoulli random variables in two ways. We prove that we can improve the rate of convergence (hence the quality of the approximation) by using explicitly constructed signed or positive probability measures, and that we can extend the setting to possibly dependent random variables. The framework which allows this is that of mod-Poisson convergence, and more precisely those mod-Poisson convergent sequences whose residue functions can be expressed…
In the first part of the paper we use a new Fourier technique to obtain a Stein characterizations for random variables in the second Wiener chaos. We provide the connection between this result and similar conclusions that can be derived using Malliavin calculus. We also introduce a new form of discrepancy which we use, in the second part of the paper, to provide bounds on the 2-Wasserstein distance between linear combinations of independent centered random variables. Our method of proof is entirely original. In particular it does not rely on estimation of bounds on solutions of the so-called S…
We prove a general theorem to bound the total variation distance between the distribution of an integer valued random variable of interest and an appropriate discretized normal distribution. We apply the theorem to 2-runs in a sequence of i.i.d. Bernoulli random variables, the number of vertices with a given degree in the Erdös-Rényi random graph, and the uniform multinomial occupancy model.
We introduce and study invariant (weighted) transport-kernels balancing stationary random measures on a locally compact Abelian group. The first main result is an associated fundamental invariance property of Palm measures, derived from a generalization of Neveu's exchange formula. The second main result is a simple sufficient and necessary criterion for the existence of balancing invariant transport-kernels. We then introduce (in a nonstationary setting) the concept of mass-stationarity with respect to a random measure, formalizing the intuitive idea that the origin is a typical location in t…
In this paper, we consider the sums of non-negative integer valued $m$-dependent random variables, and its approximation to the power series distribution. We first discuss some relevant results for power series distribution such as Stein operator, uniform and non-uniform bounds on the solution of Stein equation, and etc. Using Stein's method, we obtain the error bounds for the approximation problem considered. As special cases, we discuss two applications, namely, $2$-runs and $(k_1,k_2)$-runs and compare the bound with the existing bounds.
Stein's method is applied to obtain a general Cramer-type moderate deviation result for dependent random variables whose dependence is defined in terms of a Stein identity. A corollary for zero-bias coupling is deduced. The result is also applied to a combinatorial central limit theorem, a general system of binary codes, the anti-voter model on a complete graph, and the Curie-Weiss model. A general moderate deviation result for independent random variables is also proved.
We establish a general inequality on the Poisson space, yielding an upper bound for the distance in total variation between the law of a regular random variable with values in the integers and a Poisson distribution. Several applications are provided, in particular: (i) to deduce a set of sufficient conditions implying that a sequence of (suitably shifted) multiple Wiener-Itô integrals converges in distribution to a Poisson random variable, and (ii) to compute explicit rates of convergence for the Poisson approximation of statistics associated with geometric random graphs with sparse connectio…
Let $W$ be a random variable with mean zero and variance $σ^2$. The distribution of a variate $W^*$, satisfying $EWf(W)=σ^2 Ef'(W^*)$ for smooth functions $f$, exists uniquely and defines the zero bias transformation on the distribution of $W$. The zero bias transformation shares many interesting properties with the well known size bias transformation for non-negative variables, but is applied to variables taking on both positive and negative values. The transformation can also be defined on more general random objects. The relation between the transformation and the expression $wf'(w)-σ^2 f''…
Stein's method allows to prove distributional convergence of a sequence of random variables and to quantify it with respect to a given metric such as Kolmogorov's (a Berry-Esséen type theorem). Mod-* convergence quantifies the convergence of a sequence of random variables to a given distribution in a sense unusual in probability theory, a priori unrelated to a metric on probability measures. This article gives a connection between these two notions. It shows that mod-* convergence can be understood as a higher order approximation in distribution when the limiting function is integrable and pro…
This paper establishes new concentration inequalities for random matrices constructed from independent random variables. These results are analogous with the generalized Efron-Stein inequalities developed by Boucheron et al. The proofs rely on the method of exchangeable pairs.
We derive explicit central moment inequalities for random variables that admit a Stein coupling, such as exchangeable pairs, size--bias couplings or local dependence, among others. The bounds are in terms of moments (not necessarily central) of variables in the Stein coupling, which are typically local in some sense, and therefore easier to bound. In cases where the Stein couplings have the kind of behaviour leading to good normal approximation, the central moments are closely bounded by those of a normal. We show how the bounds can be used to produce concentration inequalities, and compare th…
One major obstacle in applications of Stein's method for compound Poisson approximation is the availability of so-called magic factors (bounds on the solution of the Stein equation) with favourable dependence on the parameters of the approximating compound Poisson random variable. In general, the best such bounds have an exponential dependence on these parameters, though in certain situations better bounds are available. In this paper, we extend the region for which well-behaved magic factors are available for compound Poisson approximation in the Kolmogorov metric, allowing useful compound Po…
We obtain rates of convergence in limit theorems of partial sums $S_n$ for certain sequences of dependent, identically distributed random variables, which arise naturally in statistical mechanics, in particular, in the context of the Curie-Weiss models. Under appropriate assumptions there exists a real number $α$, a positive real number $μ$, and a positive integer $k$ such that $(S_n- n α)/n^{1 - 1/2k}$ converges weakly to a random variable with density proportional to $\exp(-μ|x|^{2k} /(2k)!)$. We develop Stein's method for exchangeable pairs for a rich class of distributional approximations …
Let $X$ be a simple random walk on $\mathbb{Z}_n^d$ with $d\geq 3$ and let $t_{\rm{cov}}$ be the expected cover time. We consider the set of points $\mathcal{U}_α$ of $\mathbb{Z}_n^d$ that have not been visited by the walk by time $αt_{\rm{cov}}$ for $α\in (0,1)$. It was shown in [MS17] that there exists $α_1(d)\in (0,1)$ such that for all $α>α_1(d)$ the total variation distance between the law of the set $\mathcal{U}_α$ and an i.i.d. sequence of Bernoulli random variables indexed by $\mathbb{Z}_n^d$ with success probability $n^{-αd}$ tends to $0$ as $n \to \infty$. In [MS17] the constant $α_1…
The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized sums of $k$-dimensional independent random vectors $W=\sum_{i=1}^n X_i$ with an error bound of order $k^{1/2}γ$ where $γ=\sum_{i=1}^n E|X_i|^3$. For sums of locally dependent (unbounded) random vectors, we obtain a fourth moment bound which is typically of order $O_k(1/\sqrt{n})$, as well as a third moment bound which is typically of order $O_k(\log n/\sqrt…
We combine the method of exchangeable pairs with Stein's method for functional approximation. As a result, we give a general linearity condition under which an abstract Gaussian approximation theorem for stochastic processes holds. We apply this approach to estimate the distance of a sum of random variables, chosen from an array according to a random permutation, from a Gaussian mixture process. This result lets us prove a functional combinatorial central limit theorem. We also consider a graph-valued process and bound the speed of convergence of the distribution of its rescaled edge counts to…
