We combine Stein's method with a version of Malliavin calculus on the Poisson space. As a result, we obtain explicit Berry-Esséen bounds in Central Limit Theorems (CLTs) involving multiple Wiener-Itô integrals with respect to a general Poisson measure. We provide several applications to CLTs related to Ornstein-Uhlenbeck Lévy processes.
In this paper, we give an upper bound for a probabilistic distance between a Gaussian vector and a vector of U-statistics of Poisson point processes by applying Malliavin-Stein inequality on the Poisson space.
We obtain Stein approximation bounds for stochastic integrals with respect to a Poisson random measure over ${\Bbb R}^d$, $d\geq 2$. This approach relies on third cumulant Edgeworth-type expansions based on derivation operators defined by the Malliavin calculus for Poisson random measures. The use of third cumulants can exhibit faster convergence rates than the standard Berry-Esseen rate for some sequences of Poisson stochastic integrals.
We establish various bounds on the solutions to a Stein equation for Poisson approximation in Wasserstein distance with non-linear transportation costs. The proofs are a refinement of those in [Barbour and Xia (2006)] using the results in [Liu and Ma (2009)]. As a corollary, we obtain an estimate of Poisson approximation error measured in L^2-Wasserstein distance.
Stein's (1972) method is a very general tool for assessing the quality of approximation of the distribution of a random element by another, often simpler, distribution. In applications of Stein's method, one needs to establish a Stein identity for the approximating distribution, solve the Stein equation and estimate the behaviour of the solutions in terms of the metrics under study. For some Stein equations, solutions with good properties are known; for others, this is not the case. Barbour and Xia (1999) introduced a perturbation method for Poisson approximation, in which Stein identities for…
One major obstacle in applications of Stein's method for compound Poisson approximation is the availability of so-called magic factors (bounds on the solution of the Stein equation) with favourable dependence on the parameters of the approximating compound Poisson random variable. In general, the best such bounds have an exponential dependence on these parameters, though in certain situations better bounds are available. In this paper, we extend the region for which well-behaved magic factors are available for compound Poisson approximation in the Kolmogorov metric, allowing useful compound Po…
In this paper, we apply the Stein's method in the context of point processes, namely when the target measure is the distribution of a finite Poisson point process. We show that the so-called Kantorovich-Rubinstein distance between such a measure and another finite point process is bounded by the $L^1$-distance between their respective Papangelou intensities. Then, we deduce some convergence rates for sequences of point processes approaching a Poisson or a Cox point process.
The main purpose of the paper is to investigate the possibility of applying Chen-Stein approach to estimate the $χ^2$ distance between Poisson distribution and a sum of independent indicators. Earlier results concerning $χ^2$ distance between above mentioned distributions either used analytical approach heavily based on the analysis of the generating functions or on rather lengthy and complicated elementary calculations. Applying Chen-Stein approach we succeed in providing a very quick proof of upper bounds for $χ^2$ distance that are of comparable strength to the earlier estimates obtained by…
This exposition explains the basic ideas of Stein's method for Poisson random variable approximation and Poisson process approximation from the point of view of the immigration-death process and Palm theory. The latter approach also enables us to define local dependence of point processes [Chen and Xia (2004)] and use it to study Poisson process approximation for locally dependent point processes and for dependent superposition of point processes.
We establish a general inequality on the Poisson space, yielding an upper bound for the distance in total variation between the law of a regular random variable with values in the integers and a Poisson distribution. Several applications are provided, in particular: (i) to deduce a set of sufficient conditions implying that a sequence of (suitably shifted) multiple Wiener-Itô integrals converges in distribution to a Poisson random variable, and (ii) to compute explicit rates of convergence for the Poisson approximation of statistics associated with geometric random graphs with sparse connectio…
This paper uses the generator comparison approach of Stein's method to analyze the gap between steady-state distributions of Markov chains and diffusion processes. The "standard" generator comparison approach starts with the Poisson equation for the diffusion, and the main technical difficulty is to obtain bounds on the derivatives of the solution to the Poisson equation, also known as Stein factor bounds. In this paper we propose starting with the Poisson equation of the Markov chain; we term this the prelimit approach. Although one still needs Stein factor bounds, they now correspond to fini…
New bounds on the total variation distance between the law of integer valued functionals of possibly non-symmetric and non-homogeneous infinite Rademacher sequences and the Poisson distribution are established. They are based on a combination of the Chen-Stein method and a discrete version of Malliavin calculus. We give some applications to shifted discrete multiple stochastic integrals.
In this article, we provide an extension of the Chen-Stein inequality for Poisson approximation in the total variation distance for sums of independent Bernoulli random variables in two ways. We prove that we can improve the rate of convergence (hence the quality of the approximation) by using explicitly constructed signed or positive probability measures, and that we can extend the setting to possibly dependent random variables. The framework which allows this is that of mod-Poisson convergence, and more precisely those mod-Poisson convergent sequences whose residue functions can be expressed…
We apply the Stein-Chen method to problems from extreme value theory. On the one hand, the Stein-Chen method for Poisson approximation allows us to obtain bounds on the Kolmogorov distance between the law of the maximum of i.i.d. random variables, following certain well known distributions, and an extreme value distribution. On the other hand, we introduce marked point processes of exceedances (MPPE's) whose i.i.d. marks can be either univariate or multivariate. We use the Stein-Chen method for Poisson process approximation to determine bounds on the error of the approximation, in some appropr…
The framework of Stein's method for Poisson process approximation is presented from the point of view of Palm theory, which is used to construct Stein identities and define local dependence. A general result (Theorem \refimportantproposition) in Poisson process approximation is proved by taking the local approach. It is obtained without reference to any particular metric, thereby allowing wider applicability. A Wasserstein pseudometric is introduced for measuring the accuracy of point process approximation. The pseudometric provides a generalization of many metrics used so far, including the t…
Based on Stein's method, we derive upper bounds for Poisson process approximation in the $L_1$-Wasserstein metric $d_2^{(p)}$, which is based on a slightly adapted $L_p$-Wasserstein metric between point measures. For the case $p=1$, this construction yields the metric $d_2$ introduced in [Barbour and Brown Stochastic Process. Appl. 43 (1992) 9--31], for which Poisson process approximation is well studied in the literature. We demonstrate the usefulness of the extension to general $p$ by showing that $d_2^{(p)}$-bounds control differences between expectations of certain $p$th order average stat…
Point processes are an essential tool when we are interested in where in time or space events occur. The basic starting point for point processes is usually the Poisson process. Over the years, Stein's method has been developed with a great deal of success for Poisson point process approximation. When studying rare events though, typically one only begins modelling after the occurrence of such an event. As a result, a point process that is conditional upon at least one atom, is arguably more appropriate in certain applications. In this paper, we develop Stein's method for conditional Poisson p…
In this paper, a new method based on probability generating functions is used to obtain multiple Stein operators for various random variables closely related to Poisson, binomial and negative binomial distributions. Also, Stein operators for certain compound distributions, where the random summand satisfies Panjer's recurrence relation, are derived. A well-known perturbation approach for Stein's method is used to obtain total variation bounds for the distributions mentioned above. The importance of such approximations is illustrated, for example, by the binomial convoluted with Poisson approxi…
Random events in space and time often exhibit a locally dependent structure. When the events are very rare and dependent structure is not too complicated, various studies in the literature have shown that Poisson and compound Poisson processes can provide adequate approximations. However, the accuracy of approximations does not improve or may even deteriorate when the mean number of events increases. In this paper, we investigate an alternative family of approximating point processes and establish Stein's method for their approximations. We prove two theorems to accommodate respectively the po…
A stochastic ordering approach is applied with Stein's method for approximation by the equilibrium distribution of a birth-death process. The usual stochastic order and the more general s-convex orders are discussed. Attention is focused on Poisson and translated Poisson approximation of a sum of dependent Bernoulli random variables, for example k-runs in i.i.d. Bernoulli trials. Other applications include approximation by polynomial birth--death distributions.
This paper uses the generator approach of Stein's method to analyze the gap between steady-state distributions of Markov chains and diffusion processes. Until now, the standard way to invoke Stein's method for this problem was to use the Poisson equation for the diffusion as a starting point. The main technical difficulty with this approach is obtaining bounds on the derivatives of the solution to the Poisson equation, also known as Stein factor bounds. In this paper we propose starting with the discrete Poisson equation of the Markov chain. An important step in our approach is extending the d…
In this paper we use a Malliavin-Stein type method to investigate Poisson and normal approximations for the measurable functions of infinitely many independent random variables. We combine Stein's method with the difference operators in theory of concentration inequalities to obtain explicit bounds on Wasserstein, Kolmogorov and total variation distances. When restricted to the functions of a finite number of independent random variables, our method provides new bounds in the normal approximation. Meanwhile, our bounds in Poisson approximation are first to obtain explicitly.
Motivated by a theorem of Barbour, we revisit some of the classical limit theorems in probability from the viewpoint of the Stein method. We setup the framework to bound Wasserstein distances between some distributions on infinite dimensional spaces. We show that the convergence rate for the Poisson approximation of the Brownian motion is as expected proportional to $λ^{-1/2}$ where $λ$ is the intensity of the Poisson process. We also exhibit the speed of convergence for the Donsker Theorem and for the linear interpolation of the Brownian motion. By iterating the procedure, we give Edgeworth e…
We provide a general theorem bounding the error in the approximation of a random measure of interest--for example, the empirical population measure of types in a Wright-Fisher model--and a Dirichlet process, which is a measure having Poisson-Dirichlet distributed atoms with i.i.d. labels from a diffuse distribution. The implicit metric of the approximation theorem captures the sizes and locations of the masses, and so also yields bounds on the approximation between the masses of the measure of interest and the Poisson-Dirichlet distribution. We apply the result to bound the error in the approx…
We study an approximation method of stationary characters of a two-dimensional Markov chain via the Stein method. For this purpose, innovative methods are developed to estimate the moments of the Markov chain, as well as the solution to the Poisson equation with a partial differential operator.
We provide a general result for bounding the difference between point probabilities of integer supported distributions and the translated Poisson distribution, a convenient alternative to the discretized normal. We illustrate our theorem in the context of the Hoeffding combinatorial central limit theorem with integer valued summands, of the number of isolated vertices in an Erdős-Rényi random graph, and of the Curie-Weiss model of magnetism, where we provide optimal or near optimal rates of convergence in the local limit metric. In the Hoeffding example, even the discrete normal approximation …
In this paper we extend Stein's method to the distribution of the product of $n$ independent mean zero normal random variables. A Stein equation is obtained for this class of distributions, which reduces to the classical normal Stein equation in the case $n=1$. This Stein equation motivates a generalisation of the zero bias transformation. We establish properties of this new transformation, and illustrate how they may be used together with the Stein equation to assess distributional distances for statistics that are asymptotically distributed as the product of independent central normal random…
In this paper we establish a framework for normal approximation for white noise functionals by Stein's method and Hida calculus. Our work is inspired by that of Nourdin and Peccati (Probab. Theory Relat. Fields 145, 75-118, 2009), who combined Stein's method and Malliavin calculus for normal approximation for functionals of Gaussian processes.
In this paper, we extend Stein's method to products of independent beta, gamma, generalised gamma and mean zero normal random variables. In particular, we obtain Stein operators for mixed products of these distributions, which include the classical beta, gamma and normal Stein operators as special cases. These operators lead us to closed-form expressions involving the Meijer $G$-function for the probability density function and characteristic function of the mixed product of independent beta, gamma and central normal random variables.
Stein's method provides a way of bounding the distance of a probability distribution to a target distribution $μ$. Here we develop Stein's method for the class of discrete Gibbs measures with a density $e^V$, where $V$ is the energy function. Using size bias couplings, we treat an example of Gibbs convergence for strongly correlated random variables due to Chayes and Klein [Helv. Phys. Acta 67 (1994) 30--42]. We obtain estimates of the approximation to a grand-canonical Gibbs ensemble. As side results, we slightly improve on the Barbour, Holst and Janson [Poisson Approximation (1992)] bounds f…
We extend the ideas of (Barbour 1990) and use Stein's method to obtain a bound on the distance between a scaled time-changed random walk and a time-changed Brownian Motion. We then apply this result to bound the distance between a time-changed compensated scaled Poisson process and a time-changed Brownian Motion. This allows us to bound the distance between a process whose dynamics resemble those of the Moran model with mutation and a process whose dynamics resemble those of the Wright-Fisher diffusion with mutation upon noting that the former may be expressed as a difference of two time-chang…
Using the Chen-Stein method, we show that the spatial distribution of large finite clusters in the supercritical FK model approximates a Poisson process when the ratio weak mixing property holds.
This paper is a sequel of \cite{CD:2012}. We show how to establish a functional Edgeworth expansion of any order thanks to the Stein method. We apply the procedure to the Brownian approximation of compensated Poisson process and to the linear interpolation of the Brownian motion. It is then apparent that these two expansions are of rather different form.
In this article, we provide a Stein type characterization for $G$-normal distributions: Let $\mathcal{N}[φ]=\max_{μ\inΘ}μ[φ],\ φ\in C_{b,Lip}(\mathbb{R}),$ be a sublinear expectation. $\mathcal{N}$ is $G$-normal if and only if for any $φ\in C_b^2(\mathbb{R})$, we have \[\int_\mathbb{R}[\frac{x}{2}φ'(x)-G(φ"(x))]μ^φ(dx)=0,\] where $μ^φ$ is a realization of $φ$ associated with $\mathcal{N}$, i.e., $μ^φ\in Θ$ and $μ^φ[φ]=\mathcal{N}[φ]$.
We use Stein's method to provide non asymptotic $L^1$ bounds to the normal for functionals of associated point processes. As for supporting tools, we use the connection between association and $α$-mixing properties that was recently uncovered by [PDL17]. We apply our main results to determinantal point processes which are known to be negatively associated. A potential application to point processes in the Laguerre-Gaussian family is also presented.
In this paper we establish a multivariate exchangeable pairs approach within the framework of Stein's method to assess distributional distances to potentially singular multivariate normal distributions. By extending the statistics into a higher-dimensional space, we also propose an embedding method which allows for a normal approximation even when the corresponding statistics of interest do not lend themselves easily to Stein's exchangeable pairs approach. To illustrate the method, we provide the examples of runs on the line as well as double-indexed permutation statistics.
We develop Stein's method for the half-normal distribution and apply it to derive rates of convergence in distributional limit theorems for three statistics of the simple symmetric random walk: the maximum value, the number of returns to the origin and the number of sign changes up to a given time $n$. We obtain explicit error bounds with the optimal rate $n^{-1/2}$ for both the Kolmogorov and the Wasserstein metric. In order to apply Stein's method, we compare the characterizing operator of the limiting half-normal distribution with suitable characterizations of the discrete approximating dis…
We combine Stein's method with Malliavin calculus in order to obtain explicit bounds in the multidimensional normal approximation (in the Wasserstein distance) of functionals of Gaussian fields. Our results generalize and refine the main findings by Peccati and Tudor (2005), Nualart and Ortiz-Latorre (2007), Peccati (2007) and Nourdin and Peccati (2007b, 2008); in particular, they apply to approximations by means of Gaussian vectors with an arbitrary, positive definite covariance matrix. Among several examples, we provide an application to a functional version of the Breuer-Major CLT for field…
In this paper, we provide upper bounds on the d2 distance between a large class of functionals of a multivariate compound Hawkes process and a given Gaussian vector. This is proven using Malliavin's calculus defined on an underlying Poisson embedding. The upper bound is then used to infer the speed of convergence of Central Limit Theorems for the multivariate compound Hawkes process with exponential kernels as the observation time T goes to infinity.
The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized sums of $k$-dimensional independent random vectors $W=\sum_{i=1}^n X_i$ with an error bound of order $k^{1/2}γ$ where $γ=\sum_{i=1}^n E|X_i|^3$. For sums of locally dependent (unbounded) random vectors, we obtain a fourth moment bound which is typically of order $O_k(1/\sqrt{n})$, as well as a third moment bound which is typically of order $O_k(\log n/\sqrt…
As an application of Stein's method for Poisson approximation, we prove rates of convergence for the tail probabilities of two scan statistics that have been suggested for detecting local signals in sequences of independent random variables subject to possible change-points. Our formulation deals simultaneously with ordinary and with large deviations.
New bounds for the $k$-th order derivatives of the solutions of the normal and multivariate normal Stein equations are obtained. Our general order bounds involve fewer derivatives of the test function than those in the existing literature. We apply these bounds and local approach couplings to obtain an order $n^{-(p-1)/2}$ bound, for smooth test functions, for the distance between the distribution of a standardised sum of independent and identically distributed random variables and the standard normal distribution when the first $p$ moments of these distributions agree. We also obtain a bound …
We show by a surprisingly simple argument that the exchangeability condition, which is key to the exchangeable pair approach in Stein's method for distributional approximation, can be omitted in many standard settings. This is achieved by replacing the usual antisymmetric function by a simpler one, for which only equality in distribution is required. In the case of normal approximation we also slightly improve the constants appearing in previous results. For Poisson approximation, a different antisymmetric function is used, and additional error terms are needed if the bound is to be extended b…
In this paper, following Nourdin-Peccati's methodology, we combine the Malliavin calculus and Stein's method to provide general bounds on the Wasserstein distance between functionals of a compound Hawkes process and a given Gaussian density. To achieve this, we rely on the Poisson embedding representation of an Hawkes process to provide a Malliavin calculus for the Hawkes processes, and more generally for compound Hawkes processes. As an application, we close a gap in the literature by providing the first Berry-Esséen bounds associated to Central Limit Theorems for the compound Hawkes process.
In this article, we obtain, for the total variance distance, the error bounds between Poisson and convolution of power series distributions via Stein's method. This provides a unified approach to many known discrete distributions. Several Poisson limit theorems follow as corollaries from our bounds. As applications, we compare the Poisson approximation results with the negative binomial approximation results, for the sums of Bernoulli, geometric, and logarithmic series random variables.
Stein's method is a method of probability approximation which hinges on the solution of a functional equation. For normal approximation the functional equation is a first order differential equation. Malliavin calculus is an infinite-dimensional differential calculus whose operators act on functionals of general Gaussian processes. Nourdin and Peccati (2009) established a fundamental connection between Stein's method for normal approximation and Malliavin calculus through integration by parts. This connection is exploited to obtain error bounds in total variation in central limit theorems for …
We provide a general result for finding Stein operators for the product of two independent random variables whose Stein operators satisfy a certain assumption, extending a recent result of Gaunt, Mijoule and Swan \cite{gms18}. This framework applies to non-centered normal and non-centered gamma random variables, as well as a general sub-family of the variance-gamma distributions. Curiously, there is an increase in complexity in the Stein operators for products of independent normals as one moves, for example, from centered to non-centered normals. As applications, we give a simple derivation o…
We study multi-dimensional normal approximations on the Poisson space by means of Malliavin calculus, Stein's method and probabilistic interpolations. Our results yield new multi-dimensional central limit theorems for multiple integrals with respect to Poisson measures -- thus significantly extending previous works by Peccati, Solé, Taqqu and Utzet. Several explicit examples (including in particular vectors of linear and non-linear functionals of Ornstein-Uhlenbeck Lévy processes) are discussed in detail.
We prove, using the Brascamp-Lieb inequality, that the Gaussian measure is the only strong log-concave measure having a strong log-concavity parameter equal to its covariance matrix. We also give a similar characterization of the Poisson measure in the discrete case, using "Chebyshev's other inequality". We briefly discuss how these results relate to Stein and Stein-Chen methods for Gaussian and Poisson approximation, and to the Bakry-Emery calculus.
We prove a general theorem to bound the total variation distance between the distribution of an integer valued random variable of interest and an appropriate discretized normal distribution. We apply the theorem to 2-runs in a sequence of i.i.d. Bernoulli random variables, the number of vertices with a given degree in the Erdös-Rényi random graph, and the uniform multinomial occupancy model.
We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $ν$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $ν$ for any $t > 0$. If the stochastic process $(X_t)_{t \geq 0}$ satisfies an additional exchangeability assumption, we show it can also be used to obtain bounds on Wasserstein distances of any order $p \geq 1$. Using our results, we provide optimal convergence rates for the multi-dimensional Central Limit Theorem in terms of Wasserstein distances of any order $p \geq 2$ under simple moment assumptions.
This paper is a short exposition of Stein's method of normal approximation from my personal perspective. It focuses mainly on the characterization of the normal distribution and the construction of Stein identities. Through examples, it provides glimpses into the many approaches to constructing Stein identities and the diverse applications of Stein's method to mathematical problems. It also includes anecdotes of historical interest, including how Stein discovered his method and how I found an unpublished proof of his of the Berry-Esseen theorem.