In this article, we present the theoretical basis for an approach to Stein's method for probability distributions on Riemannian manifolds. Using a semigroup representation for the solution to the Stein equation, we use tools from stochastic calculus to estimate the derivatives of the solution, yielding a bound on the Wasserstein distance. We first assume the Bakry-Emery-Ricci tensor is bounded below by a positive constant, after which we deal separately with the case of uniform approximation on a compact manifold. Applications of these results are currently under development and will appear in a subsequent article.
Stein's method has been widely used to achieve distributional approximations for probability distributions defined in Euclidean spaces. Recently, techniques to extend Stein's method to manifold-valued random variables with distributions defined on the respective manifolds have been reported. However, several of these methods impose strong regularity conditions on the distributions as well as the manifolds and/or consider very special cases. In this paper, we present a novel framework for Stein's method on Riemannian manifolds using the Friedrichs extension technique applied to self-adjoint unb…
In this paper we establish a framework for normal approximation for white noise functionals by Stein's method and Hida calculus. Our work is inspired by that of Nourdin and Peccati (Probab. Theory Relat. Fields 145, 75-118, 2009), who combined Stein's method and Malliavin calculus for normal approximation for functionals of Gaussian processes.
We study an approximation method of stationary characters of a two-dimensional Markov chain via the Stein method. For this purpose, innovative methods are developed to estimate the moments of the Markov chain, as well as the solution to the Poisson equation with a partial differential operator.
In this paper, a new method based on probability generating functions is used to obtain multiple Stein operators for various random variables closely related to Poisson, binomial and negative binomial distributions. Also, Stein operators for certain compound distributions, where the random summand satisfies Panjer's recurrence relation, are derived. A well-known perturbation approach for Stein's method is used to obtain total variation bounds for the distributions mentioned above. The importance of such approximations is illustrated, for example, by the binomial convoluted with Poisson approxi…
We establish various bounds on the solutions to a Stein equation for Poisson approximation in Wasserstein distance with non-linear transportation costs. The proofs are a refinement of those in [Barbour and Xia (2006)] using the results in [Liu and Ma (2009)]. As a corollary, we obtain an estimate of Poisson approximation error measured in L^2-Wasserstein distance.
Stein's method has been widely used for probability approximations. However, in the multi-dimensional setting, most of the results are for multivariate normal approximation or for test functions with bounded second- or higher-order derivatives. For a class of multivariate limiting distributions, we use Bismut's formula in Malliavin calculus to control the derivatives of the Stein equation solutions by the first derivative of the test function. Combined with Stein's exchangeable pair approach, we obtain a general theorem for multivariate approximations with near optimal error bounds on the Wass…
By a delicate analysis for the Stein's equation associated to the $α$-stable law approximation with $α\in (0,2)$, we prove a quantitative stable central limit theorem in Wasserstein type distance, which generalizes the results in the series of work \cite{Xu19, CNX19+,CNXYZ19+} from the univariate case to the multiple variate case. From an explicit computation for Pareto's distribution, we see that the rate of our approximation is sharp. The analysis of the Stein's equation is new and has independent interest.
This paper concerns the development of Stein's method for chi-square approximation and its application to problems in statistics. New bounds for the derivatives of the solution of the gamma Stein equation are obtained. These bounds involve both the shape parameter and the order of the derivative. Subsequently Stein's method for chi-square approximation is applied to bound the distributional distance between Pearson's statistic and its limiting chi-square distribution, measured using smooth test functions. In combination with the use of symmetry arguments, Stein' method yields explicit bounds o…
We obtain Stein approximation bounds for stochastic integrals with respect to a Poisson random measure over ${\Bbb R}^d$, $d\geq 2$. This approach relies on third cumulant Edgeworth-type expansions based on derivation operators defined by the Malliavin calculus for Poisson random measures. The use of third cumulants can exhibit faster convergence rates than the standard Berry-Esseen rate for some sequences of Poisson stochastic integrals.
We combine Stein's method with a version of Malliavin calculus on the Poisson space. As a result, we obtain explicit Berry-Esséen bounds in Central Limit Theorems (CLTs) involving multiple Wiener-Itô integrals with respect to a general Poisson measure. We provide several applications to CLTs related to Ornstein-Uhlenbeck Lévy processes.
We obtain new bounds for the solution of the variance-gamma (VG) Stein equation that are of the correct form for approximations in terms of the Wasserstein and Kolmorogorov metrics. These bounds hold for all parameters values of the four parameter VG class. As an application we obtain explicit Wasserstein and Kolmogorov distance error bounds in a six moment theorem for VG approximation of double Wiener-Itô integrals.
In (Barbour, 1990) foundations for diffusion approximation via Stein's method are laid. This paper has been cited more than 130 times and is a cornerstone in the area of Stein's method. A semigroup argument is used therein to solve a Stein equation for Gaussian diffusion approximation. We prove that, contrary to the claim in (Barbour, 1990), the semigroup considered therein is not strongly continuous on the Banach space of continuous, real-valued functions on D[0,1] growing slower than a cubic, equipped with an appropriate norm. We also provide a proof of the exact formulation of the solution …
We use Stein's method to obtain explicit bounds on the rate of convergence for the Laplace approximation of two different sums of independent random variables; one being a random sum of mean zero random variables and the other being a deterministic sum of mean zero random variables in which the normalisation sequence is random. We make technical advances to the framework of Pike and Ren \cite{pike} for Stein's method for Laplace approximation, which allows us to give bounds in the Kolmogorov and Wasserstein metrics. Under the additional assumption of vanishing third moments, we obtain faster c…
We develop Stein's method for $α$-stable approximation with $α\in(0,1]$, continuing the recent line of research by Xu \cite{lihu} and Chen, Nourdin and Xu \cite{C-N-X} in the case $α\in(1,2).$ The main results include an intrinsic upper bound for the error of the approximation in a variant of Wasserstein distance that involves the characterizing differential operators for stable distributions, and an application to the generalized central limit theorem. Due to the lack of first moment for the approximating sequence in the latter result, we appeal to an additional truncation procedure and inves…
One major obstacle in applications of Stein's method for compound Poisson approximation is the availability of so-called magic factors (bounds on the solution of the Stein equation) with favourable dependence on the parameters of the approximating compound Poisson random variable. In general, the best such bounds have an exponential dependence on these parameters, though in certain situations better bounds are available. In this paper, we extend the region for which well-behaved magic factors are available for compound Poisson approximation in the Kolmogorov metric, allowing useful compound Po…
We provide a general steady-state diffusion approximation result which bounds the Wasserstein distance between the reversible measure $μ$ of a diffusion process and the measure $ν$ of an approximating Markov chain. Our result is obtained thanks to a generalization of a new approach to Stein's method which may be of independent interest. As an application, we study the invariant measure of a random walk on a $k$-nearest neighbors graph, providing a quantitative answer to a problem of interest to the machine learning community.
We derive Stein approximation bounds for functionals of uniform random variables, using chaos expansions and the Clark-Ocone representation formula combined with derivation and finite difference operators. This approach covers sums and functionals of both continuous and discrete independent random variables. For random variables admitting a continuous density, it recovers classical distance bounds based on absolute third moments, with better and explicit constants. We also apply this method to multiple stochastic integrals that can be used to represent U-statistics, and include linear and quad…
The main purpose of the paper is to investigate the possibility of applying Chen-Stein approach to estimate the $χ^2$ distance between Poisson distribution and a sum of independent indicators. Earlier results concerning $χ^2$ distance between above mentioned distributions either used analytical approach heavily based on the analysis of the generating functions or on rather lengthy and complicated elementary calculations. Applying Chen-Stein approach we succeed in providing a very quick proof of upper bounds for $χ^2$ distance that are of comparable strength to the earlier estimates obtained by…
We combine Stein's method with Malliavin calculus in order to obtain explicit bounds in the multidimensional normal approximation (in the Wasserstein distance) of functionals of Gaussian fields. Our results generalize and refine the main findings by Peccati and Tudor (2005), Nualart and Ortiz-Latorre (2007), Peccati (2007) and Nourdin and Peccati (2007b, 2008); in particular, they apply to approximations by means of Gaussian vectors with an arbitrary, positive definite covariance matrix. Among several examples, we provide an application to a functional version of the Breuer-Major CLT for field…
In this paper, we apply the Stein's method in the context of point processes, namely when the target measure is the distribution of a finite Poisson point process. We show that the so-called Kantorovich-Rubinstein distance between such a measure and another finite point process is bounded by the $L^1$-distance between their respective Papangelou intensities. Then, we deduce some convergence rates for sequences of point processes approaching a Poisson or a Cox point process.
This exposition explains the basic ideas of Stein's method for Poisson random variable approximation and Poisson process approximation from the point of view of the immigration-death process and Palm theory. The latter approach also enables us to define local dependence of point processes [Chen and Xia (2004)] and use it to study Poisson process approximation for locally dependent point processes and for dependent superposition of point processes.
We use Stein's method to provide non asymptotic $L^1$ bounds to the normal for functionals of associated point processes. As for supporting tools, we use the connection between association and $α$-mixing properties that was recently uncovered by [PDL17]. We apply our main results to determinantal point processes which are known to be negatively associated. A potential application to point processes in the Laguerre-Gaussian family is also presented.
The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized sums of $k$-dimensional independent random vectors $W=\sum_{i=1}^n X_i$ with an error bound of order $k^{1/2}γ$ where $γ=\sum_{i=1}^n E|X_i|^3$. For sums of locally dependent (unbounded) random vectors, we obtain a fourth moment bound which is typically of order $O_k(1/\sqrt{n})$, as well as a third moment bound which is typically of order $O_k(\log n/\sqrt…
Random events in space and time often exhibit a locally dependent structure. When the events are very rare and dependent structure is not too complicated, various studies in the literature have shown that Poisson and compound Poisson processes can provide adequate approximations. However, the accuracy of approximations does not improve or may even deteriorate when the mean number of events increases. In this paper, we investigate an alternative family of approximating point processes and establish Stein's method for their approximations. We prove two theorems to accommodate respectively the po…
We obtain upper bounds for the total variation distance between the distributions of two Gibbs point processes in a very general setting. Applications are provided to various well-known processes and settings from spatial statistics and statistical physics, including the comparison of two Lennard-Jones processes, hard core approximation of an area interaction process and the approximation of lattice processes by a continuous Gibbs process. Our proof of the main results is based on Stein's method. We construct an explicit coupling between two spatial birth-death processes to obtain Stein factor…
In this paper we establish a multivariate exchangeable pairs approach within the framework of Stein's method to assess distributional distances to potentially singular multivariate normal distributions. By extending the statistics into a higher-dimensional space, we also propose an embedding method which allows for a normal approximation even when the corresponding statistics of interest do not lend themselves easily to Stein's exchangeable pairs approach. To illustrate the method, we provide the examples of runs on the line as well as double-indexed permutation statistics.
Motivated by a theorem of Barbour, we revisit some of the classical limit theorems in probability from the viewpoint of the Stein method. We setup the framework to bound Wasserstein distances between some distributions on infinite dimensional spaces. We show that the convergence rate for the Poisson approximation of the Brownian motion is as expected proportional to $λ^{-1/2}$ where $λ$ is the intensity of the Poisson process. We also exhibit the speed of convergence for the Donsker Theorem and for the linear interpolation of the Brownian motion. By iterating the procedure, we give Edgeworth e…
We combine the method of exchangeable pairs with Stein's method for functional approximation. As a result, we give a general linearity condition under which an abstract Gaussian approximation theorem for stochastic processes holds. We apply this approach to estimate the distance of a sum of random variables, chosen from an array according to a random permutation, from a Gaussian mixture process. This result lets us prove a functional combinatorial central limit theorem. We also consider a graph-valued process and bound the speed of convergence of the distribution of its rescaled edge counts to…
A stochastic ordering approach is applied with Stein's method for approximation by the equilibrium distribution of a birth-death process. The usual stochastic order and the more general s-convex orders are discussed. Attention is focused on Poisson and translated Poisson approximation of a sum of dependent Bernoulli random variables, for example k-runs in i.i.d. Bernoulli trials. Other applications include approximation by polynomial birth--death distributions.
Stein's method is a method of probability approximation which hinges on the solution of a functional equation. For normal approximation the functional equation is a first order differential equation. Malliavin calculus is an infinite-dimensional differential calculus whose operators act on functionals of general Gaussian processes. Nourdin and Peccati (2009) established a fundamental connection between Stein's method for normal approximation and Malliavin calculus through integration by parts. This connection is exploited to obtain error bounds in total variation in central limit theorems for …
New bounds on the total variation distance between the law of integer valued functionals of possibly non-symmetric and non-homogeneous infinite Rademacher sequences and the Poisson distribution are established. They are based on a combination of the Chen-Stein method and a discrete version of Malliavin calculus. We give some applications to shifted discrete multiple stochastic integrals.
The paper gives the bounds on the solutions to a Stein equation for the negative binomial distribution that are needed for approximation in terms of the Wasserstein metric. The proofs are probabilistic, and follow the approach introduced in Barbour and Xia (Bernoulli 12 (2006) 943-954). The bounds are used to quantify the accuracy of negative binomial approximation to parasite counts in hosts. Since the infectivity of a population can be expected to be proportional to its total parasite burden, the Wasserstein metric is the appropriate choice.
This paper provides an introduction to the Stein method framework in the context of steady-state diffusion approximations. The framework consists of three components: the Poisson equation and gradient bounds, generator coupling, and moment bounds. Working in the setting of the Erlang-A and Erlang-C models, we prove that both Wasserstein and Kolmogorov distances between the stationary distribution of a normalized customer count process, and that of an appropriately defined diffusion process decrease at a rate of $1/\sqrt{R}$, where $R$ is the offered load. Futhermore, these error bounds are \em…
Variance-Gamma distributions are widely used in financial modelling and contain as special cases the normal, Gamma and Laplace distributions. In this paper we extend Stein's method to this class of distributions. In particular, we obtain a Stein equation and smoothness estimates for its solution. This Stein equation has the attractive property of reducing to the known normal and Gamma Stein equations for certain parameter values. We apply these results and local couplings to bound the distance between sums of the form $\sum_{i,j,k=1}^{m,n,r}X_{ik}Y_{jk}$, where the $X_{ik}$ and $Y_{jk}$ are in…
In this article, we develop Stein characterization for two-sided tempered stable distribution. Stein characterizations for normal, gamma, Laplace, and variance-gamma distributions already known in the literature follow easily. One can also derive Stein characterizations for more difficult distributions such as the distribution of product of two normal random variables, a difference between two gamma random variables. Using the semigroup approach, we obtain estimates of the solution to Stein equation. Finally, we apply these estimates to obtain error bounds in the Wasserstein-type distance for …
We combine Malliavin calculus with Stein's method to derive bounds for the Variance-Gamma approximation of functionals of isonormal Gaussian processes, in particular of random variables living inside a fixed Wiener chaos induced by such a process. The bounds are presented in terms of Malliavin operators and norms of contractions. We show that a sequence of distributions of random variables in the second Wiener chaos converges to a Variance-Gamma distribution if and only if their moments of order two to six converge to that of a Variance-Gamma distributed random variable (six moment theorem). M…
The framework of Stein's method for Poisson process approximation is presented from the point of view of Palm theory, which is used to construct Stein identities and define local dependence. A general result (Theorem \refimportantproposition) in Poisson process approximation is proved by taking the local approach. It is obtained without reference to any particular metric, thereby allowing wider applicability. A Wasserstein pseudometric is introduced for measuring the accuracy of point process approximation. The pseudometric provides a generalization of many metrics used so far, including the t…
Stein's (1972) method is a very general tool for assessing the quality of approximation of the distribution of a random element by another, often simpler, distribution. In applications of Stein's method, one needs to establish a Stein identity for the approximating distribution, solve the Stein equation and estimate the behaviour of the solutions in terms of the metrics under study. For some Stein equations, solutions with good properties are known; for others, this is not the case. Barbour and Xia (1999) introduced a perturbation method for Poisson approximation, in which Stein identities for…
The variance-gamma (VG) distributions form a four parameter family that includes as special and limiting cases the normal, gamma and Laplace distributions. Some of the numerous applications include financial modelling and approximation on Wiener space. Recently, Stein's method has been extended to the VG distribution. However, technical difficulties have meant that bounds for distributional approximations have only been given for smooth test functions (typically requiring at least two derivatives for the test function). In this paper, which deals with symmetric variance-gamma (SVG) distributio…
We show by a surprisingly simple argument that the exchangeability condition, which is key to the exchangeable pair approach in Stein's method for distributional approximation, can be omitted in many standard settings. This is achieved by replacing the usual antisymmetric function by a simpler one, for which only equality in distribution is required. In the case of normal approximation we also slightly improve the constants appearing in previous results. For Poisson approximation, a different antisymmetric function is used, and additional error terms are needed if the bound is to be extended b…
The paper presents a general introduction to the astonishing method for deriving probability approximations that was invented by Charles Stein around 50 years ago.
We apply the Stein-Chen method to problems from extreme value theory. On the one hand, the Stein-Chen method for Poisson approximation allows us to obtain bounds on the Kolmogorov distance between the law of the maximum of i.i.d. random variables, following certain well known distributions, and an extreme value distribution. On the other hand, we introduce marked point processes of exceedances (MPPE's) whose i.i.d. marks can be either univariate or multivariate. We use the Stein-Chen method for Poisson process approximation to determine bounds on the error of the approximation, in some appropr…
We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $ν$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $ν$ for any $t > 0$. If the stochastic process $(X_t)_{t \geq 0}$ satisfies an additional exchangeability assumption, we show it can also be used to obtain bounds on Wasserstein distances of any order $p \geq 1$. Using our results, we provide optimal convergence rates for the multi-dimensional Central Limit Theorem in terms of Wasserstein distances of any order $p \geq 2$ under simple moment assumptions.
We use Stein's method to obtain a bound on the distance between scaled $p$-dimensional random walks and a $p$-dimensional (correlated) Brownian Motion. We consider dependence schemes including those in which the summands in scaled sums are weakly dependent and their $p$ components are strongly correlated. As an example application, we prove a functional limit theorem for exceedances in an $m$-scans process, together with a bound on the rate of convergence. We also find a bound on the rate of convergence of scaled U-statistics to Brownian Motion, representing an example of a sum of strongly dep…
In this article, we provide an extension of the Chen-Stein inequality for Poisson approximation in the total variation distance for sums of independent Bernoulli random variables in two ways. We prove that we can improve the rate of convergence (hence the quality of the approximation) by using explicitly constructed signed or positive probability measures, and that we can extend the setting to possibly dependent random variables. The framework which allows this is that of mod-Poisson convergence, and more precisely those mod-Poisson convergent sequences whose residue functions can be expressed…
Edgeworth expansion provides higher-order corrections to the normal approximation for a probability distribution. The classical proof of Edgeworth expansion is via characteristic functions. As a powerful method for distributional approximations, Stein's method has also been used to prove Edgeworth expansion results. However, these results assume that either the test function is smooth (which excludes indicator functions of the half line) or that the random variables are continuous (which excludes random variables having only a continuous component). Thus, how to recover the classical Edgeworth…
We extend the ideas of (Barbour 1990) and use Stein's method to obtain a bound on the distance between a scaled time-changed random walk and a time-changed Brownian Motion. We then apply this result to bound the distance between a time-changed compensated scaled Poisson process and a time-changed Brownian Motion. This allows us to bound the distance between a process whose dynamics resemble those of the Moran model with mutation and a process whose dynamics resemble those of the Wright-Fisher diffusion with mutation upon noting that the former may be expressed as a difference of two time-chang…
We consider $M/Ph/n+M$ queueing systems in steady state. We prove that the Wasserstein distance between the stationary distribution of the normalized system size process and that of a piecewise Ornstein-Uhlenbeck (OU) process is bounded by $C/\sqrtλ$, where the constant $C$ is independent of the arrival rate $λ$ and the number of servers $n$ as long as they are in the Halfin-Whitt parameter regime. For each integer $m>0$, we also establish a similar bound for the difference of the $m$th steady-state moments. For the proofs, we develop a modular framework that is based on Stein's method. The fr…
Based on Stein's method, we derive upper bounds for Poisson process approximation in the $L_1$-Wasserstein metric $d_2^{(p)}$, which is based on a slightly adapted $L_p$-Wasserstein metric between point measures. For the case $p=1$, this construction yields the metric $d_2$ introduced in [Barbour and Brown Stochastic Process. Appl. 43 (1992) 9--31], for which Poisson process approximation is well studied in the literature. We demonstrate the usefulness of the extension to general $p$ by showing that $d_2^{(p)}$-bounds control differences between expectations of certain $p$th order average stat…
We prove a general theorem to bound the total variation distance between the distribution of an integer valued random variable of interest and an appropriate discretized normal distribution. We apply the theorem to 2-runs in a sequence of i.i.d. Bernoulli random variables, the number of vertices with a given degree in the Erdös-Rényi random graph, and the uniform multinomial occupancy model.
This paper is a short exposition of Stein's method of normal approximation from my personal perspective. It focuses mainly on the characterization of the normal distribution and the construction of Stein identities. Through examples, it provides glimpses into the many approaches to constructing Stein identities and the diverse applications of Stein's method to mathematical problems. It also includes anecdotes of historical interest, including how Stein discovered his method and how I found an unpublished proof of his of the Berry-Esseen theorem.
Diffusion approximations have been a popular tool for performance analysis in queueing theory, with the main reason being tractability and computational efficiency. This dissertation is concerned with establishing theoretical guarantees on the performance of steady-state diffusion approximations of queueing systems. We develop a modular framework based on Stein's method that allows us to establish error bounds, or convergence rates, for the approximations. We apply this framework three queueing systems: the Erlang-C, Erlang-A, and $M/Ph/n+M$ systems. The former two systems are simpler and allo…
