The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized sums of $k$-dimensional independent random vectors $W=\sum_{i=1}^n X_i$ with an error bound of order $k^{1/2}γ$ where $γ=\sum_{i=1}^n E|X_i|^3$. For sums of locally dependent (unbounded) random vectors, we obtain a fourth moment bound which is typically of order $O_k(1/\sqrt{n})$, as well as a third moment bound which is typically of order $O_k(\log n/\sqrt{n})$.
In this paper we present a general framework for Stein's method for multivariate continuous distributions. The approach gives a collection of Stein characterisations, among which we highlight score-Stein operators and kernel Stein operators. Applications include copulas and distance between posterior distributions. We give a general construction for Stein kernels for elliptical distributions and discuss Stein kernels in generality, highlighting connections with Fisher information and mass transport. Finally, a goodness-of-fit test based on Stein discrepancies is given.
Stein's method has been widely used for probability approximations. However, in the multi-dimensional setting, most of the results are for multivariate normal approximation or for test functions with bounded second- or higher-order derivatives. For a class of multivariate limiting distributions, we use Bismut's formula in Malliavin calculus to control the derivatives of the Stein equation solutions by the first derivative of the test function. Combined with Stein's exchangeable pair approach, we obtain a general theorem for multivariate approximations with near optimal error bounds on the Wass…
We establish uniform bounds on the low-order derivatives of Stein equation solutions for a broad class of multivariate, strongly log-concave target distributions. These "Stein factor" bounds deliver control over Wasserstein and related smooth function distances and are well-suited to analyzing the computable Stein discrepancy measures of Gorham and Mackey. Our arguments of proof are probabilistic and feature the synchronous coupling of multiple overdamped Langevin diffusions.
In this paper, we provide upper bounds on the d2 distance between a large class of functionals of a multivariate compound Hawkes process and a given Gaussian vector. This is proven using Malliavin's calculus defined on an underlying Poisson embedding. The upper bound is then used to infer the speed of convergence of Central Limit Theorems for the multivariate compound Hawkes process with exponential kernels as the observation time T goes to infinity.
By a delicate analysis for the Stein's equation associated to the $α$-stable law approximation with $α\in (0,2)$, we prove a quantitative stable central limit theorem in Wasserstein type distance, which generalizes the results in the series of work \cite{Xu19, CNX19+,CNXYZ19+} from the univariate case to the multiple variate case. From an explicit computation for Pareto's distribution, we see that the rate of our approximation is sharp. The analysis of the Stein's equation is new and has independent interest.
In this paper we establish a multivariate exchangeable pairs approach within the framework of Stein's method to assess distributional distances to potentially singular multivariate normal distributions. By extending the statistics into a higher-dimensional space, we also propose an embedding method which allows for a normal approximation even when the corresponding statistics of interest do not lend themselves easily to Stein's exchangeable pairs approach. To illustrate the method, we provide the examples of runs on the line as well as double-indexed permutation statistics.
We develop a multidimensional Stein methodology for non-degenerate self-decomposable random vectors in $\mathbb{R}^d$ having finite first moment. Building on previous univariate findings, we solve an integro-partial differential Stein equation by a mixture of semigroup and Fourier analytic methods. Then, under a second moment assumption, we introduce a notion of Stein kernel and an associated Stein discrepancy specifically designed for infinitely divisible distributions. Combining these new tools, we obtain quantitative bounds on smooth-Wasserstein distances between a probability measure in $\…
We combine Stein's method with Malliavin calculus in order to obtain explicit bounds in the multidimensional normal approximation (in the Wasserstein distance) of functionals of Gaussian fields. Our results generalize and refine the main findings by Peccati and Tudor (2005), Nualart and Ortiz-Latorre (2007), Peccati (2007) and Nourdin and Peccati (2007b, 2008); in particular, they apply to approximations by means of Gaussian vectors with an arbitrary, positive definite covariance matrix. Among several examples, we provide an application to a functional version of the Breuer-Major CLT for field…
We apply the Stein-Chen method to problems from extreme value theory. On the one hand, the Stein-Chen method for Poisson approximation allows us to obtain bounds on the Kolmogorov distance between the law of the maximum of i.i.d. random variables, following certain well known distributions, and an extreme value distribution. On the other hand, we introduce marked point processes of exceedances (MPPE's) whose i.i.d. marks can be either univariate or multivariate. We use the Stein-Chen method for Poisson process approximation to determine bounds on the error of the approximation, in some appropr…
We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $ν$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $ν$ for any $t > 0$. If the stochastic process $(X_t)_{t \geq 0}$ satisfies an additional exchangeability assumption, we show it can also be used to obtain bounds on Wasserstein distances of any order $p \geq 1$. Using our results, we provide optimal convergence rates for the multi-dimensional Central Limit Theorem in terms of Wasserstein distances of any order $p \geq 2$ under simple moment assumptions.
We use Stein's method to obtain a bound on the distance between scaled $p$-dimensional random walks and a $p$-dimensional (correlated) Brownian Motion. We consider dependence schemes including those in which the summands in scaled sums are weakly dependent and their $p$ components are strongly correlated. As an example application, we prove a functional limit theorem for exceedances in an $m$-scans process, together with a bound on the rate of convergence. We also find a bound on the rate of convergence of scaled U-statistics to Brownian Motion, representing an example of a sum of strongly dep…
In a recent paper, Gaunt 2020 extended Stein's method to limit distributions that can be represented as a function $g:\mathbb{R}^d\rightarrow\mathbb{R}$ of a centered multivariate normal random vector $Σ^{1/2}\mathbf{Z}$ with $\mathbf{Z}$ a standard $d$-dimensional multivariate normal random vector and $Σ$ a non-negative definite covariance matrix. In this paper, we obtain improved bounds, in the sense of weaker moment conditions, smaller constants and simpler forms, for the case that $g$ has derivatives with polynomial growth. We obtain new non-uniform bounds for the derivatives of the soluti…
In this paper we develop a framework for multivariate functional approximation by a suitable Gaussian process via an exchangeable pairs coupling that satisfies a suitable approximate linear regression property, thereby building on work by Barbour (1990) and Kasprzak (2020). We demonstrate the applicability of our results by applying it to joint subgraph counts in an Erdős-Renyi random graph model on the one hand and to vectors of weighted, degenerate $U$-processes on the other hand. As a concrete instance of the latter class of examples, we provide a bound for the functional approximation of a…
Stein's method is used to obtain two theorems on multivariate normal approximation. Our main theorem, Theorem 1.2, provides a bound on the distance to normality for any nonnegative random vector. Theorem 1.2 requires multivariate size bias coupling, which we discuss in studying the approximation of distributions of sums of dependent random vectors. In the univariate case, we briefly illustrate this approach for certain sums of nonlinear functions of multivariate normal variables. As a second illustration, we show that the multivariate distribution counting the number of vertices with given deg…
Let $f$ be a martingale with values in a uniformly $p$-smooth Banach space and $w$ any positive weight. We show that $\mathbb{E} (f^* \cdot w) \lesssim \mathbb{E}(S_p f \cdot w^*)$, where $\cdot^*$ is the martingale maximal operator and $S_p$ is the $\ell^p$ sum of martingale increments.
We prove a multivariate version of Hoeffding's inequality about the distribution of homogeneous polynomials of Rademacher functions. The proof is based on such an estimate about the moments of homogeneous polynomials of Rademacher functions which can be considered as an improvement of Borell's inequality in a most important special case.
We introduce a free version of the Stein kernel, relative to a semicircular law. We use it to obtain a free counterpart of the HSI inequality of Ledoux, Peccatti and Nourdin, which is an improvement of the free logarithmic Sobolev inequality of Biane and Speicher, as well as a rate of convergence in the (multivariate) entropic free Central Limit Theorem. We also compute the free Stein kernels for several relevant families of self-adjoint operators.
The purpose of this paper is to synthesize the approaches taken by Chatterjee-Meckes and Reinert-Röllin in adapting Stein's method of exchangeable pairs for multivariate normal approximation. The more general linear regression condition of Reinert-Röllin allows for wider applicability of the method, while the method of bounding the solution of the Stein equation due to Chatterjee-Meckes allows for improved convergence rates. Two abstract normal approximation theorems are proved, one for use when the underlying symmetries of the random variables are discrete, and one for use in contexts in whic…
We provide explicit lower bounds for the deficit in the Gaussian logarithmic Sobolev inequality in terms of differential operators that are naturally associated with the so-called Stein characterization of the Gaussian distribution. The techniques are based on a crucial use of the representation of the relative Fisher information, along the Ornstein-Uhlenbeck semigroup, in terms of the Minimal Mean-Square Error from information theory.
Since the introduction of Stein's method in the early 1970s, much research has been done in extending and strengthening it; however, there does not exist a version of Stein's original method of exchangeable pairs for multivariate normal approximation. The aim of this article is to fill this void. We present three abstract normal approximation theorems using exchangeable pairs in multivariate contexts, one for situations in which the underlying symmetries are discrete, and real and complex versions of a theorem for situations involving continuous symmetry groups. Our main applications are proof…
Let $M_n$ be a random element of the unitary, special orthogonal, or unitary symplectic groups, distributed according to Haar measure. By a classical result of Diaconis and Shahshahani, for large matrix size $n$, the vector $ (\on{Tr}(M_n), \on{Tr}(M_n^2),..., \on{Tr}(M_n^d))$ tends to a vector of independent (real or complex) Gaussian random variables. Recently, Jason Fulman has demonstrated that for a single power $j$ (which may grow with $n$), a speed of convergence result may be obtained via Stein's method of exchangeable pairs. In this note, we extend Fulman's result to the multivariate c…
We use a multivariate version of Stein's method to establish a quantitative Lindeberg CLT for the Fourier transforms of random $N$-vectors. We achieve this by deducing a specific integral representation for the Hessian matrix of a solution to the Stein equation with test function $e_t(x) = \exp(- i \sum_{k=1}^N t_k x_k)$, where $t,x \in \mathbb{R}^N$.
This work explores and develops elements of Stein's method of approximation, in the infinitely divisible setting, and its connections to functional analysis. It is mainly concerned with multivariate self-decomposable laws without finite first moment and, in particular, with $α$-stable ones, $α\in (0,1]$. At first, several characterizations of these laws via covariance identities are presented. In turn, these characterizations lead to integro-differential equations which are solved with the help of both semigroup and Fourier methodologies. Then, Poincaré-type inequalities for self-decomposable …
In this paper, we give an upper bound for a probabilistic distance between a Gaussian vector and a vector of U-statistics of Poisson point processes by applying Malliavin-Stein inequality on the Poisson space.
In this paper, we present a minimal formalism for Stein operators which leads to different probabilistic representations of solutions to Stein equations. These in turn provide a wide family of Stein-Covariance identities which we put to use for revisiting the very classical topic of bounding the variance of functionals of random variables. Applying the Cauchy-Schwarz inequality yields first order upper and lower Klaassen-type variance bounds. A probabilistic representation of Lagrange's identity (i.e. Cauchy-Schwarz with remainder) leads to Papathanasiou-type variance expansions of arbitrary o…
By the continuous mapping theorem, if a sequence of $d$-dimensional random vectors $(\mathbf{W}_n)_{n\geq1}$ converges in distribution to a multivariate normal random variable $Σ^{1/2}\mathbf{Z}$, then the sequence of random variables $(g(\mathbf{W}_n))_{n\geq1}$ converges in distribution to $g(Σ^{1/2}\mathbf{Z})$ if $g:\mathbb{R}^d\rightarrow\mathbb{R}$ is continuous. In this paper, we develop Stein's method for the problem of deriving explicit bounds on the distance between $g(\mathbf{W}_n)$ and $g(Σ^{1/2}\mathbf{Z})$ with respect to smooth probability metrics. We obtain several bounds for t…
We prove a multivariate version of Bernstein's inequality about the probability that degenerate $U$-statistics take a value larger than some number $u$. This is an improvement of former estimates for the same problem which yields an asymptotically sharp estimate for not too large numbers $u$. This paper also contains an analogous bound about the distribution of multiple Wiener-Ito integrals. Their comparison shows that our results are sharp. The proofs are based on good estimates about high moments of multiple random integrals. They are obtained by means of a diagram formula which enables us t…
Consider the multivariate Stein equation $Δf - x\cdot \nabla f = h(x) - E h(Z)$, where $Z$ is a standard $d$-dimensional Gaussian random vector, and let $f\_h$ be the solution given by Barbour's generator approach. We prove that, when $h$ is $α$-Hölder ($0<α\leq1$), all derivatives of order $2$ of $f\_h$ are $α$-Hölder {\it up to a $\log$ factor}; in particular they are $β$-Hölder for all $β\in (0, α)$, hereby improving existing regularity results on the solution of the multivariate Gaussian Stein equation. For $α=1$, the regularity we obtain is optimal, as shown by an example given by Raič \c…
The Gaussian correlation inequality for multivariate zero-mean normal probabilities of symmetrical n-rectangles can be considered as an inequality for multivariate gamma distributions (in the sense of Krishnamoorthy and Parthasarathy [5]) with one degree of freedom. Its generalization to all integer degrees of freedom and sufficiently large non-integer "degrees of freedom" was recently proved in [10]. Here, this inequality is partly extended to smaller non-integer degrees of freedom and in particular - in a weaker form - to all infinitely divisible multivariate gamma distributions. A further m…
For integer valued random variables, the translated Poisson distributions form a flexible family for approximation in total variation, in much the same way that the normal family is used for approximation in Kolmogorov distance. Using the Stein--Chen method, approximation can often be achieved with error bounds of the same order as those for the CLT. In this paper, an analogous theory, again based on Stein's method, is developed in the multivariate context. The approximating family consists of the equilibrium distributions of a collection of Markov jump processes, whose analogues in one dimens…
This paper concerns portfolio selection with multiple assets under rough covariance matrix. We investigate the continuous-time Markowitz mean-variance problem for a multivariate class of affine and quadratic Volterra models. In this incomplete non-Markovian and non-semimartingale market framework with unbounded random coefficients, the optimal portfolio strategy is expressed by means of a Riccati backward stochastic differential equation (BSDE). In the case of affine Volterra models, we derive explicit solutions to this BSDE in terms of multi-dimensional Riccati-Volterra equations. This framew…
We provide a Lyapunov type bound in the multivariate central limit theorem for sums of independent, but not necessarily identically distributed random vectors. The error in the normal approximation is estimated for certain classes of sets, which include the class of measurable convex sets. The error bound is stated with explicit constants. The result is proved by means of Stein's method. In addition, we improve the constant in the bound of the Gaussian perimeter of convex sets.
We provide a new general theorem for multivariate normal approximation on convex sets. The theorem is formulated in terms of a multivariate extension of Stein couplings. We apply the results to a homogeneity test in dense random graphs and to prove multivariate asymptotic normality for certain doubly indexed permutation statistics.
We provide an explanation of the main ideas underlying Götze's main result in using Stein's method. We also provide detailed derivations of various intermediate estimates. Curiously, we are led to a different dimensional dependence of the constant than that given Götze's paper. We would like to dedicate this to Charles Stein on the occasion of his 90th birthday.
Berry-Esseen bounds for non-linear functionals of infinite Rademacher sequences are derived by means of the Malliavin-Stein method. Moreover, multivariate extensions for vectors of Rademacher functionals are shown. The results establish a connection to small-ball probabilities and shed new light onto the relation between central limit theorems on the Rademacher chaos and norms of contraction operators. Applications concern infinite weighted 2-runs, a combinatorial central limit theorem and traces of Bernoulli random matrices.
In a recent paper by the authors, a new approach--called the "embedding method"--was introduced, which allows to make use of exchangeable pairs for normal and multivariate normal approximation with Stein's method in cases where the corresponding couplings do not satisfy a certain linearity condition. The key idea is to embed the problem into a higher dimensional space in such a way that the linearity condition is then satisfied. Here we apply the embedding to U-statistics as well as to subgraph counts in random graphs.
We combine Malliavin calculus with Stein's method to derive bounds for the Variance-Gamma approximation of functionals of isonormal Gaussian processes, in particular of random variables living inside a fixed Wiener chaos induced by such a process. The bounds are presented in terms of Malliavin operators and norms of contractions. We show that a sequence of distributions of random variables in the second Wiener chaos converges to a Variance-Gamma distribution if and only if their moments of order two to six converge to that of a Variance-Gamma distributed random variable (six moment theorem). M…
We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Doléans-Dade exponential formula and a uniform exponential inequality using a generic chaining argument. As applications, we obtain a upper bound for a sequence of discrete time martingales indexed by a class of functionals, and so derive the rate of convergence for nonparametric maximum likelihood estimators, which is an improvement of earlier work of van de Geer.
Let $\{\mathsf{T}_t\}_{t>0}$ be a symmetric diffusion semigroup on a $σ$-finite measure space $(Ω, \mathscr{A}, μ)$ and $G^{\mathsf{T}}$ the associated Littlewood-Paley $g$-function operator: $$G^{\mathsf{T}}(f)=\Big(\int_0^\infty \left|t\frac{\partial}{\partial t} \mathsf{T}_t(f)\right|^2\frac{\mathrm{d}t}{t}\Big)^{\frac12}.$$ The classical Littlewood-Paley-Stein inequality asserts that for any $1<p<\infty$ there exist two positive constants $\mathsf{L}^{\mathsf{T}}_{p}$ and $\mathsf{S}^{\mathsf{T}}_{ p}$ such that $$ \big(\mathsf{L}^{\mathsf{T}}_{ p}\big)^{-1}\big\|f-\mathrm{F}(f)\big\|_{p}\…
We prove, using the Brascamp-Lieb inequality, that the Gaussian measure is the only strong log-concave measure having a strong log-concavity parameter equal to its covariance matrix. We also give a similar characterization of the Poisson measure in the discrete case, using "Chebyshev's other inequality". We briefly discuss how these results relate to Stein and Stein-Chen methods for Gaussian and Poisson approximation, and to the Bakry-Emery calculus.
We derive explicit Berry-Esseen bounds in the total variation distance for the Breuer-Major central limit theorem, in the case of a subordinating function $φ$ satisfying minimal regularity assumptions. Our approach is based on the combination of the Malliavin-Stein approach for normal approximations with Gebelein's inequality, bounding the covariance of functionals of Gaussian fields in terms of maximal correlation coefficients.
New bounds for the $k$-th order derivatives of the solutions of the normal and multivariate normal Stein equations are obtained. Our general order bounds involve fewer derivatives of the test function than those in the existing literature. We apply these bounds and local approach couplings to obtain an order $n^{-(p-1)/2}$ bound, for smooth test functions, for the distance between the distribution of a standardised sum of independent and identically distributed random variables and the standard normal distribution when the first $p$ moments of these distributions agree. We also obtain a bound …
For a multivariate stationary process, we develop explicit representations for the finite predictor coefficient matrices, the finite prediction error covariance matrices and the partial autocorrelation function (PACF) in terms of the Fourier coefficients of its phase function in the spectral domain. The derivation is based on a novel alternating projection technique and the use of the forward and backward innovations corresponding to the predictions based on the infinite past and future, respectively. We show that such representations are ideal for studying the rates of convergence of the fini…
Stanford University（斯坦福大学）；Imperial College London（帝国理工学院）；University of Warwick（华威大学）；Microsoft Research New England（微软新英格兰研究院）
Stein's method for measuring convergence to a continuous target distribution relies on an operator characterizing the target and Stein factor bounds on the solutions of an associated differential equation. While such operators and bounds are readily available for a diversity of univariate targets, few multivariate targets have been analyzed. We introduce a new class of characterizing operators based on Ito diffusions and develop explicit multivariate Stein factor bounds for any target with a fast-coupling Ito diffusion. As example applications, we develop computable and convergence-determining…
The Gaussian product inequality is an important conjecture concerning the moments of Gaussian random vectors. While all attempts to prove the Gaussian product inequality in full generality have been unsuccessful to date, numerous partial results have been derived in recent decades and we provide here further results on the problem. Most importantly, we establish a strong version of the Gaussian product inequality for multivariate gamma distributions in the case of nonnegative correlations, thereby extending a result recently derived by Genest and Ouimet [5]. Further, we show that the Gaussian …
We investigate links between the so-called Stein's density approach in dimension one and some functional and concentration inequalities. We show that measures having a finite first moment and a density with connected support satisfy a weighted Poincaré inequality with the weight being the Stein kernel, that indeed exists and is unique in this case. Furthermore, we prove weighted log-Sobolev and asymmetric Brascamp-Lieb type inequalities related to Stein kernels. We also show that existence of a uniformly bounded Stein kernel is sufficient to ensure a positive Cheeger isoperimetric constant. Th…
