A Bernstein-type exponential inequality for (generalized) canonical U-statistics of order 2 is obtained and the Rosenthal and Hoffmann-Jørgensen inequalities for sums of independent random variables are extended to (generalized) U-statistics of any order whose kernels are either nonnegative or canonical
The paper is devoted to establishing some general exponential inequalities for supermartingales. The inequalities improve or generalize many exponential inequalities of Bennett, Freedman, de la Peña, Pinelis and van de Geer. Moreover, our concentration inequalities also improve some known inequalities for sums of independent random variables. Applications associated with linear regressions, autoregressive processes and branching processes are provided. In particular, an interesting application of {de la Peña's} inequality to self-normalized deviations is also provided.
The objective of the present paper is to establish exponential large deviation inequalities, and to use them to show exponential concentration inequalities for the free energy of a polymer in general random environment, its rate of convergence, and an expression of its limit value in terms of those of some multiplicative cascades.
Upper exponential inequalities for the tail probabilities of the centered and normalized number of triangles in the Erdös-Rényi graph are obtained, where the probability of every edge is fixed. The result is formulated in terms of random fields.
We provide a new exponential concentration inequality for First Passage Percolation valid for a wide class of edge times distributions. This improves and extends a result by Benjamini, Kalai and Schramm which gave a variance bound for Bernoulli edge times. Our approach is based on some functional inequalities extending the work of Rossignol and Falik and Samorodnitsky.
Using the renewal approach we prove exponential inequalities for additive functionals and empirical processes of ergodic Markov chains, thus obtaining counterparts of inequalities for sums of independent random variables. The inequalities do not require functions of the chain to be bounded and moreover all the involved constants are given by explicit formulas whenever the usual drift condition holds, which may be of interest in practical applications e.g. to MCMC algorithms.
In this work, Bernstein's concentration inequalities for squared integrable matrix-valued discrete-time martingales are obtained. Based on Lieb's theory and Bernstein's condition, a suitable supermartingale can be constructed. Our proof is largely based on this new exponential supermartingale, Freedman's method, and Doob's stopping theorem. Our result can be regarded as an extension of Tropp's work (ECP, 2012).
Hoeffding-type exponential inequalities are obtained for the distribution tails of canonical von Mises' statistics of arbitrary order based on samples from a stationary sequence of random variables satisfying the φ-mixing condition. The present paper weakens the restrictions on the coefficient φ() which are contained in the paper "Exponential inequalities for the distributions of canonical U- and V-statistics of dependent observations" by Borisov and Volodko (2009). At the same time, we correct the corresponding proof in this paper.
We obtain moderate deviations theorems and exponential (Bernstein type) concentration inequalities for "nonconventional" sums of the form $S_N=\sum_{n=1}^N (F(ξ_{q_1(n)},ξ_{q_2(n)},...,ξ_{q_\ell(n)})-\bar F)$.
In this work we derive multi-level concentration inequalities for polynomial functions in independent random variables with a $α$-sub-exponential tail decay. A particularly interesting case is given by quadratic forms $f(X_1, \ldots, X_n) = \langle X,A X \rangle$, for which we prove Hanson-Wright-type inequalities with explicit dependence on various norms of the matrix $A$. A consequence of these inequalities is a two-level concentration inequality for quadratic forms in $α$-sub-exponential random variables, such as quadratic Poisson chaos. We provide various applications of these inequalities…
The Hoeffding-type-inequalities are obtained for the distribution tails of canonical (degenerate) U- and V-statistics of an arbitrary order based on samples from a stationary sequence of observations satisfying $ρ$-mixing.
For self-normalized martingales with conditionally symmetric differences, de la Peña [A general class of exponential inequalities for martingales and ratios. Ann. Probab. 27, No.1, 537-564] established the Gaussian type exponential inequalities. Bercu and Touati [Exponential inequalities for self-normalized martingales with applications. Ann. Appl. Probab. 18: 1848-1869] extended de la Peña's inequalities to martingales with differences heavy on left. In this paper, we establish Bernstein type exponential inequalities for self-normalized martingales with differences bounded from below. Moreove…
Kolmogorov's exponential inequalities are basic tools for studying the strong limit theorems such as the classical laws of the iterated logarithm for both independent and dependent random variables. This paper establishes the Kolmogorov type exponential inequalities of the partial sums of independent random variables as well as negatively dependent random variables under the sub-linear expectations. As applications of the exponential inequalities, the laws of the iterated logarithm in the sense of non-additive capacities are proved for independent or negatively dependent identically distribute…
There has been a renewed interest in exponential concentration inequalities for stochastic processes in probability and statistics over the last three decades. De la Peña \cite{d} establishes a nice exponential inequality for discrete time locally square integrable martingale . In this paper, we obtain de la Peña's inequalities for stochastic integral of multivariate point processes. The proof is primarily based on Doléans-Dade exponential formula and the optional stopping theorem. As application, we obtain an exponential inequality for block counting process in $Λ-$coalescents.
We introduce and study a notion of Orlicz hypercontractive semigroups. We analyze their relations with general $F$-Sobolev inequalities, thus extending Gross hypercontractivity theory. We provide criteria for these Sobolev type inequalities and for related properties. In particular, we implement in the context of probability measures the ideas of Maz'ja's capacity theory, and present equivalent forms relating the capacity of sets to their measure. Orlicz hypercontractivity efficiently describes the integrability improving properties of the Heat semigroup associated to the Boltzmann measures $μ…
Let $(X_{i}, \mathcal{F}_{i})_{i\geq 1}$ be a sequence of supermartingale differences and let $S_k=\sum_{i=1}^k X_i$. We give an exponential moment condition under which $P(\max_{1\leq k \leq n} S_k \geq n)=O(\exp\{-C_1 n^α\}),$ $n\rightarrow \infty,$ where $α\in (0, 1)$ is given and $C_{1}>0$ is a constant. We also show that the power $α$ is optimal under the given condition. In particular, when $α=1/3$, we recover an inequality of Lesigne and Volný.
We present Rosenthal-type moment inequalities for matrix-valued U-statistics of order 2. As a corollary, we obtain new matrix concentration inequalities for U-statistics. One of our main technical tools, a version of the non-commutative Khintchine inequality for the spectral norm of the Rademacher chaos, could be of independent interest.
The goal of the article is to improve constants in the infimum convolution inequalities (IC for short) which were introduced by R. Latała and J.O. Wojtaszczyk. We show that the exponential distribution satisfies IC with constant $2$ but not with constant $1$, which implies that linear functions are not extremal in Maurey's property $(τ)$. Using transport of measure we use this result to better constants in the IC inequalities for product symmetric log-concave measures as well as in the Talagrand's two level concentration inequality for the exponential distribution.
Decoupling inequalities disentangle complex dependence structures of random objects so that they can be analyzed by means of standard tools from the theory of independent random variables. We study decoupling inequalities for vector-valued homogeneous polynomials evaluated at random variables. We focus on providing geometric conditions ensuring decoupling inequalities with good constants depending only exponentially on the degree of the polynomial. Assuming the Banach space has finite cotype we achieve this for classical decoupling inequalities that compare the polynomials with their associate…
In this paper we present various new inequalities for tail proabilities for distributions that are elements of the most improtant exponential families. These families include the Poisson distributions, the Gamma distributions, the binomial distributions, the negative binomial distributions and the inverse Gaussian distributions. All these exponential families have simple variance functions and the variance functions play an important role in the exposition. All the inequalities presented in this paper are formulated in terms of the signed log-likelihood. The inequalities are of a qualitative n…
We present remarkably simple proofs of Burkholder-Davis-Gundy inequalities for stochastic integrals and maximal inequalities for stochastic convolutions in Banach spaces driven by Lévy-type processes. Exponential estimates for stochastic convolutions are obtained and two versions of Itô's formula in Banach spaces are also derived. Based on the obtained maximal inequality, the existence and uniqueness of mild solutions of stochastic quasi-geostrophic equation with Lévy noise is established.
In this paper non-asymptotic exponential estimates are derived for the tail distribution of polynomial martingale differences in terms unconditional tails distributions of summands. Applications are considered in the theory of polynomials on independent random variables, to the theory of U-statistics, multiply martingale series and in the theory of weak compactness measures on the Banach spaces. Partially supported by the Israel Ministry of Absorbtion Mathematics Subject Classification (2000): 47A45, 47B10, 60F10, 60G42.
We present moment inequalities for completely degenerate Banach space valued (generalized) U-statistics of arbitrary order. The estimates involve suprema of empirical processes which, in the real-valued case, can be replaced by simpler norms of the kernel matrix (i.e., norms of some multilinear operators associated with the kernel matrix). As a corollary, we derive tail inequalities for U-statistics with bounded kernels and for some multiple stochastic integrals.
In this work, we deal with an iteration method for approximating a fixed point of a contraction mapping using the Mann's algorithm under functional random errors. We first show its almost complete convergence to the fixed point by mean of an exponential inequality and then we specify the induced rate of convergence. We finally build a confidence set for the fixed point.
In this paper, we provide a characterization of a large class of transportation-cost inequalities in terms of exponential integrability of the cost function under the reference probability measure. Our results completely extend the previous works by Djellout, Guilin and Wu and Bolley and Villani.
Normal comparison lemma and Slepian's inequality are essential tools in the study of Gaussian processes. In this paper we extend normal comparison lemma and derive various related comparison inequalities including Slepian's inequality for order statistics of two Gaussian arrays.The derived results can be applied in numerous problems related to the study of the supremum of order statistics of Gaussian processes. In order to illustrate the range of possible applications, we analyze the lower tail behaviour of order statistics of self-similar Gaussian processes and derive mixed Gumbel limit theor…
We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Doléans-Dade exponential formula and a uniform exponential inequality using a generic chaining argument. As applications, we obtain a upper bound for a sequence of discrete time martingales indexed by a class of functionals, and so derive the rate of convergence for nonparametric maximum likelihood estimators, which is an improvement of earlier work of van de Geer.
We extend the dimension free Talagrand inequalities for convex distance \cite{talagrand:1995} using an extension of Marton's weak transport \cite{marton:1996a} to other metrics than the Hamming distance. We study the dual form of these weak transport inequalities for the euclidian norm and prove that it implies sub-gaussianity and convex Poincaré inequality \cite{bobkov:gotze:1999a}. We obtain new weak transport inequalities for non products measures extending the results of Samson in \cite{samson:2000}. Many examples are provided to show that the euclidian norm is an appropriate metric for cl…
The exponential inequality of the maximum partial sums is a key to establish the law of the iterated logarithm of negatively associated random variables. In the one-indexed random sequence case, such inequalities for negatively associated random variables are established by Shao (2000) by using his comparison theorem between negatively associated and independent random variables. In the multi-indexed random field case, the comparison theorem fails. The purpose of this paper is to establish the Kolmogorov exponential inequality as well a moment inequality of the maximum partial sums of a negati…
In a recent paper by A. Backhausz, B. Gerencsér and V. Harangi, it was shown that factors of independent identically distributed random processes (IID) on trees obey certain geometry-driven inequalities. In particular, the mutual information shared between two vertices decays exponentially, and there is an explicit bound for this decay. In this note we show that all of these inequalities could be verbatim translated to the setting of factors of processes driven by unique Gibbs measures. As a consequence, we show that correlations decay exponentially for unique Gibbs measures on trees.
In this paper we obtain non-uniform exponential upper bounds for the rate of convergence of a version of the algorithm Context, when the underlying tree is not necessarily bounded. The algorithm Context is a well-known tool to estimate the context tree of a Variable Length Markov Chain. As a consequence of the exponential bounds we obtain a strong consistency result. We generalize in this way several previous results in the field.
We propose several exponential inequalities for self-normalized martingales similar to those established by De la Peña. The keystone is the introduction of a new notion of random variable heavy on left or right. Applications associated with linear regressions, autoregressive and branching processes are also provided.
We establish exponential inequalities for a class of V-statistics under strong mixing conditions. Our theory is developed via a novel kernel expansion based on random Fourier features and the use of a probabilistic method. This type of expansion is new and useful for handling many notorious classes of kernels.
Motivated by problems arising in random sampling of trigonometric polynomials, we derive exponential inequalities for the operator norm of the difference between the sample second moment matrix $n^{-1}U^*U$ and its expectation where $U$ is a complex random $n\times D$ matrix with independent rows. These results immediately imply deviation inequalities for the largest (smallest) eigenvalues of the sample second moment matrix, which in turn lead to results on the condition number of the sample second moment matrix. We also show that trigonometric polynomials in several variables can be learned f…
This paper aims to provide some tools coming from functional inequalities to deal with quasi-stationarity for absorbed Markov processes. First, it is shown how a Poincaré inequality related to a suitable Doob transform entails exponential convergence of conditioned distributions to a quasi-stationary distribution in total variation and in $1$-Wasserstein distance. A special attention is paid to multi-dimensional diffusion processes, for which the aforementioned Poincaré inequality is implied by an easier-to-check Bakry-Émery condition depending on the right eigenvector for the sub-Markovian ge…
Self-normalized processes arise naturally in statistical applications. Being unit free, they are not affected by scale changes. Moreover, self-normalization often eliminates or weakens moment assumptions. In this paper we present several exponential and moment inequalities, particularly those related to laws of the iterated logarithm, for self-normalized random variables including martingales. Tail probability bounds are also derived. For random variables B_t>0 and A_t, let Y_t(λ)=\exp{λA_t-λ^2B_t^2/2}. We develop inequalities for the moments of A_t/B_{t} or sup_{t\geq 0}A_t/{B_t(\log \log B_{…
In this paper, we consider Poincaré inequalities for non euclidean metrics on $\mathbb{R}^d$. These inequalities enable us to derive precise dimension free concentration inequalities for product measures. This technique is appropriate for a large scope of concentration rate: between exponential and gaussian and beyond. We give different equivalent functional forms of these Poincaré type inequalities in terms of transportation-cost inequalities and infimum convolution inequalities. Workable sufficient conditions are given and a comparison is made with generalized Beckner-Latala-Oleszkiewicz ine…
We prove concentration inequalities for functions of independent random variables {under} sub-gaussian and sub-exponential conditions. The utility of the inequalities is demonstrated by an extension of the now classical method of Rademacher complexities to Lipschitz function classes and unbounded sub-exponential distribution.
We derive sufficient conditions for a probability measure on a finite product space (a spin system) to satisfy a (modified) logarithmic Sobolev inequality. We establish these conditions for various examples, such as the (vertex-weighted) exponential random graph model, the random coloring and the hard-core model with fugacity. This leads to two separate branches of applications. The first branch is given by mixing time estimates of the Glauber dynamics. The proofs do not rely on coupling arguments, but instead use functional inequalities. As a byproduct, this also yields exponential decay of t…
Let $(ξ_i)_{i=1,...,n}$ be a sequence of independent and symmetric random variables. We consider the upper bounds on tail probabilities of self-normalized deviations $$ \mathbf{P} \Big( \max_{1\leq k \leq n} \sum_{i=1}^{k} |ξ_i|\big/ \big(\sum_{i=1}^{n} |ξ_i|^β\big)^{1/β} \geq x \Big) $$ for $x>0$ and $β>1.$ Our bound is the best that can be obtained from the Bernstein inequality under the present assumption. An application to Student's $t$-statistics is also given.
We use a generalization of Hoeffding's inequality to show concentration results for the free energy of disordered pinning models, assuming only that the disorder has a finite exponential moment. We also prove some concentration inequalities for directed polymers in random environment, which we use to establish a large deviations results for the end position of the polymer under the polymer measure.
This paper deduces exponential matrix concentration from a Poincaré inequality via a short, conceptual argument. Among other examples, this theory applies to matrix-valued functions of a uniformly log-concave random vector. The proof relies on the subadditivity of Poincaré inequalities and a chain rule inequality for the trace of the matrix Dirichlet form. It also uses a symmetrization technique to avoid difficulties associated with a direct extension of the classic scalar argument.
The modified Bessel function of the first kind, $I_ν(x)$, arises in numerous areas of study, such as physics, signal processing, probability, statistics, etc. As such, there has been much interest in recent years in deducing properties of functionals involving $I_ν(x)$, in particular, of the ratio ${I_{ν+1}(x)}/{I_ν(x)}$, when $ν,x\geq 0$. In this paper we establish sharp upper and lower bounds on $H(ν,x)=\sum_{k=1}^{\infty} {I_{ν+k}(x)}/{I_ν(x)}$ for $ν,x\geq 0$ that appears as the complementary cumulative hazard function for a Skellam$(λ,λ)$ probability distribution in the statistical analys…
In this paper, we prove analogues of Khintchine and Rosenthal's moment inequalities for symmetric statistics (U-statistics) of arbitrary order. An example that shows significance of each term in the analogues of Rosenthal's bounds for symmetric statistics is constructed as well.
The use of Lyapunov conditions for proving functional inequalities was initiated in [5]. It was shown in [4, 30] that there is an equivalence between a Poincar{é} inequality, the existence of some Lyapunov function and the exponential integrability of hitting times. In the present paper, we close the scheme of the interplay between Lyapunov conditions and functional inequalities by $\bullet$ showing that strong functional inequalities are equivalent to Lyapunov type conditions; $\bullet$ showing that these Lyapunov conditions are characterized by the finiteness of generalized exponential momen…
Kolmogorov-Type Maximal Inequalities for Independent and Dependent Negative Binomial Random Variables: Sharp Bounds, Sub-Exponential Refinements, and Applications to Overdispersed Count Data
We prove decoupling inequalities for random polynomials in independent random variables with coefficients in vector space. We use various means of comparison, including rearrangement invariant norms (e.g., Orlicz and Lorentz norms), tail distributions, tightness, hypercontractivity, etc.
We consider the two-star model, a family of exponential random graphs indexed by two real parameters, $h$ and $α$, that rule respectively the total number of edges and the mutual dependence between them. Borrowing tools from statistical mechanics, we study different classes of correlation inequalities for edges, that naturally emerge while taking the partial derivatives of the (finite size) free energy. In particular, if $α, h\ge 0$, we derive first and second order correlation inequalities and then prove the so-called GHS inequality. As a consequence, under the above conditions on the paramet…
We prove a concentration inequality for sequential dynamical systems of the unit interval enjoying an exponential loss of memory in the BV norm, and we investigate several of its consequences. In particular, this covers compositions of $β$-transformations, with all $β$ lying in a neighborhood of a fixed $β_{\star} > 1$ and systems satisfying a covering type assumption.
This note describes non-asymptotic variance and tail bounds for order statistics of samples of independent identically distributed random variables. Those bounds are checked to be asymptotically tight when the sampling distribution belongs to a maximum domain of attraction. If the sampling distribution has non-decreasing hazard rate (this includes the Gaussian distribution), we derive an exponential Efron-Stein inequality for order statistics: an inequality connecting the logarithmic moment generating function of centered order statistics with exponential moments of Efron-Stein (jackknife) est…
The note is devoted to estimates for convolutions appearing in some class of stochastic Volterra equations. Two maximal inequalities and exponential tail estimate are proved by the fractional method of infinite dimensional stochastic calculus. The paper extends on non-semigroup case some results obtained earlier for semigroups.
We study random walks on groups with the feature that, roughly speaking, successive positions of the walk tend to be "aligned". We formalize and quantify this property by means of the notion of deviation inequalities. We show that deviation inequalities have several consequences including Central Limit Theorems, the local Lipschitz continuity of the rate of escape and entropy, as well as linear upper and lower bounds on the variance of the distance of the position of the walk from its initial point. In a second part of the paper, we show that the (exponential) deviation inequality holds for me…