In this paper we study empirical measures which can be thought as a decoupled version of the empirical measures generated by random matrices. We prove the large deviation principle with the rate function, which is finite only on product measures and hence is non-convex. As a corollary, we derive a large deviations principle for (univariate) average empirical measures with the rate function that superficially resembles the rate function of random matrices, but may be concave.
We prove hydrostatics of boundary driven gradient exclusion processes, Fick's law and we present a simple proof of the dynamical large deviations principle which holds in any dimension
We prove an energy estimate for the polar empirical measure of the two-dimensional symmetric simple exclusion process. We deduce from this estimate and from results in reference [2] large deviations principles for the polar empirical measure and for the occupation time of the origin.
We derive a large deviation principle for the empirical currents of lattice gas dynamics which combine a fast stirring mechanism (Symmetric Simple Exclusion Process) and creation/annihilation mechanisms (Glauber dynamics). Previous results on the density large deviations can be recovered from this general large deviation principle. The contribution of external driving forces due to reservoirs at the boundary of the system is also taken into account.
We consider a continuous time Markov chain on a countable state space and prove a joint large deviation principle for the empirical measure and the empirical flow, which accounts for the total number of jumps between pairs of states. We give a direct proof using tilting and an indirect one by contraction from the empirical process.
This article revisits the work by Ofer Zeitouni and Steve Zelditch on large deviations for the empirical measures of random orthogonal polynomials with i.i.d. Gaussian complex coefficients, and extends this result to real Gaussian coefficients. This article does not require any knowledge in geometry. For clarity, we focus on two classical cases: Kac polynomials and elliptic polynomials.
We prove moderate deviation principles for the tagged particle position and current in one-dimensional symmetric simple exclusion processes. There is at most one particle per site. A particle jumps to one of its two neighbors at rate $1/2$, and the jump is suppressed if there is already one at the target site. We distinguish one particular particle which is called the tagged particle. We first establish a variational formula for the moderate deviation rate functions of the tagged particle positions based on moderate deviation principles from hydrodynamic limit proved by Gao and Quastel \cite{g…
We prove joint large deviation principle for the \emph{ empirical pair measure} and \emph{empirical locality measure} of the \emph{near intermediate} coloured random geometric graph models on $n$ points picked uniformly in a $d-$dimensional torus of a unit circumference.From this result we obtain large deviation principles for the \emph{number of edges per vertex}, the \emph{degree distribution and the proportion of isolated vertices } for the \emph{near intermediate} random geometric graph models.
We consider a lattice gas evolving in a bounded cylinder of length 2N + 1 and interacting via a Neuman Kac interaction of range N, in contact with particles reservoirs at different densities. We investigate the associated law of large numbers and large deviations of the empirical current and of the density. The hydrodynamic limit for the empirical density, obtained in the diffusive scaling, is given by a nonlocal, nonlinear evolution equation with Dirichlet boundary conditions.
In this paper we prove a Large Deviation Principle for the sequence of symmetrised empirical measures $\frac{1}{n} \sum_{i=1}^{n} δ_{(X^n_i,X^n_{σ_n(i)})}$ where $σ_n$ is a random permutation and $((X_i^n)_{1 \leq i \leq n})_{n \geq 1}$ is a triangular array of random variables with suitable properties. As an application we show how this result allows to improve the Large Deviation Principles for symmetrised initial-terminal conditions bridge processes recently established by Adams, Dorlas and König.
In this article for a finite typed random geometric graph we define the empirical locality distribution, which records the number of nodes of a given type linked to a given number of nodes of each type. We find large deviation principle (LDP) for the empirical locality measure given the empirical pair measure and the empirical type measure of the typed random geometric graphs. From this LDP, we derive large deviation principles for the degree measure and the proportion of detached nodes in the classical Erdos-Renyi graph defined on [0, 1]^d. This graphs have been suggested by (Canning and Penm…
We study in this article large deviations for the empirical mean of iid random vectors with some deterministic weights, whose empirical measure weakly converges to some compactly support probability distribution. The scope of this paper is to study the effect on the LDP of outliers, that is sequences of weights that remain far from the support of the limiting measure.
For any finite colored graph we define the empirical neighborhood measure, which counts the number of vertices of a given color connected to a given number of vertices of each color, and the empirical pair measure, which counts the number of edges connecting each pair of colors. For a class of models of sparse colored random graphs, we prove large deviation principles for these empirical measures in the weak topology. The rate functions governing our large deviation principles can be expressed explicitly in terms of relative entropies. We derive a large deviation principle for the degree distr…
We study the variational problem that arises from consideration of large deviations for semimartingale reflected Brownian motion (SRBM) in the positive octant. Due to the difficulty of the general problem, we consider the case in which the SRBM has rotationally symmetric parameters. In this case, we are able to obtain conditions under which the optimal solutions to the variational problem are paths that are gradual (moving through faces of strictly increasing dimension) or that spiral around the boundary of the octant. Furthermore, these results allow us to provide an example for which it can …
In the present paper, we consider the linear autoregressive model in $\rr$, $$ X_{k,n}=θ_n X_{k,n-1}+ξ_k, k=0,1,...,n, n\ge 1$$ where $θ_n\in [0,1)$ is unknown, $(ξ_k)_{k\in\zz}$ is a sequence of centered i.i.d. r.v. valued in $\rr$ representing the noise. When $θ_n\to 1$, the moderate deviations principle for empirical covariance is discussed and as statistical applications we provide the moderate deviation estimates of the least square and the Yule-Walker estimators of the parameter $θ_n$.
A large deviations principle is established for the joint law of the empirical measure and the flow measure of a renewal Markov process on a finite graph. We do not assume any bound on the arrival times, allowing heavy tailed distributions. In particular, the rate functional is in general degenerate (it has a nontrivial set of zeros) and not strictly convex. These features show a behavior highly different from what one may guess with a heuristic Donsker-Varadhan analysis of the problem.
In this paper, we show that the empirical measure of mean-field model satisfies the large deviation principle with respect to the weak convergence topology or the stronger Wasserstein metric, under the strong exponential integrability condition on the negative part of the interaction potentials. In contrast to the known results we prove this without any continuity or boundedness condition on the interaction potentials. The proof relies mainly on the law of large numbers and the exponential decoupling inequality of de la Pena for U-statistics.
A basic result of large deviations theory is Sanov's theorem, which states that the sequence of empirical measures of independent and identically distributed samples satisfies the large deviation principle with rate function given by relative entropy with respect to the common distribution. Large deviation principles for the empirical measures are also known to hold for broad classes of weakly interacting systems. When the interaction through the empirical measure corresponds to an absolutely continuous change of measure, the rate function can be expressed as relative entropy of a distribution…
We establish uniqueness for a class of first-order Hamilton-Jacobi equations with Hamiltonians that arise from the large deviations of the empirical measure and empirical flux pair of weakly interacting Markov jump processes. As a corollary we obtain a large deviation principle for the trajectory of the empirical measure and empirical flux pair of such processes. As a second corollary we get same result in the setting where the jump-rates are time-periodic, with period-length that decreases to 0.
Here we propose the Donsker-Varadhan-type compactness conditions and prove the joint large deviation principle for the empirical measure and empirical flow of Markov renewal processes (semi-Markov processes) with a countable state space, generalizing the relevant results for continuous-time Markov chains with a countable state space obtained in [Ann. Inst. H. Poincaré Probab. Statist. 51, 867-900 (2015)] and [Stoch. Proc. Appl. 125, 2786-2819 (2015)], as well as the relevant results for Markov renewal processes with a finite state space obtained in [Adv. Appl. Probab. 48, 648-671 (2016)]. In p…
Let $U_m$ be an $m \times m$ Haar unitary matrix and $U_{[m,n]}$ be its $n \times n$ truncation. In this paper the large deviation is proven for the empirical eigenvalue density of $U_{[m,n]}$ as $m/n \to λ$ and $n \to \infty$. The rate function and the limit distribution are given explicitly. $U_{[m,n]}$ is the random matrix model of $quq$, where $u$ is a Haar unitary in a finite von Neumann algebra, $q$ is a certain projection and they are free. The limit distribution coincides with the Brown measure of the operator $quq$.
We consider preferential attachment random graphs which may be obtained as follows: It starts with a single node. If a new node appears, it is linked by an edge to one or more existing node(s) with a probability proportional to function of their degree. For a class of linear preferential attachment random graphs we find a large deviation principle (LDP) for the empirical degree measure. In the course of the prove this LDP we establish an LDP for the empirical degree and pair distribution see Theorem 2.3, of the fitness preferential attachment model of random graphs.
Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is common to all particles. The interaction between the particles is due to the common noise and also through the drift and diffusion coefficients that depend on the state empirical measure. We study large deviation behavior of the empirical measure process which is governed by two types of scaling, one corresponding to mean field asymptotics and the other to the Fr…
Consider a symmetric $α$-stable Lévy process with $α\in (1,2)$. We study shifted small ball probabilities for these processes in the uniform topology, when the shift function is an arbitrary continuous function which starts at 0. We obtain the exact rate of decrease for these probabilities including constants. Using these small ball estimates, we obtain a functional LIL for $α$-stable Lévy process with attracting functions that are continuous. It occurs that the limit set for the family of renormalized $α$-stable Lévy processes is equal to the set of all continuous functions on $[0,1]$ which s…
The large deviations principle for the empirical measure for both continuous and discrete time Markov processes is well known. Various expressions are available for the rate function, but these expressions are usually as the solution to a variational problem, and in this sense not explicit. An interesting class of continuous time, reversible processes was identified in the original work of Donsker and Varadhan for which an explicit expression is possible. While this class includes many (reversible) processes of interest, it excludes the case of continuous time pure jump processes, such as a re…
We investigate the large deviation behaviour of a point process sequence based on a stationary symmetric stable non-Gaussian discrete-parameter random field using the framework of Hult and Samorodnitsky (2010). Depending on the ergodic theoretic and group theoretic structures of the underlying nonsingular group action, we observe different large deviation behaviours of this point process sequence. We use our results to study the large deviations of various functionals (e.g., partial sum, maxima, etc.) of stationary symmetric stable fields.
In this article, we consider a one-dimensional symmetric exclusion process in weak contact with reservoirs at the boundary. In the diffusive time-scaling the empirical measure evolves according to the heat equation with Robin boundary conditions. We prove the associated dynamical large deviations principle.
Importance sampling is a popular method for efficient computation of various properties of a distribution such as probabilities, expectations, quantiles etc. The output of an importance sampling algorithm can be represented as a weighted empirical measure, where the weights are given by the likelihood ratio between the original distribution and the sampling distribution. In this paper the efficiency of an importance sampling algorithm is studied by means of large deviations for the weighted empirical measure. The main result, which is stated as a Laplace principle for the weighted empirical me…
The aim of this paper is to develop tractable large deviation approximations for the empirical measure of a small noise diffusion. The starting point is the Freidlin-Wentzell theory, which shows how to approximate via a large deviation principle the invariant distribution of such a diffusion. The rate function of the invariant measure is formulated in terms of quasipotentials, quantities that measure the difficulty of a transition from the neighborhood of one metastable set to another. The theory provides an intuitive and useful approximation for the invariant measure, and along the way many u…
Given a branching random walk $(Z_n)_{n\geq0}$ on $\mathbb{R}$, let $Z_n(A)$ be the number of particles located in interval $A$ at generation $n$. It is well known (e.g., \cite{biggins}) that under some mild conditions, $Z_n(\sqrt nA)/Z_n(\mathbb{R})$ converges a.s. to $ν(A)$ as $n\rightarrow\infty$, where $ν$ is the standard Gaussian measure. In this work, we investigate its large deviation probabilities under the condition that the step size or offspring law has heavy tail, i.e. the decay rate of $$\mathbb{P}(Z_n(\sqrt nA)/Z_n(\mathbb{R})>p)$$ as $n\rightarrow\infty$, where $p\in(ν(A),1)$. O…
We introduce two new concepts designed for the study of empirical processes. First, we introduce a new Orlicz norm which we call the Bernstein-Orlicz norm. This new norm interpolates sub-Gaussian and sub-exponential tail behavior. In particular, we show how this norm can be used to simplify the derivation of deviation inequalities for suprema of collections of random variables. Secondly, we introduce chaining and generic chaining along a tree. These simplify the well-known concepts of chaining and generic chaining. The supremum of the empirical process is then studied as a special case. We sho…
We prove that moderate deviations for empirical measures for countable nonhomogeneous Markov chains hold under the assumption of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chains in Cesàro sense.
We present large deviations principles for the moments of the empirical spectral measure of Wigner matrices and empirical measure of $β$-ensembles in three cases : the case of Wigner matrices without Gaussian tails, that is Wigner matrices whose entries have tail distributions decreasing as $e^{-ct^α}$, for some constant $c>0$ and with $α\in (0,2)$, the case of Gaussian Wigner matrices, and the case of $β$-ensembles associated with a convex potential with polynomial growth.
The entropy of an ergodic finite-alphabet process can be computed from a single typical sample path x_1^n using the entropy of the k-block empirical probability and letting k grow with $n$ roughly like log n. We further assume that the distribution of the process is a g-measure; g-measures form a large class of Gibbs measures. We prove large deviation principles for conditional, non-conditional and relative k(n)-block empirical entropies.
We present new M-estimators of the mean and variance of real valued random variables, based on PAC-Bayes bounds. We analyze the non-asymptotic minimax properties of the deviations of those estimators for sample distributions having either a bounded variance or a bounded variance and a bounded kurtosis. Under those weak hypotheses, allowing for heavy-tailed distributions, we show that the worst case deviations of the empirical mean are suboptimal. We prove indeed that for any confidence level, there is some M-estimator whose deviations are of the same order as the deviations of the empirical me…
In this paper we define for a Bernoulli samples the \emph{ empirical infection measure}, which counts the number of positives (infections) in the Bernoulli sample and for the \emph{ pool samples} we define the empirical pool infection measure, which counts the number of positive (infected) pool samples. For this empirical measures we prove a joint large deviation principle for Bernoulli samples. We also found an asymptotic relationship between the \emph{ proportion of infected individuals } with respect to the samples size, $n$ and the \emph{ proportion of infected pool samples} with respect t…
Non-degenerate U-empirical Kolmogorov-Smirnov tests are studied and their large deviation asymptotics under the null-hypothesis is described. Several examples of such statistics used for testing goodness-of-fit and symmetry are considered. It is shown how to calculate their local Bahadur efficiency.
In this article we study the stochastic block model also known as the multi-type random networks (MRNs). For the stochastic block model or the MRNs we define the empirical group measure, empirical cooperative measure and the empirical locality measure. We derive large deviation principles for the empirical measures in the weak topology. These results will form the basis of understanding asymptotics of the evolutionary and co-evolutionary processes on the stochastic block model.
Given a super-critical branching random walk on $\mathbb{R}$ started from the origin, let $Z\_n(\cdot)$ be the counting measure which counts the number of individuals at the $n$-th generation located in a given set. Under some mild conditions, it is known in \cite{B90} that for any interval $A\subset \mathbb{R}$, $\frac{Z\_n(\sqrt{n}A)}{Z\_n(\mathbb{R})}$ converges a.s. to $ν(A)$, where $ν$ is the standard Gaussian measure. In this work, we investigate the convergence rates of $$\mathbb{P}\left(\frac{Z\_n(\sqrt{n}A)}{Z\_n(\mathbb{R})}-ν(A)>Δ\right),$$ for $Δ\in (0, 1-ν(A))$, in both Schr{ö}der…
We investigate the Large Deviations properties of bootstrapped empirical measure with exchangeable weights. Our main result shows in great generality how the resulting rate function combines the LD properties of both the sample weights and the observations. As an application we recover known conditional and unconditional LDPs and obtain some new ones.
We compute the Hamiltonian and Lagrangian associated to the large deviations of the trajectory of the empirical distribution for independent Markov processes, and of the empirical measure for translation invariant interacting Markov processes. We treat both the case of jump processes (continuous-time Markov chains and interacting particle systems) as well as diffusion processes. For diffusion processes, the Lagrangian is a quadratic form of the deviation of the trajectory from the Kolmogorov forward equation. In all cases, the Lagrangian can be interpreted as a relative entropy or relative ent…
The approach of Kleitman (1970) and Kanter (1976) to multivariate concentration function inequalities is generalized in order to obtain for deviation probabilities of sums of independent symmetric random variables a lower bound depending only on deviation probabilities of the terms of the sum. This bound is optimal up to discretization effects, improves on a result of Nagaev (2001), and complements the comparison theorems of Birnbaum (1948) and Pruss (1997). Birnbaum's theorem for unimodal random variables is extended to the lattice case.
We investigate large deviations for the empirical measure of the position and momentum of a particle traveling in a box with hot walls. The particle travels with uniform speed from left to right, until it hits the right boundary. Then it is absorbed and re-emitted from the left boundary with a new random speed, taken from an i.i.d. sequence. It turns out that this simple model, often used to simulate a heat bath, displays unusually complex large deviations features, that we explain in detail. In particular, if the tail of the update distribution of the speed is sufficiently oscillating, then t…
Functionals of spatial point process often satisfy a weak spatial dependence condition known as stabilization. In this paper we prove process level moderate deviation principles (MDP) for such functionals, which are a level-3 result for empirical point fields as well as a level-2 result for empirical point measures. The level-3 rate function coincides with the so-called specific information. We show that the general result can be applied to prove MDPs for various particular functionals, including random sequential packing, birth-growth models, germ-grain models and nearest neighbor graphs.
Importance sampling has become an important tool for the computation of tail-based risk measures. Since such quantities are often determined mainly by rare events standard Monte Carlo can be inefficient and importance sampling provides a way to speed up computations. This paper considers moderate deviations for the weighted empirical process, the process analogue of the weighted empirical measure, arising in importance sampling. The moderate deviation principle is established as an extension of existing results. Using a delta method for large deviations established by Gao and Zhao (Ann. Statis…
We study the existence of the (thermodynamic) limit of the scaled cumulant-generating function L_n(z)=|W_n|^{-1}\logE\exp{z|Ξ\cap W_n|} of the empirical volume fraction |Ξ\cap W_n|/|W_n|, where |\cdot| denotes the d-dimensional Lebesgue measure. Here Ξ=\bigcup_{i\ge1}(Ξ_i+X_i) denotes a d-dimensional Poisson grain model (also known as a Boolean model) defined by a stationary Poisson process Π_λ=\sum_{i\ge1}δ_{X_i} with intensity λ>0 and a sequence of independent copies Ξ_1,Ξ_2,... of a random compact set Ξ_0. For an increasing family of compact convex sets {W_n, n\ge1} which expand unboundedly…
We obtain a large deviations principle for the self-intersection local times for a symmetric random walk in dimension d>4. As an application, we obtain moderate deviations for random walk in random sceneries in some region of parameters.
