We present a new technique for proving empirical process invariance principle for stationary processes $(X_n)_{n\geq 0}$. The main novelty of our approach lies in the fact that we only require the central limit theorem and a moment bound for a restricted class of functions $(f(X_n))_{n\geq 0}$, not containing the indicator functions. Our approach can be applied to Markov chains and dynamical systems, using spectral properties of the transfer operator. Our proof consists of a novel application of chaining techniques.
Empirical processes for stationary, causal sequences are considered. We establish empirical central limit theorems for classes of indicators of left half lines, absolutely continuous functions and piecewise differentiable functions. Sample path properties of empirical distribution functions are also discussed. The results are applied to linear processes and Markov chains.
We give two asymptotic results for the empirical distance covariance on separable metric spaces without any iid assumption on the samples. In particular, we show the almost sure convergence of the empirical distance covariance for any measure with finite first moments, provided that the samples form a strictly stationary and ergodic process. We further give a result concerning the asymptotic distribution of the empirical distance covariance under the assumption of absolute regularity of the samples and extend these results to certain types of pseudometric spaces. In the process, we derive a ge…
This paper considers the maximum generalized empirical likelihood (GEL) estimation and inference on parameters identified by high dimensional moment restrictions with weakly dependent data when the dimensions of the moment restrictions and the parameters diverge along with the sample size. The consistency with rates and the asymptotic normality of the GEL estimator are obtained by properly restricting the growth rates of the dimensions of the parameters and the moment restrictions, as well as the degree of data dependence. It is shown that even in the high dimensional time series setting, the …
Generalized linear statistics are an unifying class that contains U-statistics, U-quantiles, L-statistics as well as trimmed and winsorized U-statistics. For example, many commonly used estimators of scale fall into this class. GL-statistics only have been studied under independence; in this paper, we develop an asymptotic theory for GL-statistics of sequences which are strongly mixing or L^1 near epoch dependent on an absolutely regular process. For this purpose, we prove an almost sure approximation of the empirical U-process by a Gaussian process. With the help of a generalized Bahadur repr…
It is commonly acknowledged that V-functionals with an unbounded kernel are not Hadamard differentiable and that therefore the asymptotic distribution of U- and V-statistics with an unbounded kernel cannot be derived by the Functional Delta Method (FDM). However, in this article we show that V-functionals are quasi-Hadamard differentiable and that therefore a modified version of the FDM (introduced recently in (J. Multivariate Anal. 101 (2010) 2452--2463)) can be applied to this problem. The modified FDM requires weak convergence of a weighted version of the underlying empirical process. The l…
Two key ingredients to carry out inference on the copula of multivariate observations are the empirical copula process and an appropriate resampling scheme for the latter. Among the existing techniques used for i.i.d. observations, the multiplier bootstrap of Rémillard and Scaillet (J. Multivariate Anal. 100 (2009) 377-386) frequently appears to lead to inference procedures with the best finite-sample properties. Bücher and Ruppert (J. Multivariate Anal. 116 (2013) 208-229) recently proposed an extension of this technique to strictly stationary strongly mixing observations by adapting the depe…
In this paper, we obtain some uniform laws of large numbers and functional central limit theorems for sequential empirical measure processes indexed by classes of product functions satisfying appropriate Vapnik-Chervonenkis properties.
This paper has been temporarily withdrawn, pending a revised version taking into account similarities between this paper and the recent work of del Barrio, Gine and Utzet (Bernoulli, 11 (1), 2005, 131-189).
It is well known that the empirical likelihood ratio confidence region suffers finite sample under-coverage issue, and this severely hampers its application in statistical inferences.} The root cause of this under-coverage is an upper limit imposed by the convex hull of the estimating functions that is used in the construction of the profile empirical likelihood. For i.i.d data, various methods have been proposed to solve this issue by modifying the convex hull, but it is not clear how well these methods perform when the data are no longer independent. In this paper, we propose an adjusted blo…
False discovery rate (FDR) has been widely used as an error measure in large scale multiple testing problems, but most research in the area has been focused on procedures for controlling the FDR based on independent test statistics or the properties of such procedures for test statistics with certain types of stochastic dependence. Based on an approach proposed in Tang and Zhang (2005), we further develop in this paper empirical Bayes methods for controlling the FDR with dependent data. We implement our methodology in a time series model and report the results of a simulation study to demonstr…
The empirical copula process plays a central role for statistical inference on copulas. Recently, Segers (2011) investigated the asymptotic behavior of this process under non-restrictive smoothness assumptions for the case of i.i.d. random variables. In the present paper we extend his main result to the case of serial dependent random variables by means of the powerful and elegant functional delta method. Moreover, we utilize the functional delta method in order to obtain conditional consistency of certain bootstrap procedures. Finally, we extend the results to the more general sequential empi…
A weakly dependent time series regression model with multivariate covariates and univariate observations is considered, for which we develop a procedure to detect whether the nonparametric conditional mean function is stable in time against change point alternatives. Our proposal is based on a modified CUSUM type test procedure, which uses a sequential marked empirical process of residuals. We show weak convergence of the considered process to a centered Gaussian process under the null hypothesis of no change in the mean function and a stationarity assumption. This requires some sophisticated …
We incorporate into the empirical measure the auxiliary information given by a finite collection of expectation in an optimal information geometry way. This allows to unify several methods exploiting a side information and to uniquely define an informed empirical measure. These methods are shown to share the same asymptotic properties. Then we study the informed empirical process subject to a true information. We establish the Glivenko-Cantelli and Donsker theorems for the informed empirical measure under minimal assumptions and we quantify the asymptotic uniform variance reduction. Moreover, …
We consider the residual empirical process in random design regression with long memory errors. We establish its limiting behaviour, showing that its rates of convergence are different from the rates of convergence for to the empirical process based on (unobserved) errors. Also, we study a residual empirical process with estimated parameters. Its asymptotic distribution can be used to construct Kolmogorov-Smirnov, Cramér-Smirnov-von Mises, or other goodness-of-fit tests. Theoretical results are justified by simulation studies.
We derive strong approximations to the supremum of the non-centered empirical process indexed by a possibly unbounded VC-type class of functions by the suprema of the Gaussian and bootstrap processes. The bounds of these approximations are non-asymptotic, which allows us to work with classes of functions whose complexity increases with the sample size. The construction of couplings is not of the Hungarian type and is instead based on the Slepian-Stein methods and Gaussian comparison inequalities. The increasing complexity of classes of functions and non-centrality of the processes make the res…
We provide a framework for empirical process theory of locally stationary processes using the functional dependence measure. Our results extend known results for stationary Markov chains and mixing sequences by another common possibility to measure dependence and allow for additional time dependence. Our main result is a functional central limit theorem for locally stationary processes. Moreover, maximal inequalities for expectations of sums are developed. We show the applicability of our theory in some examples, for instance we provide uniform convergence rates for nonparametric regression wi…
The purpose of this note is to provide an approximation for the generalized bootstrapped empirical process achieving the rate in Kolmos et al. (1975). The proof is based on much the same arguments as in Horvath et al. (2000). As a consequence, we establish an approximation of the bootstrapped kernel-type density estimator
We provide an empirical process theory for locally stationary processes over nonsmooth function classes. An important novelty over other approaches is the use of the flexible functional dependence measure to quantify dependence. A functional central limit theorem and nonasymptotic maximal inequalities are provided. The theory is used to prove the functional convergence of the empirical distribution function (EDF) and to derive uniform convergence rates for kernel density estimators both for stationary and locally stationary processes. A comparison with earlier results based on other measures o…
We study the weak convergence of conditional empirical copula processes, when the conditioning event has a nonzero probability. The validity of several bootstrap schemes is stated, including the exchangeable bootstrap. We define general - possibly conditional - multivariate dependence measures and their estimators. By applying our theoretical results, we prove the asymptotic normality of some estimators of such dependence measures.
Regularly varying stochastic processes are able to model extremal dependence between process values at locations in random fields. We investigate the empirical extremogram as an estimator of dependence in the extremes. We provide conditions to ensure asymptotic normality of the empirical extremogram centred by a pre-asymptotic version. For max-stable processes with Fr{é}chet margins we provide conditions such that the empirical extremogram centred by its true version is asymptotically normal. The results of this paper apply to a variety of spatial and space-time processes, and to time series m…
In this paper we investigate an indirect regression model characterized by the Radon transformation. This model is useful for recovery of medical images obtained by computed tomography scans. The indirect regression function is estimated using a series estimator motivated by a spectral cut-off technique. Further, we investigate the empirical process of residuals from this regression, and show that it satsifies a functional central limit theorem.
We study the empirical measure associated to a sample of size $n$ and modified by $N$ iterations of the raking-ratio method. This empirical measure is adjusted to match the true probability of sets in a finite partition which changes each step. We establish asymptotic properties of the raking-ratio empirical process indexed by functions as $n\rightarrow +\infty$, for $N$ fixed. We study nonasymptotic properties by using a Gaussian approximation which yields uniform Berry-Esseen type bounds depending on $n, N$ and provides estimates of the uniform quadratic risk reduction. A closed-form express…
This paper develops asymptotic theory of integrals of empirical quantile functions with respect to random weight functions, which is an extension of classical $L$-statistics. They appear when sample trimming or Winsorization is applied to asymptotically linear estimators. The key idea is to consider empirical processes in the spaces appropriate for integration. First, we characterize weak convergence of empirical distribution functions and random weight functions in the space of bounded integrable functions. Second, we establish the delta method for empirical quantile functions as integrable f…
We develop large sample theory for merged data from multiple sources. Main statistical issues treated in this paper are (1) the same unit potentially appears in multiple datasets from overlapping data sources, (2) duplicated items are not identified, and (3) a sample from the same data source is dependent due to sampling without replacement. We propose and study a new weighted empirical process and extend empirical process theory to a dependent and biased sample with duplication. Specifically, we establish the uniform law of large numbers and uniform central limit theorem over a class of funct…
Let $(X_k)_{k\geq1}$ be a Gaussian long-range dependent process with $EX_1=0$, $EX_1^2=1$ and covariance function $r(k)=k^{-D}L(k)$. For any measurable function $G$ let $(Y_k)_{k\geq1}=(G(X_k))_{k\geq1}$. We study the asymptotic behaviour of the associated sequential empirical process $\left(R_N(x,t)\right)$ with respect to a weighted norm $\|\cdot\|_w$. We show that, after an appropriate normalization, $\left(R_N(x,t)\right)$ converges weakly in the space of càdlàg functions with finite weighted norm to a Hermite process.
We establish empirical quantile process CLTs based on $n$ independent copies of a stochastic process $\{X_t: t \in E\}$ that are uniform in $t \in E$ and quantile levels $α\in I$, where $I$ is a closed sub-interval of $(0,1)$. Typically $E=[0,T]$, or a finite product of such intervals. Also included are CLT's for the empirical process based on $\{I_{X_t \le y} - \rm {Pr}(X_t \le y): t \in E, y \in R \}$ that are uniform in $t \in E, y \in R$. The process $\{X_t: t \in E\}$ may be chosen from a broad collection of Gaussian processes, compound Poisson processes, stationary independent increment …
For stochastic processes $\{X_t:t\in E\}$, we establish sufficient conditions for the empirical process based on $\{I_{X_t\le y}-\operatorname{Pr}(X_t\le y):t\in E,y\in\mathbb{R}\}$ to satisfy the CLT uniformly in $t\in E,y\in\mathbb{R}$. Corollaries of our main result include examples of classical processes where the CLT holds, and we also show that it fails for Brownian motion tied down at zero and $E=[0,1]$.
We define a time dependent empirical process based on $n$ i.i.d.~fractional Brownian motions and establish Gaussian couplings and strong approximations to it by Gaussian processes. They lead to functional laws of the iterated logarithm for this process.
Let $(G(X_j))_{j\geq1}$ be a multivariate subordinated Gaussian process, which exhibits long-range dependence. We study the asymptotic behaviour of the corresponding sequential empirical process under two different types of subordination. The limiting process is either a product of a deterministic function and a Hermite process as in the one-dimensional case or a sum of various processes of this kind.
Drees and Rootzén [2010] have proven central limit theorems (CLT) for empirical processes of extreme values cluster functionals built from $β$-mixing processes. The problem with this family of $β$-mixing processes is that it is quite restrictive, as has been shown by Andrews [1984]. We expand this result to a more general dependent processes family, known as weakly dependent processes in the sense of Doukhan and Louhichi [1999], but in finite-dimensional convergence (fidis). We show an example where the application of the CLT-fidis is sufficient in several cases, including a small simulation o…
We study the Wasserstein distance of order 1 between the empirical distribution and the marginal distribution of stationary $α$-dependent sequences. We prove some moments inequalities of order p for any p $\ge$ 1, and we give some conditions under which the central limit theorem holds. We apply our results to unbounded functions of expanding maps of the interval with a neutral fixed point at zero. The moment inequalities for the Wasserstein distance are similar to the well known von Bahr-Esseen or Rosenthal bounds for partial sums, and seem to be new even in the case of independent and identic…
Let $(U_n(t))_{t\in\R^d}$ be the empirical process associated to an $\R^d$-valued stationary process $(X_i)_{i\ge 0}$. We give general conditions, which only involve processes $(f(X_i))_{i\ge 0}$ for a restricted class of functions $f$, under which weak convergence of $(U_n(t))_{t\in\R^d}$ can be proved. This is particularly useful when dealing with data arising from dynamical systems or functional of Markov chains. This result improves those of [DDV09] and [DD11], where the technique was first introduced, and provides new applications.
For a uniform process $\{ X_t: t\in E\}$ (by which $X_t $ is uniformly distributed on $(0,1)$ for $t\in E$) and a function $w(x)>0$ on $(0,1)$, we give a sufficient condition for the weak convergence of the empirical process based on $\{ w(x)(\mathbb{1}_{X_t\leq x} -x): t\in E, x\in [0,1]\}$ in $\ell^\infty(E\times [0,1])$. When specializing to $w(x)\equiv 1$ and assuming strict monotonicity on the marginal distribution functions of the input process, we recover a result of Kuelbs, Kurtz, and Zinn (2013). In the last section, we give an example of the main theorem.
We define a time dependent empirical process based on $n$ independent fractional Brownian motions and describe strong approximations to it by Gaussian processes. They lead to strong approximations and functional laws of the iterated logarithm for the quantile or inverse of this empirical process. They are obtained via time dependent Bahadur--Kiefer representations.
We investigate concentration properties of spectral measures of Hermitian random matrices with partially dependent entries. More precisely, let $X_n$ be a Hermitian random matrix of size $n\times n$ that can be split into independent blocks of the size at most $d_n=o(n^2)$. We prove that under some mild conditions on the distribution of the entries of $X_n$, the empirical spectral measure of $X_n$ concentrates around its mean. The main theorem is a strengthening of a recent result by Kemp and Zimmerman, where the size of blocks grows as $o(\log n)$. As an application, we are able to upgrade th…
A theorem of Donsker asserts that the empirical process converges in distribution to the Brownian bridge. The aim of this paper is to provide a new and simple proof of this fact.
We study weak convergence of empirical processes of dependent data $(X_i)_{i\geq0}$, indexed by classes of functions. Our results are especially suitable for data arising from dynamical systems and Markov chains, where the central limit theorem for partial sums of observables is commonly derived via the spectral gap technique. We are specifically interested in situations where the index class ${\mathcal{F}}$ is different from the class of functions $f$ for which we have good properties of the observables $(f(X_i))_{i\geq0}$. We introduce a new bracketing number to measure the size of the index…
We consider a class of real random matrices with dependent entries and show that the limiting empirical spectral distribution is given by the Marchenko-Pastur law. Additionally, we establish a rate of convergence of the expected empirical spectral distribution.
This article investigates weak convergence of the sequential $d$-dimensional empirical process under strong mixing. Weak convergence is established for mixing rates $α_n = O(n^{-a})$, where $a>1$, which slightly improves upon existing results in the literature that are based on mixing rates depending on the dimension $d$.
It is known (Hofmann-Credner and Stolz (2008)) that the convergence of the mean empirical spectral distribution of a sample covariance matrix W_n = 1/n Y_n Y_n^t to the Marčenko-Pastur law remains unaffected if the rows and columns of Y_n exhibit some dependence, where only the growth of the number of dependent entries, but not the joint distribution of dependent entries needs to be controlled. In this paper we show that the well-known CLT for traces of powers of W_n also extends to the dependent case.
This paper proves that, under a monotonicity condition, the invariant probability measure of a McKean--Vlasov process can be approximated by weighted empirical measures of some processes including itself. These processes are described by distribution dependent or empirical measure dependent stochastic differential equations constructed from the equation for the McKean--Vlasov process. Convergence of empirical measures is characterized by upper bound estimates for their Wasserstein distance to the invariant measure. The theoretical results are demonstrated via a mean-field Ornstein--Uhlenbeck p…
This paper explores certain kinds of empirical process with respect to the components of multivariate Gaussian. We put forward some finite sample bounds which hold for multivariate Gaussian under general dependence. We give necessary and sufficient condition for the convergence in probability of the random variable sequence $\displaystyle\left\{\sup_t\vert\widehat{F}_n(t)-\mathbf{E}\widehat{F}_n(t)\vert\right\}_{n\in \mathbb{N}}$, where $\widehat{F}_n(t)$ is the empirical distribution. Also, we find a similar sufficient condition for almost surely convergence.
A moderate deviation principle for functionals, with at most quadratic growth, of moving average processes is established. The main assumptions on the moving average process are a Logarithmic Sobolev inequality for the driving random variables and the continuity, or weaker, of the spectral density of the moving average process. We also obtain the moderate deviations for the empirical spectral density, exhibiting an interesting new form of the rate function, i.e. with a correction term compared to the Gaussian rate functionnal.
We consider a mean-field system of path-dependent stochastic interacting diffusions in random media over a finite time window. The interaction term is given as a function of the empirical measure and is allowed to be non-linear and path dependent. We prove that the sequence of empirical measures of the full trajectories satisfies a large deviation principle with explicit rate function. The minimizer of the rate function is characterized as the path-dependent McKean-Vlasov diffusion associated to the system. As corollary, we obtain a strong law of large numbers for the sequence of empirical mea…
Estimation of the $ϕ$-divergence between two unknown probability distributions using empirical data is a fundamental problem in information theory and statistical learning. We consider a multi-variate generalization of the data dependent partitioning method for estimating divergence between the two unknown distributions. Under the assumption that the distribution satisfies a power law of decay, we provide a convergence rate result for this method on the number of samples and hyper-rectangles required to ensure the estimation error is bounded by a given level with a given probability.
Empirical distribution of ancestral lineages in populations with density-dependent interactions
Centre de Mathématiques Appliquées (CMAP), Ecole Polytechnique（巴黎综合理工学院应用数学中心）；Institute of Ecology and Environmental Sciences (iEES), Sorbonne Université（索邦大学生态与环境科学研究所）
Let $(X_j)_{j\geq1}$ be a multivariate long-range dependent Gaussian process. We study the asymptotic behavior of the corresponding sequential empirical process indexed by a class of functions. If some entropy condition is satisfied we have weak convergence to a linear combination of Hermite processes.
This paper studies: (i) the long time behaviour of the empirical distribution of age and normalised position of an age dependent critical branching Markov process conditioned on non-extinction; and (ii) the super-process limit of a sequence of age dependent critical branching Brownian motions.
We proved the strong approximation result for the empirical process derived from its corresponding Schatte model. The corresponding strong approximation rate obtained is 1/16.
A random walk in random scenery $(Y_n)_{n\in\mathbb{N}}$ is given by $Y_n=ξ_{S_n}$ for a random walk $(S_n)_{n\in\mathbb{N}}$ and iid random variables $(ξ_n)_{n\in\mathbb{Z}}$. In this paper, we will show the weak convergence of the sequential empirical process, i.e. the centered and rescaled empirical distribution function. The limit process shows a new type of behavior, combining properties of the limit in the independent case (roughness of the paths) and in the long range dependent case (self-similarity).
