In this paper, we obtain some uniform laws of large numbers and functional central limit theorems for sequential empirical measure processes indexed by classes of product functions satisfying appropriate Vapnik-Chervonenkis properties.
The receiver operating characteristic (ROC) curve, the positive predictive value (PPV) curve and the negative predictive value (NPV) curve are three measures of performance for a continuous diagnostic biomarker. The ROC, PPV and NPV curves are often estimated empirically to avoid assumptions about the distributional form of the biomarkers. Recently, there has been a push to incorporate group sequential methods into the design of diagnostic biomarker studies. A thorough understanding of the asymptotic properties of the sequential empirical ROC, PPV and NPV curves will provide more flexibility w…
The empirical copula process plays a central role for statistical inference on copulas. Recently, Segers (2011) investigated the asymptotic behavior of this process under non-restrictive smoothness assumptions for the case of i.i.d. random variables. In the present paper we extend his main result to the case of serial dependent random variables by means of the powerful and elegant functional delta method. Moreover, we utilize the functional delta method in order to obtain conditional consistency of certain bootstrap procedures. Finally, we extend the results to the more general sequential empi…
We give two asymptotic results for the empirical distance covariance on separable metric spaces without any iid assumption on the samples. In particular, we show the almost sure convergence of the empirical distance covariance for any measure with finite first moments, provided that the samples form a strictly stationary and ergodic process. We further give a result concerning the asymptotic distribution of the empirical distance covariance under the assumption of absolute regularity of the samples and extend these results to certain types of pseudometric spaces. In the process, we derive a ge…
Two key ingredients to carry out inference on the copula of multivariate observations are the empirical copula process and an appropriate resampling scheme for the latter. Among the existing techniques used for i.i.d. observations, the multiplier bootstrap of Rémillard and Scaillet (J. Multivariate Anal. 100 (2009) 377-386) frequently appears to lead to inference procedures with the best finite-sample properties. Bücher and Ruppert (J. Multivariate Anal. 116 (2013) 208-229) recently proposed an extension of this technique to strictly stationary strongly mixing observations by adapting the depe…
The aim of sequential change-point detection is to issue an alarm when it is thought that certain probabilistic properties of the monitored observations have changed. This work is concerned with nonparametric, closed-end testing procedures based on differences of empirical distribution functions that are designed to be particularly sensitive to changes in the comtemporary distribution of multivariate time series. The proposed detectors are adaptations of statistics used in a posteriori (offline) change-point testing and involve a weighting allowing to give more importance to recent observation…
Nonparametric tests for equality of multivariate distributions are frequently desired in research. It is commonly required that test-procedures based on relatively small samples of vectors accurately control the corresponding Type I Error (TIE) rates. Often, in the multivariate testing, extensions of null-distribution-free univariate methods, e.g., Kolmogorov-Smirnov and Cramer-von Mises type schemes, are not exact, since their null distributions depend on underlying data distributions. The present paper extends the density-based empirical likelihood technique in order to nonparametrically app…
In health-related experiments, treatment effects can be identified using paired data that consist of pre- and post-treatment measurements. In this framework, sequential testing strategies are widely accepted statistical tools in practice. Since performances of parametric sequential testing procedures vitally depend on the validity of the parametric assumptions regarding underlying data distributions, we focus on distribution-free mechanisms for sequentially evaluating treatment effects. In fixed sample size designs, the density-based empirical likelihood (DBEL) methods provide powerful nonpara…
In applications the properties of a stochastic feature often change gradually rather than abruptly, that is: after a constant phase for some time they slowly start to vary. In this paper we discuss statistical inference for the detection and the localisation of gradual changes in the jump characteristic of a discretely observed Ito semimartingale. We propose a new measure of time variation for the jump behaviour of the process. The statistical uncertainty of a corresponding estimate is analyzed by deriving new results on the weak convergence of a sequential empirical tail integral process and …
In the following article we consider the time-stability associated to the sequential Monte Carlo (SMC) estimate of the backward interpretation of Feynman-Kac Formulae. This is particularly of interest in the context of performing smoothing for hidden Markov models (HMMs). We prove a central limit theorem (CLT) under weaker assumptions than adopted in the literature. We then show that the associated asymptotic variance expression, for additive functionals grows at most linearly in time, under hypotheses that are weaker than those currently existing in the literature. The assumptions are verifie…
We propose a class of tests for linear regression on concomitants (induced order statistics). These tests are based on sequential sums of regression residuals. We self-center and self-normalize these sums. The resulting process is called an empirical bridge. We prove weak convergence of the empirical bridge in uniform metrics to a centered Gaussian process. The proposed tests are of chi-square type.
A weakly dependent time series regression model with multivariate covariates and univariate observations is considered, for which we develop a procedure to detect whether the nonparametric conditional mean function is stable in time against change point alternatives. Our proposal is based on a modified CUSUM type test procedure, which uses a sequential marked empirical process of residuals. We show weak convergence of the considered process to a centered Gaussian process under the null hypothesis of no change in the mean function and a stationarity assumption. This requires some sophisticated …
We present a unified technique for sequential estimation of convex divergences between distributions, including integral probability metrics like the kernel maximum mean discrepancy, $φ$-divergences like the Kullback-Leibler divergence, and optimal transport costs, such as powers of Wasserstein distances. This is achieved by observing that empirical convex divergences are (partially ordered) reverse submartingales with respect to the exchangeable filtration, coupled with maximal inequalities for such processes. These techniques appear to be complementary and powerful additions to the existing …
A non parametric method based on the empirical likelihood is proposed for detecting the change in the coefficients of high-dimensional linear model where the number of model variables may increase as the sample size increases. This amounts to testing the null hypothesis of no change against the alternative of one change in the regression coefficients. Based on the theoretical asymptotic behaviour of the empirical likelihood ratio statistic, we propose, for a fixed design, a simpler test statistic, easier to use in practice. The asymptotic normality of the proposed test statistic under the null…
This article investigates weak convergence of the sequential $d$-dimensional empirical process under strong mixing. Weak convergence is established for mixing rates $α_n = O(n^{-a})$, where $a>1$, which slightly improves upon existing results in the literature that are based on mixing rates depending on the dimension $d$.
Let $(X_k)_{k\geq1}$ be a Gaussian long-range dependent process with $EX_1=0$, $EX_1^2=1$ and covariance function $r(k)=k^{-D}L(k)$. For any measurable function $G$ let $(Y_k)_{k\geq1}=(G(X_k))_{k\geq1}$. We study the asymptotic behaviour of the associated sequential empirical process $\left(R_N(x,t)\right)$ with respect to a weighted norm $\|\cdot\|_w$. We show that, after an appropriate normalization, $\left(R_N(x,t)\right)$ converges weakly in the space of càdlàg functions with finite weighted norm to a Hermite process.
Let $(X_j)_{j\geq1}$ be a multivariate long-range dependent Gaussian process. We study the asymptotic behavior of the corresponding sequential empirical process indexed by a class of functions. If some entropy condition is satisfied we have weak convergence to a linear combination of Hermite processes.
Let $(G(X_j))_{j\geq1}$ be a multivariate subordinated Gaussian process, which exhibits long-range dependence. We study the asymptotic behaviour of the corresponding sequential empirical process under two different types of subordination. The limiting process is either a product of a deterministic function and a Hermite process as in the one-dimensional case or a sum of various processes of this kind.
The purpose of this paper is to prove a weak convergence result for empirical processes indexed in general classes of functions and with an underlying $α$-mixing sequence of random variables. In particular the uniformly boundedness assumption on the function class, which is required in most of the existing literature, is spared. Furthermore under strict stationarity a weak convergence result for the sequential empirical process indexed in function classes is obtained, as a direct consequence. Two examples in mathematical statistics, that cannot be treated with existing results, are given as po…
A random walk in random scenery $(Y_n)_{n\in\mathbb{N}}$ is given by $Y_n=ξ_{S_n}$ for a random walk $(S_n)_{n\in\mathbb{N}}$ and iid random variables $(ξ_n)_{n\in\mathbb{Z}}$. In this paper, we will show the weak convergence of the sequential empirical process, i.e. the centered and rescaled empirical distribution function. The limit process shows a new type of behavior, combining properties of the limit in the independent case (roughness of the paths) and in the long range dependent case (self-similarity).
We investigate the convergence in distribution of sequential empirical processes of dependent data indexed by a class of functions F. Our technique is suitable for processes that satisfy a multiple mixing condition on a space of functions which differs from the class F. This situation occurs in the case of data arising from dynamical systems or Markov chains, for which the Perron--Frobenius or Markov operator, respectively, has a spectral gap on a restricted space. We provide applications to iterative Lipschitz models that contract on average.
The asymptotic behaviour of the distribution of the squared singular values of the sample autocovariance matrix between the past and the future of a high-dimensional complex Gaussian uncorrelated sequence is studied. Using Gaussian tools, it is established the distribution behaves as a deterministic probability measure whose support S is characterized. It is also established that the singular values to the square are almost surely located in a neighbourhood of S.
This article examines large time behaviour of finite state mean-field interacting particle systems. Our first main result is a sharp estimate (in the exponential scale) on the time required for convergence of the empirical measure process of the $N$-particle system to its invariant measure; we show that when time is of the order of $\exp\{NΛ\}$ for a suitable constant $Λ\geq 0$, the process has mixed well and it is close to its invariant measure. We then obtain large-$N$ asymptotics of the second largest eigenvalue of the generator associated with the empirical measure process when it is rever…