In this paper, we provide a central limit theorem for the finite-dimensional marginal distributions of empirical processes $(Z_n(f))_{f\in\mathcal{F}}$ whose index set $\mathcal{F}$ is a family of cluster functionals valued on blocks of values of a stationary random field. The practicality and applicability of the result depends mainly on the usual Lindeberg condition and a sequence $T_n$ which summarizes the dependence between the blocks of the random field values. Finally, as application, we use the previous result in order to show the Gaussian asymptotic behavior of the iso-extremogram estimator introduced in this paper.
In this paper, a very useful lemma (in two versions) is proved: it simplifies notably the essential step to establish a Lindeberg central limit theorem for dependent processes. Then, applying this lemma to weakly dependent processes introduced in Doukhan and Louhichi (1999), a new central limit theorem is obtained for sample mean or kernel density estimator. Moreover, by using the subsampling, extensions under weaker assumptions of these central limit theorems are provided. All the usual causal or non causal time series: Gaussian, associated, linear, ARCH($\infty$), bilinear, Volterra processe…
This paper makes 3 contributions. First, it generalizes the Lindeberg\textendash Feller and Lyapunov Central Limit Theorems to Hilbert Spaces by way of $L^2$. Second, it generalizes these results to spaces in which sample failure and missingness can occur. Finally, it shows that satisfaction of the Lindeberg\textendash Feller Condition in such spaces guarantees the consistency of all inferences from the partial functional data with respect to the completely observed data. These latter two results are especially important given the increasing attention to statistical inference with partially ob…
The goal of this paper is to describe conditions which guarantee a central limit theorem for random variables, which distributions are controled by hidden Markov chains. We proved that when a Markov chain is ergodic and random variables fullfiled Lindeberg's condition then the Central Limit Theorem is true.
We prove the asymptotic normality of the kernel density estimator (introduced by Rosenblatt (1956) and Parzen (1962)) in the context of stationary strongly mixing random fields. Our approach is based on the Lindeberg's method rather than on Bernstein's small-block-large-block technique and coupling arguments widely used in previous works on nonparametric estimation for spatial processes. Our method allows us to consider only minimal conditions on the bandwidth parameter and provides a simple criterion on the (non-uniform) strong mixing coefficients which do not depend on the bandwith.
This paper deals with the Gaussian and bootstrap approximations to the distribution of the max statistic in high dimensions. This statistic takes the form of the maximum over components of the sum of independent random vectors and its distribution plays a key role in many high-dimensional econometric problems. Using a novel iterative randomized Lindeberg method, the paper derives new bounds for the distributional approximation errors. These new bounds substantially improve upon existing ones and simultaneously allow for a larger class of bootstrap methods.
Non-asymptotic bounds for Gaussian and bootstrap approximation have recently attracted significant interest in high-dimensional statistics. This paper studies Berry-Esseen bounds for such approximations with respect to the multivariate Kolmogorov distance, in the context of a sum of $n$ random vectors that are $p$-dimensional and i.i.d. Up to now, a growing line of work has established bounds with mild logarithmic dependence on $p$. However, the problem of developing corresponding bounds with near $n^{-1/2}$ dependence on $n$ has remained largely unresolved. Within the setting of random vector…
Consider a discrete-time martingale, and let $V^2$ be its normalized quadratic variation. As $V^2$ approaches 1, and provided that some Lindeberg condition is satisfied, the distribution of the rescaled martingale approaches the Gaussian distribution. For any $p\geq 1$, (Ann. Probab. 16 (1988) 275-299) gave a bound on the rate of convergence in this central limit theorem that is the sum of two terms, say $A_p+B_p$, where up to a constant, $A_p={\|V^2-1\|}_p^{p/(2p+1)}$. Here we discuss the optimality of this term, focusing on the restricted class of martingales with bounded increments. In this…
It is shown that the existence of an L^1 co boundary does not imply the quenched version of the central limit theorem. In another result it is shown that Hannan's condition does imply quenched convergence for an appropriately centered version of the sum.
This paper establishes a central limit theorem and an invariance principle for a wide class of stationary random fields under natural and easily verifiable conditions. More precisely, we deal with random fields of the form $X_k = g(\varepsilon_{k-s}, s \in \Z^d)$, $k\in\Z^d$, where $(\varepsilon_i)_{i\in\Z^d}$ are i.i.d random variables and $g$ is a measurable function. Such kind of spatial processes provides a general framework for stationary ergodic random fields. Under a short-range dependence condition, we show that the central limit theorem holds without any assumption on the underlying d…
We obtain central limit theorems for stationary random fields employing a novel measure of dependence called $θ$-lex weak dependence. We show that this dependence notion is more general than strong mixing, i.e., it applies to a broader class of models. Moreover, we discuss hereditary properties for $θ$-lex and $η$-weak dependence and illustrate the possible applications of the weak dependence notions to the study of the asymptotic properties of stationary random fields. Our general results apply to mixed moving average fields (MMAF in short) and ambit fields. We show general conditions such th…
In this paper, we give estimates of ideal or minimal distances between the distribution of the normalized partial sum and the limiting Gaussian distribution for stationary martingale difference sequences or stationary sequences satisfying projective criteria. Applications to functions of linear processes and to functions of expanding maps of the interval are given.
We consider independent random variables (r.v.'s) with a common mean $μ$ that either satisfy Lindeberg's condition, or are symmetric around $μ$. Present forms of existing functional central limit theorems (FCLT's) for Studentized partial sums of such r.v.'s on $D[0,1]$ are seen to be of some use for constructing asymptotic confidence intervals, or what we call functional asymptotic confidence intervals (FACI's), for $μ$. In this paper we establish completely data-based versions of these FCLT's and thus extend their applicability in this regard. Two special examples of new FACI's for $μ$ are pr…
We derive process limit distribution results for the Nelson-Aalen estimator of a hasard function and for the Kaplan-Meier estimator of a distribution function, under different dependence assumptions. The data are assumed to be right censored observations of a stationary time series. We treat weakly dependent as well as long range dependent data, and allow for qualitative differences in the dependence for the censoring times versus the time of interest
We establish a central limit theorem and an invariance principle for stationary random fields, with projective-type conditions. Our result is obtained via an m-dependent approximation method. As applications, we establish invariance principles for orthomartingales and functionals of linear random fields.
The question whether a time series behaves as a random walk or as a station- ary process is an important and delicate problem, particularly arising in financial statistics, econometrics, and engineering. This paper studies the problem to detect sequentially that the error terms in a polynomial regression model no longer behave as a random walk but as a stationary process. We provide the asymptotic distribution theory for a monitoring procedure given by a control chart, i.e., a stopping time, which is related to a well known unit root test statistic calculated from sequentially updated residual…
A general moment bound for sums of products of Gaussian vector's functions extending the moment bound in Taqqu (1977, Lemma 4.5) is established. A general central limit theorem for triangular arrays of nonlinear functionals of multidimensional non-stationary Gaussian sequences is proved. This theorem extends the previous results of Breuer and Major (1981), Arcones (1994) and others. A Berry-Esseen-type bound in the above-mentioned central limit theorem is derived following Nourdin, Peccati and Podolskij (2011). Two applications of the above results are discussed. The first one refers to the as…
We provide a framework for empirical process theory of locally stationary processes using the functional dependence measure. Our results extend known results for stationary Markov chains and mixing sequences by another common possibility to measure dependence and allow for additional time dependence. Our main result is a functional central limit theorem for locally stationary processes. Moreover, maximal inequalities for expectations of sums are developed. We show the applicability of our theory in some examples, for instance we provide uniform convergence rates for nonparametric regression wi…
In this paper some general theory is presented for locally stationary processes based on the stationary approximation and the stationary derivative. Laws of large numbers, central limit theorems as well as deterministic and stochastic bias expansions are proved for processes obeying an expansion in terms of the stationary approximation and derivative. In addition it is shown that this applies to some general nonlinear non-stationary Markov-models. In addition the results are applied to derive the asymptotic properties of maximum likelihood estimates of parameter curves in such models.
In this study, we develop an asymptotic theory of nonparametric regression for a locally stationary functional time series. First, we introduce the notion of a locally stationary functional time series (LSFTS) that takes values in a semi-metric space. Then, we propose a nonparametric model for LSFTS with a regression function that changes smoothly over time. We establish the uniform convergence rates of a class of kernel estimators, the Nadaraya-Watson (NW) estimator of the regression function, and a central limit theorem of the NW estimator.
In this paper, under natural and easily verifiable conditions, we prove the $\mathbb{L}^1$-convergence and the asymptotic normality of the Parzen-Rosenblatt density estimator for stationary random fields of the form $X_k = g\left(\varepsilon_{k-s}, s \in \Z^d \right)$, $k\in\Z^d$, where $(\varepsilon_i)_{i\in\Z^d}$ are i.i.d real random variables and $g$ is a measurable function defined on $\R^{\Z^d}$. Such kind of processes provides a general framework for stationary ergodic random fields. A Berry-Esseen's type central limit theorem is also given for the considered estimator.
We study the problem of nonparametric estimation of the fractional derivative of unknown spectral function of Gaussian stationary sequence (time series) and show that these problems is well posed with the classical speed of convergence when the order of derivative is less than 0.5. We prove also the asymptotical unbiaseness and normality of offered estimates with optimal speed of convergence. For the construction of the confidence region in some functional norm we establish the Central Limit Theorem in correspondent space of continuous functions for offered estimates.
Let $\mathbf{X}_n=(x_{ij})$ be a $k \times n$ data matrix with complex-valued, independent and standardized entries satisfying a Lindeberg-type moment condition. We consider simultaneously $R$ sample covariance matrices $\mathbf{B}_{nr}=\frac1n \mathbf{Q}_r \mathbf{X}_n \mathbf{X}_n^*\mathbf{Q}_r^\top,~1\le r\le R$, where the $\mathbf{Q}_{r}$'s are nonrandom real matrices with common dimensions $p\times k~(k\geq p)$. Assuming that both the dimension $p$ and the sample size $n$ grow to infinity, the limiting distributions of the eigenvalues of the matrices $\{\mathbf{B}_{nr}\}$ are identified, …
There exists a wide literature on modelling strongly dependent time series using a longmemory parameter d, including more recent work on semiparametric wavelet estimation. As a generalization of these latter approaches, in this work we allow the long-memory parameter d to be varying over time. We embed our approach into the framework of locally stationary processes. We show weak consistency and a central limit theorem for our log-regression wavelet estimator of the time-dependent d in a Gaussian context. Both simulations and a real data example complete our work on providing a fairly general a…
In this paper, we survey some recent results on statistical inference (parametric and nonparametric statistical estimation, hypotheses testing) about the spectrum of stationary models with tapered data, as well as, a question concerning robustness of inferences, carried out on a linear stationary process contaminated by a small trend. We also discuss some question concerning tapered Toeplitz matrices and operators, central limit theorems for tapered Toeplitz type quadratic functionals, and tapered Fejér-type kernels and singular integrals. These are the main tools for obtaining the correspondi…
National Chen-Kung University（国立成功大学）；National Chiao Tung University（国立交通大学）；Duke University（杜克大学）；National Center for Theoretical Sciences（国家理论科学中心）
Motivated by analyzing complicated and non-stationary time series, we study a generalization of the scattering transform (ST) that includes broad neural activation functions, which is called neural activation ST (NAST). On the whole, NAST is a transform that comprises a sequence of ``neural processing units'', each of which applies a high pass filter to the input from the previous layer followed by a composition with a nonlinear function as the output to the next neuron. Here, the nonlinear function models how a neuron gets excited by the input signal. In addition to showing properties like no…
Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
Department of Statistics, University of Chicago（芝加哥大学统计系）；Department of Statistics and Data Science, Washington University in St. Louis（圣路易斯华盛顿大学统计与数据科学系）
In this paper, we study central and non-central limit theorems for partial sum of functionals of general stationary Gaussian fields. We apply our result to study drift parameter estimation problems for some stochastic differential equations related to stationary Gaussian processes.
We study rates of convergence in central limit theorems for partial sum of functionals of general stationary and non-stationary Gaussian sequences, using optimal tools from analysis on Wiener space. We apply our result to study drift parameter estimation problems for some stochastic differential equations driven by fractional Brownian motion with fixed-time-step observations.
