We establish the Bahadur representation of sample quantiles for linear and some widely used nonlinear processes. Local fluctuations of empirical processes are discussed. Applications to the trimmed and Winsorized means are given. Our results extend previous ones by establishing sharper bounds under milder conditions and thus provide new insight into the theory of empirical processes for dependent random variables.
We obtain a Bahadur representation for sample quantiles of nonlinear functional of Gaussian sequences with correlation function decreasing as $k^{-α}$ for some $α> 0$. This representation is derived under a mimimal assumption.
In this paper we consider quantile and Bahadur-Kiefer processes for long range dependent linear sequences. These processes, unlike in previous studies, are considered on the whole interval $(0,1)$. As it is well-known, quantile processes can have very erratic behavior on the tails. We overcome this problem by considering these processes with appropriate weight functions. In this way we conclude strong approximations that yield some remarkable phenomena that are not shared with i.i.d. sequences, including weak convergence of the Bahadur-Kiefer processes, a different pointwise behavior of the ge…
On the one hand, we investigate the Bahadur representation for sample quantiles under $φ$-mixing sequence with $φ(n)=O(n^{-3})$ and obtain a rate as $O(n^{-\frac{3}{4}}\log n)$, $a.s.$. On the other hand, by relaxing the condition of mixing coefficients to $\sum\nolimits_{n=1}^\inftyφ^{1/2}(n)<\infty$, a rate $O(n^{-1/2}(\log n)^{1/2})$, $a.s.$, is also obtained.
In this paper, we establish the Bahadur--Kiefer representation for sample quantiles for a class of weakly dependent linear processes. The rate of approximation is the same as for i.i.d. sequences and is thus optimal.
In this paper, the Bahadur representation of sample quantiles based on associated sequences is established under polynomially decaying of covariances. The rate of approximation depends on the covariances decay degree and becomes close to the optimal rate obtained under independence when the covariances decrease fastly to 0.
We establish the Bahadur representation of sample quantiles for stabilizing score functionals in stochastic geometry and study local fluctuations of the corresponding empirical distribution function. The scores are obtained from a Poisson process. We apply the results to trimmed and Winsorized means of the score functionals and establish a law of the iterated logarithm for the sample quantiles of the scores.
U-quantiles are applied in robust statistics, like the Hodges-Lehmann estimator of location for example. They have been analyzed in the case of independent random variables with the help of a generalized Bahadur representation. Our main aim is to extend these results to U-quantiles of strongly mixing random variables and functionals of absolutely regular sequences. We obtain the central limit theorem and the law of the iterated logarithm for U-quantiles as straightforward corollaries. Furthermore, we improve the existing result for sample quantiles of mixing data.
This paper investigates the bias and the weak Bahadur representation of a local polynomial estimator of the conditional quantile function and its derivatives. The bias and Bahadur remainder term are studied uniformly with respect to the quantile level, the covariates and the smoothing parameter. The order of the local polynomial estimator can be higher than the differentiability order of the conditional quantile function. Applications of the results deal with global optimal consistency rates of the local polynomial quantile estimator, performance of random bandwidths and estimation of the cond…
In this paper, we establish a uniform error rate of a Bahadur representation for local polynomial estimators of quantile regression functions. The error rate is uniform over a range of quantiles, a range of evaluation points in the regressors, and over a wide class of probabilities for observed random variables. Most of the existing results on Bahadur representations for local polynomial quantile regression estimators apply to the fixed data generating process. In the context of testing monotonicity where the null hypothesis is of a complex composite hypothesis, it is particularly relevant to …
A new multivariate concept of quantile, based on a directional version of Koenker and Bassett's traditional regression quantiles, is introduced for multivariate location and multiple-output regression problems. In their empirical version, those quantiles can be computed efficiently via linear programming techniques. Consistency, Bahadur representation and asymptotic normality results are established. Most importantly, the contours generated by those quantiles are shown to coincide with the classical halfspace depth contours associated with the name of Tukey. This relation does not only allow f…
In this paper we study strong approximations (invariance principles) of the sequential uniform and general Bahadur--Kiefer processes of long-range dependent sequences. We also investigate the strong and weak asymptotic behavior of the sequential Vervaat process, that is, the integrated sequential Bahadur--Kiefer process, properly normalized, as well as that of its deviation from its limiting process, the so-called Vervaat error process. It is well known that the Bahadur--Kiefer and the Vervaat error processes cannot converge weakly in the i.i.d. case. In contrast to this, we conclude that the …
This paper is devoted to the introduction of a new class of consistent estimators of the fractal dimension of locally self-similar Gaussian processes. These estimators are based on convex combinations of sample quantiles of discrete variations of a sample path over a discrete grid of the interval $[0,1]$. We derive the almost sure convergence and the asymptotic normality for these estimators. The key-ingredient is a Bahadur representation for sample quantiles of non-linear functions of Gaussians sequences with correlation function decreasing as $k^{-α}L(k)$ for some $α>0$ and some slowly varyi…
It is proved that the information divergence statistic is infinitely more Bahadur efficient than the power divergence statistics of the orders $α>1$ as long as the sequence of alternatives is contiguous with respect to the sequence of null-hypotheses and the the number of observations per bin increases to infinity is not very slow. This improves the former result in Harremoës and Vajda (2008) where the the sequence of null-hypotheses was assumed to be uniform and the restrictions on on the numbers of observations per bin were sharper. Moreover, this paper evaluates also the Bahadur efficiency …
We investigate asymptotic properties of least-absolute-deviation or median quantile estimates of the location and scale functions in nonparametric regression models with dependent data from multiple subjects. Under a general dependence structure that allows for longitudinal data and some spatially correlated data, we establish uniform Bahadur representations for the proposed median quantile estimates. The obtained Bahadur representations provide deep insights into the asymptotic behavior of the estimates. Our main theoretical development is based on studying the modulus of continuity of kernel…
We define the quantile set of order $α\in \left[ 1/2,1\right) $ associated to a law $P$ on $\mathbb{R}^{d}$ to be the collection of its directional quantiles seen from an observer $O\in \mathbb{R}^{d}$. Under minimal assumptions these star-shaped sets are closed surfaces, continuous in $(O,α)$ and the collection of empirical quantile surfaces is uniformly consistent.\ Under mild assumptions -- no density or symmetry is required for $P$ -- our uniform central limit theorem reveals the correlations between quantile points and a non asymptotic Gaussian approximation provides joint confident enlar…
Population quantiles and their functions are important parameters in many applications. For example, the lower quantiles often serve as crucial quality indices for forestry products. Given several independent samples from populations satisfying the density ratio model, we investigate the properties of empirical likelihood (EL) based inferences. The induced EL quantile estimators are shown to admit a Bahadur representation that leads to asymptotically valid confidence intervals for functions of quantiles. We rigorously prove that EL quantiles based on all the samples are more efficient than emp…
A collection of quantile curves provides a complete picture of conditional distributions. Properly centered and scaled versions of estimated curves at various quantile levels give rise to the so-called quantile regression process (QRP). In this paper, we establish weak convergence of QRP in a general series approximation framework, which includes linear models with increasing dimension, nonparametric models and partial linear models. An interesting consequence is obtained in the last class of models, where parametric and non-parametric estimators are shown to be asymptotically independent. App…
A new quantile regression concept, based on a directional version of Koenker and Bassett's traditional single-output one, has been introduced in [Ann. Statist. (2010) 38 635-669] for multiple-output location/linear regression problems. The polyhedral contours provided by the empirical counterpart of that concept, however, cannot adapt to unknown nonlinear and/or heteroskedastic dependencies. This paper therefore introduces local constant and local linear (actually, bilinear) versions of those contours, which both allow to asymptotically recover the conditional halfspace depth contours that com…
We consider quantile regression processes from censored data under dependent data structures and derive a uniform Bahadur representation for those processes. We also consider cases where the dimension of the parameter in the quantile regression model is large. It is demonstrated that traditional penalized estimators such as the adaptive lasso yield sub-optimal rates if the coefficients of the quantile regression cross zero. New penalization techniques are introduced which are able to deal with specific problems of censored data and yield estimates with an optimal rate. In contrast to most of t…
Generalized linear statistics are an unifying class that contains U-statistics, U-quantiles, L-statistics as well as trimmed and winsorized U-statistics. For example, many commonly used estimators of scale fall into this class. GL-statistics only have been studied under independence; in this paper, we develop an asymptotic theory for GL-statistics of sequences which are strongly mixing or L^1 near epoch dependent on an absolutely regular process. For this purpose, we prove an almost sure approximation of the empirical U-process by a Gaussian process. With the help of a generalized Bahadur repr…
Traditionally, assessing the accuracy of inference based on regression quantiles has relied on the Bahadur representation. This provides an error of order $n^{-1/4}$ in normal approximations, and suggests that inference based on regression quantiles may not be as reliable as that based on other (smoother) approaches, whose errors are generally of order $n^{-1/2}$ (or better in special symmetric cases). Fortunately, extensive simulations and empirical applications show that inference for regression quantiles shares the smaller error rates of other procedures. In fact, the "Hungarian" constructi…
Generalized linear (GL-) statistics are defined as functionals of an U-quantile process and unify different classes of statistics such as U-statistics and L-statistics. We derive a central limit theorem for GL-statistics of strongly mixing sequences and arbitrary dimension of the underlying kernel. For this purpose we establish a limit theorem for U-statistics and an invariance principle for U-processes together with a convergence rate for the remaining term of the Bahadur representation. An application is given by the generalized median estimator for the tail-parameter of the Pareto distribut…
We establish the validity of the empirical Edgeworth expansion (EE) for a studentized trimmed mean, under the sole condition that the underlying distribution function of the observations satisfies a local smoothness condition near the two quantiles where the trimming occurs. A simple explicit formula for the N^{-1/2} term (correcting for skewness and bias; N being the sample size) of the EE is given. In particular our result supplements previous work by P. Hall and A.R. Padmanabhan, On the bootstrap and the trimmed mean}, J. of Multivariate Analysis, v. 41 (1992), pp. 132-153. and H. Putter an…
We establish a functional limit law of the logarithm for the increments of the normed quantile process based upon a random sample of size $n\to\infty$. We extend a limit law obtained by Deheuvels and Mason (12), showing that their results hold uniformly over the bandwidth $h$, restricted to vary in $[h'_n,h''_n]$, where $\{h'_n\}_{n\geq1}$ and $\{h''_n\}_{n\geq 1}$ are appropriate non-random sequences. We treat the case where the sample observations follow possibly non-uniform distributions. As a consequence of our theorems, we provide uniform limit laws for nearest-neighbor density estimators…
We propose confidence sequences -- sequences of confidence intervals which are valid uniformly over time -- for quantiles of any distribution over a complete, fully-ordered set, based on a stream of i.i.d. observations. We give methods both for tracking a fixed quantile and for tracking all quantiles simultaneously. Specifically, we provide explicit expressions with small constants for intervals whose widths shrink at the fastest possible $\sqrt{t^{-1} \log\log t}$ rate, along with a non-asymptotic concentration inequality for the empirical distribution function which holds uniformly over time…
We consider multivariate copula-based stationary time-series under Gaussian subordination. Observed time series are subordinated to long-range dependent Gaussian processes and characterized by arbitrary marginal copula distributions. First of all, we establish limit theorems for the marginal and quantile marginal empirical processes of multivariate stationary long-range dependent sequences under Gaussian subordination. Furthermore, we establish the asymptotic behavior of sequential empirical copula processes under non-restrictive smoothness assumptions. The limiting processes in the case of lo…
Robust Nonparametric Methods for $α$-Mixing Sequences via Median-of-Means
HUN-REN Alfréd Rényi Institute of Mathematics（HUN-REN 阿尔弗雷德·雷尼数学研究所）；Budapest University of Technology and Economics（布达佩斯技术与经济大学）；HUN-REN Wigner Research Centre for Physics（HUN-REN 维格纳物理研究中心）
The well-known Komlós-Major-Tusnády inequalities [Z. Wahrsch. Verw. Gebiete 32 (1975) 111-131; Z. Wahrsch. Verw. Gebiete 34 (1976) 33-58] provide sharp inequalities to partial sums of iid standard exponential random variables by a sequence of standard Brownian motions. In this paper, we employ these results to establish Gaussian approximations to weighted increments of uniform empirical and quantile processes. This approach provides rates to the approximations which, among others, have direct applications to statistics of extreme values for randomly censored data.
We consider a design problem where experimental conditions (design points $X_i$) are presented in the form of a sequence of i.i.d.\ random variables, generated with an unknown probability measure $μ$, and only a given proportion $α\in(0,1)$ can be selected. The objective is to select good candidates $X_i$ on the fly and maximize a concave function $Φ$ of the corresponding information matrix. The optimal solution corresponds to the construction of an optimal bounded design measure $ξ_α^*\leq μ/α$, with the difficulty that $μ$ is unknown and $ξ_α^*$ must be constructed online. The construction p…
The Forward Search is an iterative algorithm for avoiding outliers in a regression analysis suggested by Hadi and Simonoff (J. Amer. Statist. Assoc. 88 (1993) 1264-1272), see also Atkinson and Riani (Robust Diagnostic Regression Analysis (2000) Springer). The algorithm constructs subsets of "good" observations so that the size of the subsets increases as the algorithm progresses. It results in a sequence of regression estimators and forward residuals. Outliers are detected by monitoring the sequence of forward residuals. We show that the sequences of regression estimators and forward residuals…
The class of Generalized $L$-statistics ($GL$-statistics) unifies a broad class of different estimators, for example scale estimators based on multivariate kernels. $GL$-statistics are functionals of $U$-quantiles and therefore the dimension of the kernel of the $U$-quantiles determines the kernel dimension of the estimator. Up to now only few results for multivariate kernels are known. Additionally, most theory was established under independence or for short range dependent processes. In this paper we establish a central limit theorem for $GL$-statistics of functionals of short range dependen…
