GARCH models are useful tools in the investigation of phenomena, where volatility changes are prominent features, like most financial data. The parameter estimation via quasi maximum likelihood (QMLE) and its properties are by now well understood. However, there is a gap between practical applications and the theory, as in reality there are usually not enough observations for the limit results to be valid approximations. We try to fill this gap by this paper, where the properties of a recent bootstrap methodology in the context of GARCH modeling are revealed. The results are promising as it turns out that this remarkably simple method has essentially the same limit distribution, as the original estimatorwith the advantage of easy confidence interval construction, as it is demonstrated in the paper.
The finite-sample properties of the suggested estimators are investigated through a simulation study, which ensures that the results are practically applicable for sample sizes as low as a thousand. On the other hand, the results are not 100% accurate until sample size reaches 100 thousands - but it is shown that this property is not a feature of our bootstrap procedure only, as it is shared by the original QMLE, too.
The quasi-maximum likelihood estimation is a commonly-used method for estimating GARCH parameters. However, such estimators are sensitive to outliers and their asymptotic normality is proved under the finite fourth moment assumption on the underlying error distribution. In this paper, we propose a novel class of estimators of the GARCH parameters based on ranks, called R-estimators, with the property that they are asymptotic normal under the existence of a more than second moment of the errors and are highly efficient. We also consider the weighted bootstrap approximation of the finite sample …
This paper investigates the asymptotic theory of the quasi-maximum exponential likelihood estimators (QMELE) for ARMA--GARCH models. Under only a fractional moment condition, the strong consistency and the asymptotic normality of the global self-weighted QMELE are obtained. Based on this self-weighted QMELE, the local QMELE is showed to be asymptotically normal for the ARMA model with GARCH (finite variance) and IGARCH errors. A formal comparison of two estimators is given for some cases. A simulation study is carried out to assess the performance of these estimators, and a real example on the…
We consider a class of M-estimators of the parameters of a GARCH (p,q) model. These estimators involve score functions and, for adequate choices of the score functions, are asymptotically normal under milder moment assumptions than the usual quasi maximum likelihood, which makes them more reliable in the presence of heavy tails. We also consider weighted bootstrap approximations of the distributions of these M-estimators and establish their validity. Through extensive simulations, we demonstrate the robustness of these M-estimators under heavy tails and conduct a comparative study of the perfo…
We provide novel characterizations of multivariate normality that incorporate both the characteristic function and the moment generating function, and we employ these results to construct a class of affine invariant, consistent and easy-to-use goodness-of-fit tests for normality. The test statistics are suitably weighted $L^2$-statistics, and we provide their asymptotic behavior both for i.i.d. observations as well as in the context of testing that the innovation distribution of a multivariate GARCH model is Gaussian. We also study the finite-sample behavior of the new tests and compare the ne…
We generalize a recent class of tests for univariate normality that are based on the empirical moment generating function to the multivariate setting, thus obtaining a class of affine invariant, consistent and easy-to-use goodness-of-fit tests for multinormality. The test statistics are suitably weighted $L^2$-statistics, and we provide their asymptotic behavior both for i.i.d. observations as well as in the context of testing that the innovation distribution of a multivariate GARCH model is Gaussian. We study the finite-sample behavior of the new tests, compare the criteria with alternative e…
This paper is mainly concerned with asymptotic studies of weighted bootstrap for u- and v-statistics. We derive the consistency of the weighted bootstrap u- and v-statistics, based on i.i.d. and non i.i.d. observations, from some more general results which we first establish for sums of randomly weighted arrays of random variables. Some of the results in this paper significantly extend some well-known results on consistency of u-statistics and also consistency of sums of arrays of random variables. We also employ a new approach to conditioning to derive a conditional CLT for weighted bootstrap…
The bootstrap variance estimate is widely used in semiparametric inferences. However, its theoretical validity is a well known open problem. In this paper, we provide a {\em first} theoretical study on the bootstrap moment estimates in semiparametric models. Specifically, we establish the bootstrap moment consistency of the Euclidean parameter which immediately implies the consistency of $t$-type bootstrap confidence set. It is worth pointing out that the only additional cost to achieve the bootstrap moment consistency in contrast with the distribution consistency is to simply strengthen the $…
Statistical inference in competing risks models is often based on the famous Aalen-Johansen estimator. Since the corresponding limit process lacks independent increments, it is typically applied together with Lin's (1997) resampling technique involving standard normal multipliers. Recently, it has been seen that this approach can be interpreted as a wild bootstrap technique and that other multipliers, as e.g. centered Poissons, may lead to better finite sample performances, see Beyersmann et al. (2013). Since the latter is closely related to Efron's classical bootstrap, the question arises whe…
We propose a nonparametric bootstrap procedure for two-phase stratified sampling without replacement. In this design, a weighted likelihood estimator is known to have smaller asymptotic variance than under the convenient assumption of independence often made in practice. Variance estimation, however, has not been well studied for semiparametric models where variance may not have a closed form. Motivated by semiparametric inference, we establish conditional weak convergence of bootstrap inverse probability weighted empirical processes with several variants of calibration. Two main obstacles to …
Institute for Computer Science and Control (SZTAKI)（计算机科学与控制研究所（SZTAKI））；Hungarian Academy of Sciences (MTA)（匈牙利科学院（MTA））
A standard model of (conditional) heteroscedasticity, i.e., the phenomenon that the variance of a process changes over time, is the Generalized AutoRegressive Conditional Heteroskedasticity (GARCH) model, which is especially important for economics and finance. GARCH models are typically estimated by the Quasi-Maximum Likelihood (QML) method, which works under mild statistical assumptions. Here, we suggest a finite sample approach, called ScoPe, to construct distribution-free confidence regions around the QML estimate, which have exact coverage probabilities, despite no additional assumptions …
Particle island models (Vergé et al., 2013) provide a means of parallelization of sequential Monte Carlo methods, and in this paper we present novel convergence results for algorithms of this sort. In particular we establish a central limit theorem - as the number of islands and the common size of the islands tend jointly to infinity - of the double bootstrap algorithm with possibly adaptive selection on the island level. For this purpose we introduce a notion of archipelagos of weighted islands and find conditions under which a set of convergence properties are preserved by different operatio…
This paper presents applications of the peaks-over threshold methodology for both the univariate and the recently introduced bivariate case, combined with a novel bootstrap approach. We compare the proposed bootstrap methods to the more traditional profile likelihood. We have investigated 63 years of the European Climate Assessment daily precipitation data for five Hungarian grid points, first separately for the summer and winter months, then aiming at the detection of possible changes by investigating 20 years moving windows. We show that significant changes can be observed both in the univar…
The role played by the composite analogue of the log likelihood ratio in hypothesis testing and in setting confidence regions is not as prominent as it is in the canonical likelihood setting, since its asymptotic distribution depends on the unknown parameter. Approximate pivots based on the composite log likelihood ratio can be derived by using asymptotic arguments. However, the actual distribution of such pivots may differ considerably from the asymptotic reference, leading to tests and confidence regions whose levels are distant from the nominal ones. The use of bootstrap rather than asympto…
In a two-stage cluster sampling procedure, $n$ random populations are drawn independently from independent populations and a sub-sample of observations is taken in each of them. The estimator of the general mean of the observed variables is asymptotically Gaussian and the asymptotic distributions of several bootstrap versions of the normalized and studentized statistics are studied. A weighted population resampling provides a good approximation and its accuracy depends on the convergence rate of the sample size of the populations.
Estimating conditional quantiles of financial time series is essential for risk management and many other applications in finance. It is well-known that financial time series display conditional heteroscedasticity. Among the large number of conditional heteroscedastic models, the generalized autoregressive conditional heteroscedastic (GARCH) process is the most popular and influential one. So far, feasible quantile regression methods for this task have been confined to a variant of the GARCH model, the linear GARCH model, owing to its tractable conditional quantile structure. This paper consid…
The process comparing the empirical cumulative distribution function of the sample with a parametric estimate of the cumulative distribution function is known as the empirical process with estimated parameters and has been extensively employed in the literature for goodness-of-fit testing. The simplest way to carry out such goodness-of-fit tests, especially in a multivariate setting, is to use a parametric bootstrap. Although very easy to implement, the parametric bootstrap can become very computationally expensive as the sample size, the number of parameters, or the dimension of the data incr…
Motivated by challenges on studying a new correlation measurement being popularized in evaluating online ranking algorithms' performance, this manuscript explores the validity of uncertainty assessment for weighted U-statistics. Without any commonly adopted assumption, we verify Efron's bootstrap and a new resampling procedure's inference validity. Specifically, in its full generality, our theory allows both kernels and weights asymmetric and data points not identically distributed, which are all new issues that historically have not been addressed. For achieving strict generalization, for exa…
We consider the problem of quantifying uncertainty for the estimation error of the leading eigenvector from Oja's algorithm for streaming principal component analysis, where the data are generated IID from some unknown distribution. By combining classical tools from the U-statistics literature with recent results on high-dimensional central limit theorems for quadratic forms of random vectors and concentration of matrix products, we establish a weighted $χ^2$ approximation result for the $\sin^2$ error between the population eigenvector and the output of Oja's algorithm. Since estimating the c…
In this work, we derive an Edgeworth expansion for the Bernoulli weighted mean $\hatμ = \frac{\sum_{i=1}^n Y_i T_i}{\sum_{i=1}^n T_i}$ in the case where $Y_1, \dots, Y_n$ are i.i.d. non semi-lattice random variables and $T_1, \dots, T_n$ are Bernoulli distributed random variables with parameter $p$. We also define the notion of a semi-lattice distribution, which gives a more geometrical equivalence to the classical Cramér's condition in dimensions bigger than 1. Our result provides a first step into the generalization of classical Edgeworth expansion theorems for random vectors that contain bo…
Standard statistical methods that do not take proper account of the complexity of survey design can lead to erroneous inferences when applied to survey data due to unequal selection probabilities, clustering, and other design features. In particular, the actual type I error rates of tests of hypotheses using standard methods can be much bigger than the nominal significance level. Methods that take account of survey design features in testing hypotheses have been proposed, including Wald tests and quasi-score tests that involve the estimated covariance matrices of parameter estimates. In this p…
The validity of various bootstrapping methods has been proved for the sample mean of strongly mixing data. But in many applications, there appear nonlinear statistics of processes that are not strongly mixing. We investigate the nonoverlapping block bootstrap sequences which are near epoch dependent on strong mixing or absolutely regular processes. This includes ARMA and GARCH-processes as well as data from chaotic dynamical systems. We establish the strong consistency of the bootstrap distribution estimator not only for the sample mean, but also for U-statistics, which include examples as Gin…
In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A simple method is to linearly average the parameters of the local models, which, however, tends to be degenerate or not applicable on non-convex models, or models with different parameter dimensions. One more practical strategy is to generate bootstrap samples from the local models, and then learn a joint model based on the combined bootstrap set. Unfortunately, t…
Median absolute deviation (hereafter MAD) is known as a robust alternative to the ordinary variance. It has been widely utilized to induce robust statistical inferential procedures. In this paper, we investigate the strong and weak Bahadur representations of its bootstrap counterpart. As a useful application, we utilize the results to derive the weak Bahadur representation of the bootstrap sample projection depth weighted mean---a quite important location estimator depending on MAD.
Recently there has been much interest in data that, in statistical language, may be described as having a large crossed and severely unbalanced random effects structure. Such data sets arise for recommender engines and information retrieval problems. Many large bipartite weighted graphs have this structure too. We would like to assess the stability of algorithms fit to such data. Even for linear statistics, a naive form of bootstrap sampling can be seriously misleading and McCullagh [Bernoulli 6 (2000) 285--301] has shown that no bootstrap method is exact. We show that an alternative bootstrap…
Statistical multispecies models of multiarea marine ecosystems use a variety of data sources to estimate parameters using composite or weighted likelihood functions with associated weighting issues and questions on how to obtain variance estimates. Regardless of the method used to obtain point estimates, a method is needed for variance estimation. A bootstrap technique is introduced for the evaluation of uncertainty in such models, taking into account inherent spatial and temporal correlations in the data sets thus avoiding many model--specification issues, which are commonly transferred as as…
We propose a class of weighted $L_2$-type tests of fit to the Gamma distribution. Our novel procedure is based on a fixed point property of a new transformation connected to a Steinian characterization of the family of Gamma distributions. We derive the weak limits of the statistic under the null hypothesis and under contiguous alternatives. Further, we establish the global consistency of the tests and apply a parametric bootstrap technique in a Monte Carlo simulation study to show the competitiveness to existing procedures.
This paper shows an analysis of the gridded European precipitation data. We combine simple linear regression with data mining tools like clustering, and evaluate the strength of the results by the modern bootstrap methods. We have used the 0.5 grade-grid of daily temperatures for 65 years, created by the European Climate Assessment. We have checked the stability of the results by changing the starting point of the linear regression - this approach might be valuable for climatologists in finding the "best" starting point for assessing the global warming in Europe. Different bootstrap approaches…
We propose Posterior Bootstrap, a set of algorithms extending Weighted Likelihood Bootstrap, to properly incorporate prior information and address the problem of model misspecification in Bayesian inference. We consider two approaches to incorporating prior knowledge: the first is based on penalization of the Weighted Likelihood Bootstrap objective function, and the second uses pseudo-samples from the prior predictive distribution. We also propose methodology for hierarchical models, which was not previously known for methods based on Weighted Likelihood Bootstrap. Edgeworth expansions guide t…
Inference procedures in sequential trial emulation with survival outcomes: comparing confidence intervals based on the sandwich variance estimator, bootstrap and jackknife
Length-biased data are a particular case of weighted data, which arise in many situations: biomedicine, quality control or epidemiology among others. In this paper we study the theoretical properties of kernel density estimation in the context of length-biased data, proposing two consistent bootstrap methods that we use for bandwidth selection. Apart from the bootstrap bandwidth selectors we suggest a rule-of-thumb. These bandwidth selection proposals are compared with a least-squares cross-validation method. A simulation study is accomplished to understand the behaviour of the procedures in f…
We propose a new class of goodness-of-fit tests for the inverse Gaussian distribution. The proposed tests are weighted $L^2$-type tests depending on a tuning parameter. We develop the asymptotic theory under the null hypothesis and under a broad class of alternative distributions. These results are used to show that the parametric bootstrap procedure, which we employ to implement the test, is asymptotically valid and that the whole test procedure is consistent. A comparative simulation study for finite sample sizes shows that the new procedure is competitive to classical and recent tests, outp…
Plausibility is a formalization of exact tests for parametric models and generalizes procedures such as Fisher's exact test. The resulting tests are based on cumulative probabilities of the probability density function and evaluate consistency with a parametric family while providing exact control of the $α$ level for finite sample size. Model comparisons are inefficient in this approach. We generalize plausibility by incorporating weighing which allows to perform model comparisons. We show that one weighing scheme is asymptotically equivalent to the likelihood ratio test (LRT) and has finite …
Vertically weighted averages perform a bilateral filtering of data, in order to preserve fine details of the underlying signal, especially discontinuities such as jumps (in dimension one) or edges (in dimension two). In homogeneous regions of the domain the procedure smoothes the data by averaging nearby data points to reduce the noise, whereas in inhomogenous regions the neighboring points are only taken into account when their value is close to the current one. This results in a denoised reconstruction or estimate of the true signal without blurring finer details. This paper addresses the la…
We introduce novel wild bootstrap procedures for testing superiority in unpaired two-sample survival data. By combining different classical weighted logrank test we obtain tests with broader power behavior. Right censoring within the data is allowed and may differ between the groups. The tests are shown to be asymptotically exact under the null, consistent for fixed alternatives and admissible for a larger set of local alternatives. Beside these asymptotic properties we also illustrate the procedures' strength in simulations for finite sample sizes. The tests are implemented in the novel R-pac…
A key tool to carry out inference on the unknown copula when modeling a continuous multivariate distribution is a nonparametric estimator known as the empirical copula. One popular way of approximating its sampling distribution consists of using the multiplier bootstrap. The latter is however characterized by a high implementation cost. Given the rank-based nature of the empirical copula, the classical empirical bootstrap of Efron does not appear to be a natural alternative, as it relies on resamples which contain ties. The aim of this work is to investigate the use of subsampling in the afore…
This project revolves around studying estimators for parameters in different Time Series models and studying their assymptotic properties. We introduce various bootstrap techniques for the estimators obtained. Our special emphasis is on Weighted Bootstrap. We establish the consistency of this scheme in a AR model and its variations. Numerical calculations lend further support to our consistency results. Next we analyze ARCH models, and study various estimators used for different error distributions. We also present resampling techniques for estimating the distribution of the estimators. Finall…
This paper establishes consistency of the weighted bootstrap for quadratic forms $\left( n^{-1/2} \sum_{i=1}^{n} Z_{i,n} \right)^{T}\left( n^{-1/2} \sum_{i=1}^{n} Z_{i,n} \right)$ where $(Z_{i,n})_{i=1}^{n}$ are mean zero, independent $\mathbb{R}^{d}$-valued random variables and $d=d(n)$ is allowed to grow with the sample size $n$, slower than $n^{1/4}$. The proof relies on an adaptation of Lindeberg interpolation technique whereby we simplify the original problem to a Gaussian approximation problem. We apply our bootstrap results to model-specification testing problems when the number of mome…
Weighted likelihood, in which one solves Horvitz-Thompson or inverse probability weighted (IPW) versions of the likelihood equations, offers a simple and robust method for fitting models to two phase stratified samples. We consider semiparametric models for which solution of infinite dimensional estimating equations leads to $\sqrt{N}$ consistent and asymptotically Gaussian estimators of both Euclidean and nonparametric parameters. If the phase two sample is selected via Bernoulli (i.i.d.) sampling with known sampling probabilities, standard estimating equation theory shows that the influence …
